My favorite books for learning about open science and how to do better research with better statistics

Why am I passionate about this?

I gradually shifted my statistics teaching from significance testing — traditional but bamboozling — to estimation (confidence intervals), which I called "the new statistics" because, although not new, relying on it would, for many researchers, be very new. It’s more informative, makes sense, and is a pleasure to teach and use. I "retired" to write Understanding the New Statistics. Then Open Science arrived—hooray! Robert Calin-Jageman joined me for an intro textbook with Open Science and The New Statistics all through. Our first edition came out in 2017. The second edition has wonderful new open-source software (‘esci’), which is also ideal for more advanced students and researchers. Enjoy!


I wrote...

Introduction to the New Statistics: Estimation, Open Science, and Beyond

By Geoff Cumming, Robert Calin-Jageman,

Book cover of Introduction to the New Statistics: Estimation, Open Science, and Beyond

What is my book about?

It’s the first introductory statistics text to use an estimation approach and explain Open Science from the very start. Estimation helps readers understand effect sizes, confidence intervals, and meta-analysis (‘the new statistics’). Open Science practices are new and exciting: They encourage replication and enhance the trustworthiness of research.

The book also explains traditional significance testing so students can understand old published research. There are numerous real research examples. The approach is highly visual, to make ideas accessible and memorable. The free open-source R-based esci (estimation statistics with confidence intervals) software makes concepts visually vivid and provides calculation and graphing facilities. It’s ideal for students at all levels and for researchers.

Shepherd is reader supported. When you buy books, we may earn an affiliate commission.

The books I picked & why

Book cover of A Student's Guide to Open Science: Using the Replication Crisis to Reform Psychology

Geoff Cumming Why did I love this book?

Charlotte Pennington eagerly started her PhD but became anxious and depressed when her experiments "didn’t work’" and were refused publication. She read about the replication crisis — many published studies won’t replicate—and Open Science. Soon, it was her passion to teach about Open Science and what’s needed to achieve efficient research and trustworthy research literature.

The result is A Student’s Guide to Open Science. It’s short, clear, and highly readable. She’s well-informed and covers the story in engaging detail. There are practical guides to using Open Science practices and numerous links to follow as you wish. Statistical issues are mentioned but are not her focus.

By Charlotte Pennington,

Why should I read it?

1 author picked A Student's Guide to Open Science as one of their favorite books, and they share why you should read it.

What is this book about?

"Dr Charlotte R. Pennington has pulled off a remarkable trifecta of being clear, concise, and comprehensive in covering the origins of the open science movement and practical advice for adopting the behaviors"

Professor Brian Nosek, Executive Director, Center for Open Science; University of Virginia, US

"My hope is that every psychology student will finish their degree with a heavily annotated, well-thumbed copy of this important and timely book!"

Dr Madeleine Pownall, University of Leeds, UK

"This book should be on the reading list for all university science degrees and on all library bookshelves. It is concise, accessible, and remarkably interactive,…


Book cover of Science Fictions: How Fraud, Bias, Negligence, and Hype Undermine the Search for Truth

Geoff Cumming Why did I love this book?

I love how Ritchie starts with a rather wry account, addressed directly to you as a would-be researcher, of the challenges and weirdness you’ll encounter as you launch into your own research.

His own research helped sparked recognition of the ‘replication crisis,’ so he’s well placed to tell us about misguided practices and the sometimes wicked deeds of researchers. More happily, he describes how we can return to the sound foundations of good scientific practice. A current term for that is ‘Open Science.’

By Stuart Ritchie,

Why should I read it?

3 authors picked Science Fictions as one of their favorite books, and they share why you should read it.

What is this book about?

An insider’s view of science reveals why many scientific results cannot be relied upon – and how the system can be reformed.

Science is how we understand the world. Yet failures in peer review and mistakes in statistics have rendered a shocking number of scientific studies useless – or, worse, badly misleading. Such errors have distorted our knowledge in fields as wide-ranging as medicine, physics, nutrition, education, genetics, economics, and the search for extraterrestrial life. As Science Fictions makes clear, the current system of research funding and publication not only fails to safeguard us from blunders but actively encourages bad…


Book cover of Beyond Significance Testing

Geoff Cumming Why did I love this book?

You may have heard of ‘significance testing,’ and the magical ‘p < .05,’ which somehow makes a research result ‘significant,’ which is often taken as (almost) ‘true.’ Even if you haven’t heard of all that, Kline explains clearly why significance testing has been disastrous for science, leading to misleading conclusions and much valuable research not even being reported.

He draws on my work to explain how ‘the new statistics’ (estimation) is a much better way to understand results. The first chapter is fairly easy to read. Later chapters are also terrific but get more technical as Kline explains lots of ways to do things better. As I’m quoted on the back cover, “Read this book and see the future!” Happily, the future is increasingly looking as Kline recommended.

By Rex B. Kline,

Why should I read it?

1 author picked Beyond Significance Testing as one of their favorite books, and they share why you should read it.

What is this book about?

Traditional education in statistics that emphasises significance testing leaves researchers and students ill prepared to understand what their results really mean. Specifically, most researchers and students who do not have strong quantitative backgrounds have difficulty understanding outcomes of statistical tests.

As more and more people become aware of this problem, the emphasis on statistical significance in the reporting of results is declining. Increasingly, researchers are expected to describe the magnitudes and precisions of their findings and also their practical, theoretical, or clinical significance.

This accessibly written book reviews the controversy about significance testing, which has now crossed various disciplines as…


Book cover of Research Methods in Psychology: Evaluating a World of Information

Geoff Cumming Why did I love this book?

Yes, this is a textbook, but if you are seeking a research design and methods text for psychology or a related discipline, this is easily my top choice.

There are lots of references to topical stories to keep everything relevant for students. There’s a truckload of valuable stuff online to support both teachers and learners. This fourth edition is right up-to-the-moment, Chapter 3 especially so, as it explains three types of scientific claims, and four types of validity that researchers should aim to achieve. That may sound forbidding, but Morling’s examples and explanations are pleasingly accessible.  

By Beth Morling,

Why should I read it?

1 author picked Research Methods in Psychology as one of their favorite books, and they share why you should read it.

What is this book about?

Featuring an emphasis on future consumers of psychological research and examples drawn from popular media, Research Methods in Psychology: Evaluating a World of Information develops students' critical-thinking skills as they evaluate information in their everyday lives. The Fourth Edition of this best-selling text takes learning to a new level for both consumers and producers by offering new content, interactive learning, and online assessment to help them master the concepts.


Book cover of The Design of Experiments in Neuroscience

Geoff Cumming Why did I love this book?

Another research design textbook, this one more specifically about neuroscience. My co-author, neuroscientist Robert Calin-Jageman, highly recommends it.

This third edition has clear and up-to-date discussions of issues such as p hacking and publication bias that emphasise the need for Open Science. There’s a focus on effect sizes and confidence intervals, as in the new statistics. The book also describes strategies needed to enhance the rigor and reproducibility of neuroscience research.

By Mary E. Harrington,

Why should I read it?

1 author picked The Design of Experiments in Neuroscience as one of their favorite books, and they share why you should read it.

What is this book about?

Using engaging prose, Mary E. Harrington introduces neuroscience students to the principles of scientific research including selecting a topic, designing an experiment, analyzing data, and presenting research. This new third edition updates and clarifies the book's wealth of examples while maintaining the clear and effective practical advice of the previous editions. New and expanded topics in this edition include techniques such as optogenetics and conditional transgenes as well as a discussion of rigor and reproducibility in neuroscience research. Extended coverage of descriptive and inferential statistics arms readers with the analytical tools needed to interpret data. Throughout, practical guidelines are provided…


You might also like...

Book cover of This Animal Body

Meredith Walters

New book alert!

What is my book about?

Neuroscience PhD student Frankie Conner has finally gotten her life together—she’s determined to discover the cause of her depression and find a cure for herself and everyone like her. But the first day of her program, she meets a group of talking animals who have an urgent message they refuse to share. And while the animals may not have Frankie’s exalted human brain, they know things she doesn’t, like what happened before she was adopted.

To prove she’s sane, Frankie investigates her forgotten past and conducts clandestine experiments. But just when she uncovers the truth, she has to make an impossible choice: betray the animals she’s fallen in love with—or give up her last chance at success and everything she thought she knew.

By Meredith Walters,

Why should I read it?

1 author picked This Animal Body as one of their favorite books, and they share why you should read it.

What is this book about?

Frankie Conner, first-year graduate student at UC Berkeley, is finally getting her life together. After multiple failures and several false starts, she's found her calling: become a neuroscientist, discover the cause of her depression and anxiety, and hopefully find a cure for herself and everyone like her.

But her first day of the program, Frankie meets a mysterious group of talking animals who claim to have an urgent message for her. The problem is, they're not willing to share it. Not yet. Not until she's ready.

While Frankie's new friends may not have her highly evolved, state-of-the-art, exalted human brain,…


5 book lists we think you will like!

Interested in psychology, philosophy, and social science?

10,000+ authors have recommended their favorite books and what they love about them. Browse their picks for the best books about psychology, philosophy, and social science.

Psychology Explore 1,697 books about psychology
Philosophy Explore 1,552 books about philosophy
Social Science Explore 79 books about social science