9 books like Beyond Significance Testing

Ritchie was part of a team that attempted to replicate a famous study led by a prominent psychologist, Daryl Bem, claiming that people did better on a word memorization test if they studied the words after taking the test.

Ritchie and his co-authors attempted to replicate this study and found no evidence supporting Bem’s claim. This is but one example of a scientific crisis in that attempts to replicate influential studies published in top peer-reviewed journals fail nearly half the time. Ritchie explains and illustrates the reasons for the current replication crisis in science.

Yes, this is a textbook, but if you are seeking a research design and methods text for psychology or a related discipline, this is easily my top choice.

There are lots of references to topical stories to keep everything relevant for students. There’s a truckload of valuable stuff online to support both teachers and learners. This fourth edition is right up-to-the-moment, Chapter 3 especially so, as it explains three types of scientific claims, and four types of validity that researchers should aim to achieve. That may sound forbidding, but Morling’s examples and explanations are pleasingly accessible.  

Another research design textbook, this one more specifically about neuroscience. My co-author, neuroscientist Robert Calin-Jageman, highly recommends it.

This third edition has clear and up-to-date discussions of issues such as p hacking and publication bias that emphasise the need for Open Science. There’s a focus on effect sizes and confidence intervals, as in the new statistics. The book also describes strategies needed to enhance the rigor and reproducibility of neuroscience research.

Charlotte Pennington eagerly started her PhD but became anxious and depressed when her experiments "didn’t work’" and were refused publication. She read about the replication crisis — many published studies won’t replicate—and Open Science. Soon, it was her passion to teach about Open Science and what’s needed to achieve efficient research and trustworthy research literature.

The result is A Student’s Guide to Open Science. It’s short, clear, and highly readable. She’s well-informed and covers the story in engaging detail. There are practical guides to using Open Science practices and numerous links to follow as you wish. Statistical issues are mentioned but are not her focus.

There is a cottage industry of historical and analytical books attempting to explain where, exactly, our educational norms, structures, and strictures came from. Many of these are terrific, but Lagemann’s An Elusive Science is the best of the bunch for exploring how nineteenth and twentieth-century scientific research influenced modern educational practice. The author is the source of a line oft-quoted in ed circles: “I have often argued to students, only in part to be perverse, that one cannot understand the history of education in the United States during the twentieth century unless one realizes that Edward L. Thorndike won and John Dewey lost.” This is the book that explicates and explores this almost primordial dichotomy, and how different philosophies of science became aligned with complementary philosophies of educational practice. A piercing, impeccably researched, enjoyable read. 

This book contains 17 chapters written by educational psychologists who have worked with creativity.  These chapters range from establishing the best conditions in organizations for creativity to occur, how to test for creativity, problem-solving and creativity, freedom, and constraint in creativity, time’s impact on creativity, how dreams and other insights influence creativity, how society influences creativity, the relevance of talent in creativity, to leadership involving creativity. The spectrum of perspectives is broad indeed and I have personally gleaned much about all the relevant domains relating to creativity from reading this book.

This book is a compilation of chapters written by (mostly) psychology professors who have dealt with creativity extensively throughout their careers, and I highly recommend it. The topics cover psychometric approaches to creativity, experimental studies in creativity, the history of creativity, biological bases of creativity, the development of creativity, relationships between creativity and intelligence, the types of motivation necessary to produce creative outputs, cultural aspects of creativity, computer modeling in creativity, the development of prodigies, and significant research into creative processes. I gained valuable insights into domains and areas that I never would have considered otherwise.

Though this book focuses on psychology, it has lessons for all social sciences.

Chambers, like me, is critical of certain practices and yet deeply respectful of what has been accomplished. He devotes much of his attention to the problem of confirmation bias. We as humans are more likely to accept results that conform to prior beliefs.

Journals are also more likely to publish such results. Scholars play with their findings, adding or removing data points to achieve a target level of statistical significance. The result is that we are often more confident in scholarly consensus than we should be. Chambers explains complex ideas clearly, and is passionate about the need for reform.

This book is kind of a fun crash course in statistics which covers all the basic concepts at an introductory level.

The cartoons are a little bit dated, but still entertaining. There are lots of pictures and graphs which are a pleasure if you are a visual learner. The reader will come away with many useful tools to help understand real world problems.

I’m a retired math professor, but still got a real kick out of this book and especially appreciated the many good examples referenced such as gender discrimination in salaries and racial discrimination in jury selection. I recommended it to many of my struggling students.