🔍

Revolutionizing Psychological Research Standards

Apr 16, 2025

Psychologists Confront Impossible Finding, Triggering a Revolution in the Field

Key Event: Daryl Bem's Study

  • In 2011, psychologist Daryl Bem published a study claiming precognition (the ability to sense the future) is real.
  • This study was explosive and questioned fundamental beliefs in psychology.
  • Jeff Galak from Carnegie Mellon University emphasized the radical implications if the study were true, affecting understanding of time, physics, and psychology.

The Replication Crisis

  • Bem's study was published in the Journal of Personality and Social Psychology.
  • Chris Chambers, a cognitive neuroscience professor, criticized the study for its "ridiculous conclusion" using standard methodologies.

Open Science Collaboration

  • A massive replication study was organized by Open Science Collaboration with 270 scientists across 17 countries.
  • 100 studies from 2008 were chosen to replicate; only 36% were successful.
  • This raised concerns about the reliability of psychological studies.

Reaction from the Field

  • Michael Inzlicht (University of Toronto) was shocked by the inability to replicate research in his field.
  • He questioned the integrity of past scientific methods and called for a reevaluation of research standards.

Building a New Foundation

  • Since 2011, psychology research standards have evolved significantly.

Introduction of Pre-registration

  • Researchers now outline hypotheses, methodologies, and data analysis plans prior to conducting experiments.
  • This prevents data manipulation to achieve desired outcomes.

Registered Reports

  • Over 200 scientific journals now practice "registered reports" accepting studies based on their methodology rather than results.

Formation of Organizations

  • New organizations like the Centre for Open Science and the Society for the Improvement of Psychological Science were established.
  • Emphasis on transparency, verification, and open scrutiny.

Key Figures

  • Jeff Galak: Professor at Carnegie Mellon University.
  • Daryl Bem: Professor emeritus, Cornell University.
  • Chris Chambers: Professor at Cardiff University, author of The Seven Deadly Sins of Psychology.
  • Michael Inzlicht: Professor at the University of Toronto, leads Toronto Laboratory for Social Neuroscience.
  • Simine Vazire: Associate professor at U.C. Davis, co-founder of the Society for the Improvement of Psychological Science.

Additional Contributors

  • Harry Collins: Cardiff University, expert on scientific knowledge.
  • Alexa Tullet: University of Alabama.
  • Alison Ledgerwood: U.C. Davis.

Conclusion

  • The replication crisis in psychology has led to broader changes in research methodology, emphasizing transparency and reliability in scientific findings.