Estimating the reproducibility of psychological science

@article{Aarts2015EstimatingTR,
  title={Estimating the reproducibility of psychological science},
  author={Alexander A. Aarts and Joanna E. Anderson and Christopher J. Anderson and Peter Raymond Attridge and A. Attwood and Jordan R Axt and M. Babel and {\vS}těp{\'a}n Bahn{\'i}k and Erica Baranski and M. Barnett-Cowan and E. Bartmess and J. Beer and R. Bell and Heather Bentley and Leah Beyan and Grace Binion and D. Borsboom and Annick Bosch and F. Bosco and S. Bowman and M. Brandt and E. L. Braswell and Hilmar Brohmer and B. T. Brown and Kristina Brown and Jovita Br{\"u}ning and Ann Calhoun-Sauls and Shannon P. Callahan and E. Chagnon and Jesse J Chandler and Christopher R. Chartier and F. Cheung and Cody Daniel Christopherson and L. Cillessen and Russ Clay and Hayley M. D. Cleary and M. Cloud and Michael Conn and J. Cohoon and Simon Columbus and A. Cordes and G. Costantini and L. Alvarez and E. Cremata and J. Crusius and J. DeCoster and M. DeGaetano and Nicol{\'a}s Delia Penna and Bobby Den Bezemer and M. Deserno and Olivia Devitt and Laura Dewitte and David G. Dobolyi and Geneva T. Dodson and M. Donnellan and Ryan Donohue and Rebecca A. Dore and Angela R Dorrough and A. Dreber and Michelle Dugas and Elizabeth W. Dunn and K. Easey and Sylvia Eboigbe and C. Eggleston and Jo Embley and S. Epskamp and T. Errington and Vivien Estel and Frank J. Farach and J. Feather and A. Fedor and Bel{\'e}n Fern{\'a}ndez-Castilla and S. Fiedler and J. G. Field and S. Fitneva and T. Flagan and Amanda L Forest and Eskil Forsell and J. D. Foster and Michael C. Frank and Rebecca S. Frazier and Heather M. Fuchs and Philip A. Gable and Jeff Galak and E. Galliani and Anup Gampa and Sara Garcia and Douglas Gazarian and E. Gilbert and R. Giner-Sorolla and A. Gl{\"o}ckner and Lars Goellner and Jin X. Goh and Rebecca M. Goldberg and P. T. Goodbourn and Shauna Gordon-McKeon and Bryan H. Gorges and Jessie Gorges and J. Goss and J. Graham and J. Grange and J. Gray and C.H.J. Hartgerink and Joshua K. Hartshorne and F. Hasselman and Timothy B Hayes and Emma Heikensten and Felix Henninger and J. Hodsoll and Taylor Holubar and G. Hoogendoorn and Denise J. Humphries and C. O. Hung and N. Immelman and V. C. Irsik and G. Jahn and F. J{\"a}kel and Marc Jekel and M. Johannesson and L. Johnson and D. J. Johnson and Kate M. Johnson and William Johnston and K. Jonas and Jennifer A. Joy-Gaba and H. Kappes and Kim Kelso and Mallory C Kidwell and Seung K. Kim and M. Kirkhart and Bennett Kleinberg and G. Kne{\vz}evi{\'c} and F. Kolorz and J. Kossakowski and R. Krause and J.M.T. Krijnen and T. Kuhlmann and Yoram K. Kunkels and Megan M. Kyc and C. Lai and Aamir Laique and D. Lakens and Kristin A. Lane and Bethany Lassetter and Ljiljana B. Lazarevi{\'c} and Etienne P. Le Bel and Key Jung Lee and Minha Lee and K. Lemm and C. Levitan and M. Lewis and Lin Lin and Stephanie C. Lin and Matthias Lippold and Darren Loureiro and Ilse Luteijn and S. Mackinnon and Heather N. Mainard and Denise C. Marigold and Daniel P. Martin and Tylar Martinez and E. Masicampo and Joshua J. Matacotta and Maya B. Mathur and Michael May and Nicole C Mechin and P. Mehta and Johannes M. Meixner and Alissa Melinger and Jeremy K. Miller and Mallorie Miller and K. Moore and Marcus M{\"o}schl and Matt Motyl and S. Muller and M. Munaf{\`o} and K. Neijenhuijs and Taylor Nervi and Gandalf Nicolas and G. Nilsonne and Brian A. Nosek and Mich{\`e}le B. Nuijten and C. Olsson and C. Osborne and Lutz Ostkamp and M. Pavel and I. Penton-Voak and O. Perna and C. Pernet and M. Perugini and R. Pipitone and M. Pitts and F. Plessow and J. Prenoveau and R. Rahal and Kate A Ratliff and David A. Reinhard and Frank Renkewitz and Ashley A. Ricker and A. Rigney and Andrew M Rivers and Mark A. Roebke and Abraham M. Rutchick and Robert S. Ryan and O. Şahin and Anondah Saide and Gillian M. Sandstrom and David Santos and R. Saxe and Ren{\'e} Schlegelmilch and Kathleen Schmidt and Sabine Scholz and L. Seibel and Dylan Selterman and S. Shaki and W. Simpson and H. Sinclair and Jeanine L. M. Skorinko and A. Slowik and J. Snyder and C. Soderberg and Carina Sonnleitner and N. Spencer and Jeffrey R. Spies and S. Steegen and S. Stieger and Nina Strohminger and G. Sullivan and Thomas Talhelm and M. Tapia and A. T. Dorsthorst and M. Thomae and Sarah L. Thomas and P. Tio and Frits Traets and Steve Tsang and F. Tuerlinckx and Paul Turchan and Milan Val{\'a}{\vs}ek and A. V. Veer and R. V. Aert and M. V. Assen and R. V. Bork and M. V. D. Ven and D. V. D. Bergh and M. Hulst and R. V. Dooren and J. Doorn and Daan R. van Renswoude and H. Rijn and W. Vanpaemel and Alejandro Echeverr{\'i}a and Melissa Vazquez and Natalia V{\'e}lez and Marieke Vermue and M. Verschoor and M. Vianello and M. Voracek and Gina Vuu and E. Wagenmakers and Joanneke Weerdmeester and Ashlee Welsh and Erin C Westgate and Joeri Wissink and M. Wood and A. Woods and Emily M. Wright and Sining Wu and M. Zeelenberg and Kellylynn Zuni},
  journal={Science},
  year={2015},
  volume={349}
}
Empirically analyzing empirical evidence One of the central goals in any scientific endeavor is to understand causality. Experiments that seek to demonstrate a cause/effect relation most often manipulate the postulated causal factor. Aarts et al. describe the replication of 100 experiments reported in papers published in 2008 in three high-ranking psychology journals. Assessing whether the replication and the original experiment yielded the same result according to several criteria, they find… Expand
What Should Researchers Expect When They Replicate Studies? A Statistical View of Replicability in Psychological Science
  • Prasad Patil, R. Peng, J. Leek
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2016
Replication in Psychological Science
Contextual sensitivity in scientific reproducibility
On the Reproducibility of Psychological Science
Large-Scale Replication Projects in Contemporary Psychological Research
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 79 REFERENCES
Continuously Cumulating Meta-Analysis and Replicability
What Kind of Empirical Research Should We Publish, Fund, and Reward?: A Different Perspective
  • P. Rozin
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2009
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
  • Brian A. Nosek, D. Lakens
  • Medicine, Psychology
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
Editors’ Introduction to the Special Section on Replicability in Psychological Science
  • H. Pashler, E. Wagenmakers
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
Tracking Replicability as a Method of Post-Publication Open Evaluation
Why Most Published Research Findings Are False
...
1
2
3
4
5
...