Teaching Replication

  title={Teaching Replication},
  author={Michael C. Frank and Rebecca Saxe},
  journal={Perspectives on Psychological Science},
  pages={600 - 604}
Replication is held as the gold standard for ensuring the reliability of published scientific literature. But conducting direct replications is expensive, time-consuming, and unrewarded under current publication practices. So who will do them? The authors argue that students in laboratory classes should replicate recent findings as part of their training in experimental methods. In their own courses, the authors have found that replicating cutting-edge results is exciting and fun; it gives… 
Bringing the Gold Standard into the Classroom: Replication in University Teaching
Reproducibility is held to be the gold standard for scientific research. The credibility of published work depends on being able to replicate the results. However, there are few incentives to conduct
Improving the Replicability of Psychological Science Through Pedagogy
Replications are important to science, but who will do them? One proposal is that students can conduct replications as part of their training. As a proof of concept for this idea, here we report a
Teaching Replication to Graduate Students
Replicating published studies promotes active learning of quantitative research skills. Drawing on experiences from a replication course, we provide practical tips and reflections for teachers who
Facts Are More Important Than Novelty
Despite increased attention to methodological rigor in education research, the field has focused heavily on experimental design and not on the merit of replicating important results. The present
Replication and Reproducibility in Cross-Cultural Psychology
Replication is the scientific gold standard that enables the confirmation of research findings. Concerns related to publication bias, flexibility in data analysis, and high-profile cases of academic
Recommendations for Increasing Replicability in Psychology †
Replicability of findings is at the heart of any empirical science. The aim of this article is to move the current replicability debate in psychology towards concrete recommendations for improvement.
Toward Greater Reproducibility of Undergraduate Behavioral Science Research
  • B. Blaine
  • Psychology
    Council on Undergraduate Research Quarterly
  • 2019
Reproducibility crises have arisen in psychology and other behavioral sciences, spurring efforts to ensure research findings are credible and replicable. Although reforms are occurring at
A Successful Test of Parallel Replication Teams in Teaching Research Methods.
It is now recognised that published results often cannot be replicated by independent investigators, leading to the pervasive file-drawer problem and the definitive study of reproducibility to date reported success in only 39 out of 100 carefully conducted replication attempts.
Using replication projects in teaching research methods
The replication crisis today Rosenthal’s (1979) seminal paper first pointed out the ‘file drawer problem’: journals print papers that are often based on Type 1 errors while the file drawers of
How to Teach Open Science Principles in the Undergraduate Curriculum—The Hagen Cumulative Science Project
The Hagen Cumulative Science Project is a large-scale replication project based on students’ thesis work. In the project, we aim to (a) teach students to conduct the entire research process for


Tracking Replicability as a Method of Post-Publication Open Evaluation
This paper proposes tracking replications as a means of post-publication evaluation, both to help researchers identify reliable findings and to incentivize the publication of reliable results.
How Journal Editors View Replication Research
Abstract The usefulness of replication research is a widely debated topic in the social sciences. Although most scholars recognize the need for a replication tradition in their respective
The Role of the Laboratory in Science Teaching: Neglected Aspects of Research
The laboratory has been given a central and distinctive role in science education, and science educators have suggested that there are rich benefits in learning from using laboratory activities. At
The file drawer problem and tolerance for null results
Quantitative procedures for computing the tolerance for filed and future null results are reported and illustrated, and the implications are discussed.
Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research
Practices of data analysis in psychology and related disciplines are changing. This is evident in the longstanding controversy about statistical tests in the behavioral sciences and the increasing
The earth is round (p < .05)
After 4 decades of severe criticism, the ritual of null hypothesis significance testing (mechanical dichotomous decisions around a sacred .05 criterion) still persists. This article reviews the
Statistical Methods in Psychology Journals: Guidelines and Explanations
In the light of continuing debate over the applications of significance testing in psychology journals and following the publication of Cohen's (1994) article, the Board of Scientific Affairs (BSA)
Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011).
It is concluded that Bem's p values do not indicate evidence in favor of precognition; instead, they indicate that experimental psychologists need to change the way they conduct their experiments and analyze their data.
Failing the Future: Three Unsuccessful Attempts to Replicate Bem's ‘Retroactive Facilitation of Recall’ Effect
Three pre-registered independent attempts to exactly replicate one of recently reported parapsychological experiments, ‘retroactive facilitation of recall’, which examines whether performance on a memory test can be influenced by a post-test exercise, failed to produce significant effects and thus do not support the existence of psychic ability.