The Alleged Crisis and the Illusion of Exact Replication

@article{Stroebe2014TheAC,
  title={The Alleged Crisis and the Illusion of Exact Replication},
  author={Wolfgang Stroebe and Fritz Strack},
  journal={Perspectives on Psychological Science},
  year={2014},
  volume={9},
  pages={59 - 71}
}
There has been increasing criticism of the way psychologists conduct and analyze studies. These critiques as well as failures to replicate several high-profile studies have been used as justification to proclaim a “replication crisis” in psychology. Psychologists are encouraged to conduct more “exact” replications of published studies to assess the reproducibility of psychological research. This article argues that the alleged “crisis of replicability” is primarily due to an epistemological… 
When a Crisis Becomes an Opportunity: The Role of Replications in Making Better Theories
While it is widely acknowledged that psychology is in the throes of a replication ‘crisis’, relatively little attention has been paid to the role theory plays in our evaluation of replications as
Psychology’s Replication Crisis as Scientific Opportunity: A Précis for Policymakers
Psychological science is in the midst of what has been referred to as a “replication crisis.” The realization that many individual findings do not replicate in new studies has led to questioning the
Testing the effect of cooperative/competitive priming on the Prisoner’s Dilemma. A replication study
TLDR
An intuitive prime-to-behavior effect in which Kay and Ross (2003) used a 2x2 design to test cooperation/competition priming crossed with an explicit/non-explicit construal of a Prisoner’s Dilemma is replicated.
Moving Beyond Unwise Replication Practices: The Case of Romantic Motivation
TLDR
An article by Shanks and colleagues (2015) conducting a meta-analysis of studies examining romantic motivation, using problematic criteria for the inclusion of effects and reaching conclusions of a null effect that were unwarranted is considered.
Making replication mainstream
TLDR
There are no theoretical or statistical obstacles to making direct replication a routine aspect of psychological science, and the need for an integrative summary of replication studies is addressed.
Psychology's Renaissance
TLDR
It is shown that the scientific practices of experimental psychologists have improved dramatically and is argued that meta‐analytical thinking increases the prevalence of false positives.
Statistical Rituals: The Replication Delusion and How We Got There
  • G. Gigerenzer
  • Psychology
    Advances in Methods and Practices in Psychological Science
  • 2018
The “replication crisis” has been attributed to misguided external incentives gamed by researchers (the strategic-game hypothesis). Here, I want to draw attention to a complementary internal factor,
Low replicability can support robust and efficient science
TLDR
It is found that the publication of potentially non-replicable studies minimizes cost and maximizes efficiency of knowledge gain for the scientific community under a variety of assumptions and suggests that low replicability can support robust and efficient science.
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 99 REFERENCES
Is the Replicability Crisis Overblown? Three Arguments Examined
  • H. Pashler, C. Harris
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
It is argued that there are no plausible concrete scenarios to back up such forecasts and that what is needed is not patience, but rather systematic reforms in scientific practice.
Under what conditions does theory obstruct research progress?
Researchers display confirmation bias when they persevere by revising procedures until obtaining a theory-predicted result. This strategy produces findings that are overgeneralized in avoidable ways,
Consequences of Prejudice Against the Null Hypothesis
The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Replication is one of the most important tools for the verification of facts within the empirical sciences. A detailed examination of the notion of replication reveals that there are many different
The Rules of the Game Called Psychological Science
TLDR
This paper considers 13 meta-analyses covering 281 primary studies in various fields of psychology and finds indications of biases and/or an excess of significant results in seven, highlighting the need for sufficiently powerful replications and changes in journal policies.
Behavioral Priming: It's All in the Mind, but Whose Mind?
TLDR
It is concluded that unconscious behavioral priming is real, while real, involves mechanisms different from those typically assumed to cause the effect.
PsychDisclosure.org
  • E. Lebel, D. Borsboom, C. Smith
  • Psychology
    Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2013
TLDR
It is argued that the time is now for mandatory methods disclosure statements for all psychology journals, which would be an important step forward in improving the reliability of findings in psychology.
The neglected 95%: why American psychology needs to become less American.
  • J. Arnett
  • Psychology
    The American psychologist
  • 2008
TLDR
It is proposed that psychological research published in APA journals focuses too narrowly on Americans, which results in an understanding of psychology that is incomplete and does not adequately represent humanity.
Priming Intelligent Behavior: An Elusive Phenomenon
TLDR
None of the experiments obtained the intelligence priming effect, although financial incentives did boost performance, and a Bayesian analysis reveals considerable evidential support for the null hypothesis.
Awareness of the influence as a determinant of assimilation versus contrast
In the present study, subjects had to generate an evaluative judgment about a target person on the basis of his behaviour that had both positive and negative implications. In a previous phase of the
...
1
2
3
4
5
...