Editors’ Introduction to the Special Section on Replicability in Psychological Science

@article{Pashler2012EditorsIT,
  title={Editors’ Introduction to the Special Section on Replicability in Psychological Science},
  author={Harold Pashler and Eric-Jan Wagenmakers},
  journal={Perspectives on Psychological Science},
  year={2012},
  volume={7},
  pages={528 - 530}
}
Is there currently a crisis of confidence in psychological science reflecting an unprecedented level of doubt among practitioners about the reliability of research findings in the field? It would certainly appear that there is. These doubts emerged and grew as a series of unhappy events unfolded in 2011: the Diederik Stapel fraud case (see Stroebe, Postmes, & Spears, 2012, this issue), the publication in a major social psychology journal of an article purporting to show evidence of extrasensory… Expand
View on SAGE
faculty.ucmerced.edu
855 Citations
Highly Influential Citations
6
Background Citations
283
Methods Citations
12
Results Citations
30

855 Citations

Citation Type

Citation Type

Less Is More: Psychologists Can Learn More by Studying Fewer People
TLDR
The reliance on group comparisons is arguably the most fundamental problem at hand because such designs are what often necessitate the kinds of statistical analyses that have led to psychology's professional crisis. Expand
Psychology's Renaissance
TLDR
It is shown that the scientific practices of experimental psychologists have improved dramatically and is argued that meta‐analytical thinking increases the prevalence of false positives. Expand
A New Replication Norm for Psychology
In recent years, there has been a growing concern regarding the replicability of findings in psychology, including a mounting number of prominent findings that have failed to replicate via… Expand
Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Over the last few years, psychology researchers have become increasingly preoccupied with the question of whether findings from psychological studies are generally replicable. The debates have… Expand
Psychological science from 'publish or perish' to 'trust but verify'
At the time when social psychologists believed they could be proud of their discipline, there was the devastating news that Diederik Stapel had committed a major scientific fraud. This event… Expand
Using replication projects in teaching research methods
The replication crisis today Rosenthal’s (1979) seminal paper first pointed out the ‘file drawer problem’: journals print papers that are often based on Type 1 errors while the file drawers of… Expand
Negativland - a home for all findings in psychology
  • K. Laws
  • Psychology, Medicine
  • BMC psychology
  • 2013
TLDR
A serious challenge for psychologists to get their house in-order is to make sure that replications and null findings find a home in psychology rather than remain the authors' dirty little secrets that further eat away at the credibility of their science. Expand
The psychology of experimental psychologists: Overcoming cognitive constraints to improve research: The 47th Sir Frederic Bartlett Lecture
  • D. Bishop
  • Medicine, Psychology
  • Quarterly journal of experimental psychology
  • 2019
TLDR
It is argued that if proposed solutions to the replication crisis are to be effective, they need to take into account human cognitive constraints that can distort all stages of the research process, including design and execution of experiments, analysis of data, and writing up findings for publication. Expand
The Crisis of Confidence in Research Findings in Psychology: Is Lack of Replication the Real Problem? Or Is It Something Else?
There have been frequent expressions of concern over the supposed failure of researchers to conduct replication studies. But the large number of meta-analyses in our literatures shows that… Expand
Is the call to abandon p-values the red herring of the replicability crisis?
TLDR
Skepticism is expressed that alternative hypothesis testing frameworks, such as Bayes factors, are a solution to the replicability crisis and the value of applying the same standards of evidence that psychologists demand in choosing between competing substantive hypotheses is highlighted. Expand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 29 REFERENCES
Is the Replicability Crisis Overblown? Three Arguments Examined
  • H. Pashler, C. Harris
  • Sociology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
It is argued that there are no plausible concrete scenarios to back up such forecasts and that what is needed is not patience, but rather systematic reforms in scientific practice. Expand
Why psychologists must change the way they analyze their data: the case of psi: comment on Bem (2011).
TLDR
It is concluded that Bem's p values do not indicate evidence in favor of precognition; instead, they indicate that experimental psychologists need to change the way they conduct their experiments and analyze their data. Expand
Why Science Is Not Necessarily Self-Correcting
  • J. Ioannidis
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
A number of impediments to self-correction that have been empirically studied in psychological science are cataloged and some proposed solutions to promote sound replication practices enhancing the credibility of scientific results are discussed. Expand
Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science
  • R. Giner-Sorolla
  • Sociology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
To open the bottleneck, putting structures in place to reward broader forms of information sharing beyond the exquisite art of present-day journal publication is suggested, suggesting a more palatable solution to the crisis in psychological research. Expand
The poor availability of psychological research data for reanalysis.
TLDR
A failed attempt to obtain data reported in 141 empirical articles recently published by the APA, to assess the robustness of the research findings to outliers. Expand
Willingness to Share Research Data Is Related to the Strength of the Evidence and the Quality of Reporting of Statistical Results
TLDR
It is suggested that statistical results are particularly hard to verify when reanalysis is more likely to lead to contrasting conclusions, which highlights the importance of establishing mandatory data archiving policies. Expand
Why Most Published Research Findings Are False
TLDR
Simulations show that for most study designs and settings, it is more likely for a research claim to be false than true. Expand
Scientific Misconduct and the Myth of Self-Correction in Science
  • W. Stroebe, T. Postmes, R. Spears
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
The authors analyze a convenience sample of fraud cases to see whether (social) psychology is more susceptible to fraud than other disciplines and suggest a number of strategies that might reduce the risk of scientific fraud. Expand
An Open, Large-Scale, Collaborative Effort to Estimate the Reproducibility of Psychological Science
  • Brian A. Nosek, D. Lakens
  • Medicine, Psychology
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2012
TLDR
The Reproducibility Project is an open, large-scale, collaborative effort to systematically examine the rate and predictors of reproducibility in psychological science. Expand
Feeling the future: experimental evidence for anomalous retroactive influences on cognition and affect.
  • D. Bem
  • Psychology, Medicine
  • Journal of personality and social psychology
  • 2011
TLDR
9 experiments are reported, involving more than 1,000 participants, that test for retroactive influence by "time-reversing" well-established psychological effects so that the individual's responses are obtained before the putatively causal stimulus events occur. Expand
...
1
2
3
...