Is Preregistration Worthwhile?

@article{Szollosi2020IsPW,
  title={Is Preregistration Worthwhile?},
  author={Aba Szollosi and David Kellen and Danielle Navarro and Richard M. Shiffrin and Iris van Rooij and Trisha Van Zandt and Chris Donkin},
  journal={Trends in Cognitive Sciences},
  year={2020},
  volume={24},
  pages={94-95}
}
Society for the Improvement of Psychological Science Global Engagement Task Force Report
The Society for the Improvement of Psychological Science (SIPS) is an organization whose mission focuses on bringing together scholars who want to improve methods and practices in psychologicalExpand
How Computational Modeling Can Force Theory Building in Psychological Science
TLDR
This work argues that one of the most divisive factors in psychological science is whether researchers choose to use computational modeling of theories over and above data during the scientific-inference process, and presents scientific inference in psychology as a path function in which each step shapes the next. Expand
A Bayesian meta-analysis of infants' ability to perceive audio-visual congruence for speech.
TLDR
It is suggested that infants' audio-visual matching ability for speech emerges at an early point in the process of language acquisition and remains stable for both native and non-native speech throughout early development. Expand
A Call for Greater Modesty in Psychology and Cognitive Neuroscience
Exaggerated claims and low levels of reproducibility are commonplace in psychology and cognitive neuroscience, due to an incentive structure that demands “newsworthy” results. My overall argumentExpand
Arrested Theory Development: The Misguided Distinction Between Exploratory and Confirmatory Research
  • A. Szollosi, Chris Donkin
  • Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2021
TLDR
It is proposed that a greater emphasis on theory criticism by argument might improve replicability, and rather than a lack of distinction between exploratory and confirmatory research, an abundance of flexible theories is a better explanation for the current Replicability problems of psychology. Expand
Code Review: An Important Step Towards Reproducible Research.
  • R. Platt
  • Medicine
  • American journal of epidemiology
  • 2021
TLDR
The fact that no one of these approaches is sufficient on its own is discussed; rather, these different steps need to become part of a culture that prioritizes reproducibility in research. Expand
Commentary: Rational Adaptation in Lexical Prediction: The Influence of Prediction Strength
TLDR
The current commentary critically reviews these analyses and performs re-analyses which show that their data, in fact, do not support the rational adaptation hypothesis. Expand
Comparing dream to reality: an assessment of adherence of the first generation of preregistered studies
TLDR
A closer look at preregistrations of the first generation reveals possible hurdles for reporting preregistered studies and provides input for future reporting guidelines, and provides recommendations for preregistered research. Expand
Designing for Interactive Exploratory Data Analysis Requires Theories of Graphical Inference
TLDR
It is described how without a grounding in theories of human statistical inference, research in exploratory visual analysis can lead to contradictory interface objectives and representations of uncertainty that can discourage users from drawing valid inferences. Expand
Easing Into Open Science: A Guide for Graduate Students and Their Advisors
This article provides a roadmap to assist graduate students and their advisors to engage in open science practices. We suggest eight open science practices that novice graduate students could beginExpand
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 14 REFERENCES
Arrested Theory Development: The Misguided Distinction Between Exploratory and Confirmatory Research
  • A. Szollosi, Chris Donkin
  • Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2021
TLDR
It is proposed that a greater emphasis on theory criticism by argument might improve replicability, and rather than a lack of distinction between exploratory and confirmatory research, an abundance of flexible theories is a better explanation for the current Replicability problems of psychology. Expand
A Model Hierarchy for Psychological Science
Lee et al. (2019) provided a comprehensive list of recommendations for modelers that aims at improving the robustness of their results. Drawing from the literature on philosophy of science, theExpand
Addressing the theory crisis in psychology.
TLDR
Recommendations for addressing the "replication crisis" are critically revisited, including the proposal to distinguish exploratory from confirmatory research, and the preregistration of hypotheses and analysis plans. Expand
Preregistration Is Hard, And Worthwhile
Preregistration clarifies the distinction between planned and unplanned research by reducing unnoticed flexibility. This improves credibility of findings and calibration of uncertainty. However,Expand
Preregistration of Modeling Exercises May Not Be Useful
TLDR
It is the opinion that preregistration of model development will lead to less, and to less creative, exploratory analysis, and that Lee at al. Expand
Psychological science needs theory development before preregistration
  • Psychon. Soc.
  • 2019
Between the Devil and the Deep Blue Sea: Tensions Between Scientific Judgement and Statistical Model Selection
  • D. Navarro
  • Psychology
  • Computational Brain & Behavior
  • 2018
Discussions of model selection in the psychological literature typically frame the issues as a question of statistical inference, with the goal being to determine which model makes the bestExpand
Scientific progress despite irreproducibility: A seeming paradox
TLDR
It appears paradoxical that science is producing outstanding new results and theories at a rapid rate at the same time that researchers are identifying serious problems in the practice of science that cause many reports to be irreproducible and invalid but this seeming paradox is not new, has always been part of the way science works, and likely will remain so. Expand
The Creative Cycle and the Growth of Psychological Science
  • K. Fiedler
  • Medicine, Psychology
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2018
Scientific progress relies on the dialectics of loosening and tightening processes. Although most gripping accomplishments in psychological science testify to the critical role of creative andExpand
What Constitutes Strong Psychological Science? The (Neglected) Role of Diagnosticity and A Priori Theorizing
  • K. Fiedler
  • Psychology, Medicine
  • Perspectives on psychological science : a journal of the Association for Psychological Science
  • 2017
TLDR
A Bayesian perspective on Ioannidis’s (2005) memorable statement that “Most Published Research Findings Are False” suggests a seemingly inescapable trade-off, within which exploratory phenomenon-driven research can play a similarly strong part as strict theory-testing science. Expand
...
1
2
...