Preregistration of Analyses of Preexisting Data

@article{Mertens2019PreregistrationOA,
  title={Preregistration of Analyses of Preexisting Data},
  author={Ga{\"e}tan Mertens and Angelos-Miltiadis Krypotos},
  journal={Psychologica Belgica},
  year={2019},
  volume={59},
  pages={338 - 352}
}
The preregistration of a study’s hypotheses, methods, and data-analyses steps is becoming a popular psychological research practice. To date, most of the discussion on study preregistration has focused on the preregistration of studies that include the collection of original data. However, much of the research in psychology relies on the (re-)analysis of preexisting data. Importantly, this type of studies is different from original studies as researchers cannot change major aspects of the study… Expand

Topics from this paper

Preregistration of secondary data analysis: A template and tutorial
TLDR
This tutorial presents a template specifically designed for the preregistration of secondary data analyses and shows that completing such a template is feasible, helps limit researcher degrees of freedom, and may make researchers more deliberate in their data selection and analysis efforts. Expand
Making ERP research more transparent: Guidelines for preregistration.
TLDR
An overview of the problems associated with undisclosed analytic flexibility is presented, why and how EEG researchers would benefit from adopting preregistration are discussed, and guidelines and examples on how to preregister data preprocessing and analysis steps in typical ERP studies are provided. Expand
Making the Black Box Transparent: A Template and Tutorial for Registration of Studies Using Experience-Sampling Methods
A growing interest in understanding complex and dynamic psychological processes as they occur in everyday life has led to an increase in studies using ambulatory assessment techniques, including theExpand
Robust Standards in Cognitive Science
Recent discussions within the mathematical psychology community have focused on how Open Science practices may apply to cognitive modelling. Lee et al. (2019) sketched an initial approach forExpand
Beyond the challenge hypothesis: The emergence of the dual-hormone hypothesis and recommendations for future research
TLDR
The dual-hormone hypothesis, according to this hypothesis, testosterone's association with status-seeking behavior depends on levels of cortisol, and potential explanations for this heterogeneity are discussed. Expand
Running head: BEYOND THE CHALLENGE HYPOTHESIS In press at Hormones and Behavior Beyond the Challenge Hypothesis: The Emergence of the Dual-Hormone Hypothesis and Recommendations for Future Research
The challenge hypothesis makes specific predictions about the association between testosterone and status-seeking behaviors, but the findings linking testosterone to these behaviors are inconsistent.Expand
Actionable recommendations for narrowing the science-practice gap in open science
Abstract Efforts to promote open-science practices are, to a large extent, driven by a need to reduce questionable research practices (QRPs). There is ample evidence that QRPs are corrosive becauseExpand

References

SHOWING 1-10 OF 76 REFERENCES
A step-by-step guide on preregistration and effective data sharing for psychopathology research.
TLDR
It is argued that this workflow will result in more transparent and easily shareable psychopathology research, eventually increasing and replicability reproducibility in the research field. Expand
Pre-registration in social psychology—A discussion and suggested template
Abstract Pre-registration of studies before they are conducted has recently become more feasible for researchers, and is encouraged by an increasing number of journals. However, because the practiceExpand
Recommendations for Increasing the Transparency of Analysis of Preexisting Data Sets
TLDR
It is explained that secondary data analysis can be used for either exploratory or confirmatory work, and can be either correlational or experimental, and the advantages and disadvantages of this type of research are highlighted. Expand
An Agenda for Purely Confirmatory Research
TLDR
This article proposes that researchers preregister their studies and indicate in advance the analyses they intend to conduct, and proposes that only these analyses deserve the label “confirmatory,” and only for these analyses are the common statistical tests valid. Expand
Ensuring the quality and specificity of preregistrations
TLDR
It is concluded that effective preregistration is challenging, and registration formats that provide effective guidance may improve the quality of research. Expand
The Quality of Response Time Data Inference: A Blinded, Collaborative Assessment of the Validity of Cognitive Models
TLDR
It is recommended that cognitive models become a typical analysis tool for response time data, and it is argued that the simpler models and procedures are sufficient for standard experimental designs. Expand
On the reproducibility of meta-analyses: six practical recommendations
TLDR
The recommendations put forward in this article aim to improve the reproducibility of meta-analyses by allowing the shared data to be re-analyzed as new theoretical viewpoints emerge or as novel statistical techniques are developed, and have the benefit of “future-proofing” meta-Analyses. Expand
The ironic effect of significant results on the credibility of multiple-study articles.
TLDR
One major recommendation is to pay more attention to the power of studies to produce positive results without the help of questionable research practices and to request that authors justify sample sizes with a priori predictions of effect sizes. Expand
Increasing Transparency Through a Multiverse Analysis
TLDR
It is shown that analyzing a single data set can be misleading and a multiverse analysis is proposed as an alternative practice, which involves performing all analyses across the whole set of alternatively processed data sets corresponding to a large set of reasonable scenarios. Expand
Sample Sizes and Effect Sizes are Negatively Correlated in Meta-Analyses: Evidence and Implications of a Publication Bias Against NonSignificant Findings
Meta-analysis involves cumulating effects across studies in order to qualitatively summarize existing literatures. A recent finding suggests that the effect sizes reported in meta-analyses may beExpand
...
1
2
3
4
5
...