Making ERP research more transparent: Guidelines for preregistration.

@article{Paul2021MakingER,
  title={Making ERP research more transparent: Guidelines for preregistration.},
  author={Mariella Paul and Gisela Govaart and Antonio Schettino},
  journal={International journal of psychophysiology : official journal of the International Organization of Psychophysiology},
  year={2021}
}
  • Mariella Paul, G. Govaart, A. Schettino
  • Published 4 March 2021
  • Medicine
  • International journal of psychophysiology : official journal of the International Organization of Psychophysiology
A combination of confirmation bias, hindsight bias, and pressure to publish may prompt the (unconscious) exploration of various methodological options and reporting only the ones that lead to a (statistically) significant outcome. This undisclosed analytic flexibility is particularly relevant in EEG research, where a myriad of preprocessing and analysis pipelines can be used to extract information from complex multidimensional data. One solution to limit confirmation and hindsight bias by… 
Preregistration in diverse contexts: a preregistration template for the application of cognitive models
TLDR
This article attempts to bridge the gap between open science and mathematical psychology, focusing on the type of cognitive modelling that Crüwell et al. labelled model application, where researchers apply a cognitive model as a measurement tool to test hypotheses about parameters of the cognitive model.
Towards ARTEM-IS: Design guidelines for evidence-based EEG methodology reporting tools
TLDR
It is concluded that new tools are needed to overcome the limitations of written methodology descriptions, and that these tools should be developed through community consultation to ensure that they have the most utility for EEG stakeholders.
The case for formal methodology in scientific reform
TLDR
A formal statistical analysis of three popular claims in the metascientific literature is presented, showing how the use and benefits of such formalism can inform and shape debates about such methodological claims.
The case for formal methodology in scientific reform
TLDR
A formal statistical analysis of three popular claims in the metascientific literature is presented, showing how the use and benefits of such formalism can inform and shape debates about such methodological claims.
Data quality and reliability metrics for event-related potentials (ERPs): The utility of subject-level reliability.
TLDR
This primer applies each metric to published error-related negativity (ERN) and reward positivity (RewP) data and demonstrates how failing to consider data quality and internal consistency can undermine statistical inferences.
Event-related potential (ERP) measures of error processing as biomarkers of externalizing disorders: A narrative review.
  • Miranda C Lutz, R. Kok, I. Franken
  • Medicine
    International journal of psychophysiology : official journal of the International Organization of Psychophysiology
  • 2021
TLDR
It is concluded that ERP measures of error processing are candidate biomarkers for externalizing disorders, albeit it is strongly urge researchers to continue looking into the predictive value of these measures in the etiology and treatment outcome through multi-method and longitudinal designs.
Can Open Science be a Tool to Dismantle Claims of Hardwired Brain Sex Differences? Opportunities and Challenges for Feminist Researchers
Feminist scholars have long been concerned with claims of hardwired brain sex differences emanating from neuroscience and evolutionary psychology. Past criticisms of these claims have rightfully
Development of the N400 for Word Learning in the First 2 Years of Life: A Systematic Review
TLDR
A systematic review of over 30 studies that report the N400 component as a proxy of semantic processing elicited in infants between 0 and 24 months old who listened to linguistic stimuli finds that there is large heterogeneity across semantic-priming studies in reported characteristics of the N 400, both with respect to latency and to distributions.

References

SHOWING 1-10 OF 302 REFERENCES
The Value of Preregistration for Psychological Science: A Conceptual Analysis
For over two centuries researchers have been criticized for using research practices that makes it easier to present data in line with what they wish to be true. With the rise of the internet it has
Does preregistration improve the credibility of research findings?
Preregistration entails researchers registering their planned research hypotheses, methods, and analyses in a time-stamped document before they undertake their data collection and analyses. This
Study Preregistration: An Evaluation of a Method for Transparent Reporting
Study preregistration promotes transparency in scientific research by making a clear distinction between a priori and post hoc procedures or analyses. Management and applied psychology have not
Preregistration of Analyses of Preexisting Data
TLDR
It is argued that the preregistration of hypotheses and data-analyses for analyses of preexisting data is an important step towards more transparent psychological research.
Preregistration of exploratory research: Learning from the golden age of discovery
TLDR
It is argued that only slight modifications are needed to harness the potential of preregistration and make exploratory research more trustworthy and useful.
Methodological reporting behavior, sample sizes, and statistical power in studies of event-related potentials: Barriers to reproducibility and replicability.
TLDR
It is indicated that failing to report key guidelines is ubiquitous and that ERP studies are primarily powered to detect large effects, and such low power and insufficient following of reporting guidelines represent substantial barriers to replication efforts.
Preregistering qualitative research
The threat to reproducibility and awareness of current rates of research misbehavior sparked initiatives to better academic science. One initiative is preregistration of quantitative research. We
Psychometric considerations in the measurement of event-related brain potentials: Guidelines for measurement and reporting.
  • Peter E. Clayson, G. A. Miller
  • Computer Science, Medicine
    International journal of psychophysiology : official journal of the International Organization of Psychophysiology
  • 2017
TLDR
The present review considers the contextual factors that influence ERP score reliability and the downstream effects that reliability has on statistical analyses and advocates the use of generalizability theory for estimating score dependability as an improvement on classical test theory reliability estimates, suggesting that the latter is less well suited to ERP research.
The New Statistics
  • G. Cumming
  • Psychology, Medicine
    Psychological science
  • 2014
TLDR
An eight-step new-statistics strategy for research with integrity is described, which starts with formulation of research questions in estimation terms, has no place for NHST, and is aimed at building a cumulative quantitative discipline.
Registered reports: an early example and analysis
TLDR
A retrospective and observational comparison of Registered and non-Registered Reports published in the EJP during a seventeen-year period provides circumstantial evidence to suggest that the approach helped to reduce questionable research practices.
...
1
2
3
4
5
...