Preregistration in Single-Case Design Research

  title={Preregistration in Single-Case Design Research},
  author={Austin H. Johnson and Bryan G. Cook},
  journal={Exceptional Children},
  pages={112 - 95}
To draw informed conclusions from research studies, research consumers need full and accurate descriptions of study methods and procedures. Preregistration has been proposed as a means to clarify reporting of research methods and procedures, with the goal of reducing bias in research. However, preregistration has been applied primarily to research studies utilizing group designs. In this article, we discuss general issues in preregistration and consider the use of preregistration in single-case… 

Tables from this paper

Preregistration and registered reports
Abstract Preregistration and registered reports are two promising open science practices for increasing transparency in the scientific process. In particular, they create transparency around one of
Single-case experimental designs: Characteristics, changes, and challenges.
  • A. Kazdin
  • Medicine, Sociology
    Journal of the experimental analysis of behavior
  • 2020
Tactics of Scientific Research (Sidman, 1960) provides a visionary treatise on single-case designs, their scientific underpinnings, and their critical role in understanding behavior. Since the
Quantitative Techniques and Graphical Representations for Interpreting Results from Alternating Treatment Design
Multiple quantitative methods for single-case experimental design data have been applied to multiple-baseline, withdrawal, and reversal designs. The advanced data analytic techniques historically
Meta-Analytic Methods to Detect Publication Bias in Behavior Science Research
Several meta-analytic techniques for examining publication bias when published and grey literature are available as well as alternative meta- Analytic techniques when grey literature is inaccessible are described.
Registered Reports in Special Education: Introduction to the Special Series
This article introduces a special series of registered reports in Remedial and Special Education. Registered reports are an innovative approach to publishing that aim to increase the credibility of
Structured visual analysis of single-case experimental design data: Developments and technological advancements.
An overview of structured visual-analysis tools is shared, their utility is delineated, common characteristics are brought to light, and future directions for both research and clinical use are highlighted.
How to Be RAD: Repeated Acquisition Design Features that Enhance Internal and External Validity.
A set of 15 quality RAD indicators, comprising foundational elements that should be present in all RAD studies and additional features that enhance causal inference and external validity are proposed, to strengthen the rigor of RAD studies.
SCD‐MVA : A mobile application for conducting single‐case experimental design research during the pandemic
The mobile application SCD-MVA (2019), developed to assists in the design of an SCD, data gathering, data analysis, and remote collaboration, allows data management and data sharing among researchers, and provides an in real time visualization of the gathered data.
Using the Performance Diagnostic Checklist to evaluate and promote paraeducators' treatment fidelity.
This study evaluated the impact of PDC-HS indicated implementation support on the intervention fidelity of five paraeducators implementing six behavior intervention plans for students receiving special education services and suggested that the behavior intervention Plans may have needed to be revised.
Open Science in Education Sciences
Open Science in education science provides opportunities to increase the transparency and therefore replicability of research and develop and answer research questions about individuals with learning disabilities and learning difficulties that were previously impossible to answer due to complexities in data analysis methods.


The preregistration revolution
Widespread adoption of preregistration will increase distinctiveness between hypothesis generation and hypothesis testing and will improve the credibility of research findings.
Preregistering qualitative research
The threat to reproducibility and awareness of current rates of research misbehavior sparked initiatives to better academic science. One initiative is preregistration of quantitative research. We
Enhancing the scientific credibility of single-case intervention research: randomization to the rescue.
It is recommended that traditional single-case intervention designs be transformed into more scientifically credible randomized single- case intervention designs whenever the research conditions under consideration permit.
A survey of publication practices of single-case design researchers when treatments have small or large effects.
Survey of single-case design researchers about publication preferences in response to simulated SCD results that show a range of small to large effects suggests that SCD researchers are more likely to submit manuscripts that show large effects for publication and are morelikely to recommend acceptance of manuscripts that shows large effects when they act as a reviewer.
Publishing Single-Case Research Design Studies That Do Not Demonstrate Experimental Control
How experimental control evolved as the standard for high-quality SCRD is discussed and why, in the era of evidence-based practice, rigorous studies that fail to fully demonstrate experimental control are important to include in the body of published intervention research is discussed.
Outcome-Reporting Bias in Education Research
Outcome-reporting bias occurs when primary studies do not include information about all outcomes measured in a study. When studies omit findings on important measures, efforts to synthesize the
Single-Case Research Designs: Methods for Clinical and Applied Settings
Now thoroughly updated in its second edition, acclaimed author Alan E. Kazdin's Single-Case Research Designs provides a notable contrast to the quantitative methodology approach that pervades the biological and social sciences.
Publication bias in studies of an applied behavior-analytic intervention: an initial analysis.
An initial test of bias was conducted by comparing effect sizes, measured by percentage of nonoverlapping data (PND), in published SSED studies and unpublished dissertations on 1 well-established intervention for children with autism, pivotal response treatment (PRT).
The Role of Between-Case Effect Size in Conducting, Interpreting, and Summarizing Single-Case Research. NCER 2015-002.
The authors' recommendations for how SCD researchers can calculate and report on standardized between-case effect sizes, the way in these effect sizes can be used for various audiences (including policymakers) to interpret findings, and how they can be use across studies to summarize the evidence base for education practices are included.
A Call for Examining Replication and Bias in Special Education Research
Valid, scientific research is critical for ascertaining the effects of instructional techniques on learners with disabilities and for guiding effective special education practice and policy.