A demonstration of how to do a meta-analysis that combines single-case designs with between-groups experiments: The effects of choice making on challenging behaviors performed by people with disabilities

@article{Zelinsky2018ADO,
  title={A demonstration of how to do a meta-analysis that combines single-case designs with between-groups experiments: The effects of choice making on challenging behaviors performed by people with disabilities},
  author={Nicole A M Zelinsky and William R. Shadish},
  journal={Developmental Neurorehabilitation},
  year={2018},
  volume={21},
  pages={266 - 278}
}
ABSTRACT Objective: This paper demonstrates how to conduct a meta-analysis that includes both between-group and single-case design (SCD) studies. The example studies whether choice-making interventions decrease challenging behaviors performed by people with disabilities. Methods: We used a between-case d-statistic to conduct a meta-analysis of 15 between-group and SCD studies of 70 people with a disability, who received a choice intervention or control. We used robust variance estimation to… 

Using response ratios for meta-analyzing single-case designs with behavioral outcomes.

Synthesis of Bullying Interventions for Individuals with Disabilities: A Meta-Analysis

This study synthesized 14 published and unpublished group design and single-case design studies on bullying interventions for individuals with disabilities. The specific objectives were to examine

Meta-analyses and effect sizes in applied behavior analysis: A review and discussion.

Meta-analysis techniques, the rationale for their adaptation with SCED studies, and current indices used to quantify the effect of SCED data in applied behavior analysis are discussed.

Assessing generalizability and variability of single-case design effect sizes using two-stage multilevel modeling including moderators

This study introduces an innovative meta-analytic approach, two-stage multilevel meta-analysis that considers the hierarchical structure of single-case experimental design (SCED) data. This approach

A primer for using multilevel models to meta-analyze single case design data with AB phases.

The purpose of this technical article is to minimally equip behavior analysts to complete a meta-analysis that will summarize a current state of affairs as it relates to the science of behavior analysis and its practice.

A Priori Justification for Effect Measures in Single-Case Experimental Designs

Due to the complex nature of single-case experimental design data, numerous effect measures are available to quantify and evaluate the effectiveness of an intervention. An inappropriate choice of the

A meta-analysis of the effects of social-cognitive training in schizophrenia: The role of treatment characteristics and study quality.

SCT benefits people with schizophrenia on a variety of social-cognitive outcomes and future studies should aim to enhance the generalization of training effects on broader clinical outcomes.

References

SHOWING 1-10 OF 67 REFERENCES

A standardized mean difference effect size for multiple baseline designs across individuals

Estimation methods for the effect size and its variance are proposed, the estimators using simulation, and the approach is demonstrated in two applications.

Characteristics of single-case designs used to assess intervention effects in 2008

A study that located, digitized, and coded all 809 single- case designs appearing in 113 studies in the year 2008 in 21 journals in a variety of fields in psychology and education has implications for the contributions of single-case designs to evidence-based practice and suggest a number of future research directions.

Publication bias in studies of an applied behavior-analytic intervention: an initial analysis.

An initial test of bias was conducted by comparing effect sizes, measured by percentage of nonoverlapping data (PND), in published SSED studies and unpublished dissertations on 1 well-established intervention for children with autism, pivotal response treatment (PRT).

A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic

We describe a standardised mean difference statistic (d) for single-case designs that is equivalent to the usual d in between-groups experiments. We show how it can be used to summarise treatment

Updating a meta-analysis of intervention research with challenging behaviour: Treatment validity and standards of practice

Behavioural interventions effectively reduce challenging behaviour, particularly when preceded by a functional analysis, and teaching replacement skills was most effective, especially if used in combination with systems change and/or traditional antecedent and consequence manipulation.

Publication bias in meta-analysis: Prevention, assessment and adjustments

Each study that is published about the effect of an independent variable on a dependent one, or the strength of the relationship between two variables, constitutes only a single piece in a constantly

A standardized mean difference effect size for single case designs

A new effect size measure for single case research that is directly comparable with the standardized mean difference (Cohen's d) often used in between-subjects designs is proposed.

The Effect of Choice-Making as an Intervention for Problem Behavior

Supporting people with disabilities in expressing preferences and making choices is a core value in positive behavior support. Indeed, in recent years, the field has increasingly focused its
...