• DOI:10.1037/0033-2909.104.3.396
• Corpus ID: 55880371

Heterogeneity of Variance in Experimental Studies: A Challenge to Conventional Interpretations

@article{Bryk1988HeterogeneityOV,
  title={Heterogeneity of Variance in Experimental Studies: A Challenge to Conventional Interpretations},
  author={Anthony Bryk and Stephen Raudenbush},
  journal={Psychological Bulletin},
  year={1988},
  volume={104},
  pages={396-404}
}

• A. Bryk, S. Raudenbush
• Published 1 November 1988
• Psychology
• Psychological Bulletin

The presence of heterogeneity of variance across groups indicates that the standard statistical model for treatment effects no longer applies. Specifically, the assumption that treatments add a constant to each subject's development fails. An alternative model is required to represent how treatment effects are distributed across individuals. We develop in this article a simple statistical model to demonstrate the link between heterogeneity of variance and random treatment effects. Next, we illustrate with results from two previously published studies how a failure to recognize the substantive importance of heterogeneity of variance obscured significant results present in these data. The article concludes with a review and synthesis of techniques for modeling variances. Although these methods have been well established in the statistical literature, they are not widely known by social and behavioral scientists. Psychological researchers have tended historically to view heterogeneity of variance as a methodological nuisance, an unwelcome obstacle in the pursuit of inferences about the effects of treatments on means. In their discussion of variance heterogeneity, standard texts concentrate on identifying conditions under which such heterogeneity can safely be ignored so that standard analyses of means may proceed. It is usually argued that heterogeneity can be ignored when statistical tests for means are robust to violation of the homogeneity assumption