How Methodological Features Affect Effect Sizes in Education

  title={How Methodological Features Affect Effect Sizes in Education},
  author={Alan C. K. Cheung and Robert E. Slavin},
  journal={Educational Researcher},
  pages={283 - 292}
As evidence becomes increasingly important in educational policy, it is essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. A total of 645 studies from 12 recent reviews of evaluations of preschool, reading, mathematics, and science programs were studied. Effect sizes were roughly twice as large for published articles, small-scale trials, and experimenter-made measures, compared to unpublished documents, large… Expand
Investigating Science Education Effect Sizes: Implications for Power Analyses and Programmatic Decisions
This meta-analysis examines the relationship between science education intervention effect sizes and a host of study characteristics, allowing primary researchers to access better estimates of effect sizes for a priori power analyses and support programmatic decisions by setting realistic expectations about the typical magnitude of impacts for science education interventions. Expand
Interpreting Effect Sizes of Education Interventions
Researchers commonly interpret effect sizes by applying benchmarks proposed by Jacob Cohen over a half century ago. However, effects that are small by Cohen’s standards are large relative to theExpand
Do Published Studies Yield Larger Effect Sizes than Unpublished Studies in Education and Special Education? A Meta-review
Meta-analyses are used to make educational decisions in policy and practice. Publication bias refers to the extent to which published literature is more likely to have statistically significantExpand
Peer tutoring and mathematics in secondary education: literature review, effect sizes, moderators, and implications for practice
Conclusions suggest the implementation of same-age over cross-age tutoring, during programs of fewer than 8 weeks, in sessions of less than 30 minutes is optimal for improving students' academic outcomes. Expand
The perspective of “limited malleability” in educational effectiveness: treatment effects in schooling
ABSTRACT In this article, several ways to adjust gross school effects are discussed to set the stage for estimating treatment effects in schooling. Although it is quite hazardous to hypothesizeExpand
Effects of policy and educational interventions intended to reduce difficulties in literacy skills in grade 1
Abstract In two large-scale studies, the effects of policy and educational interventions on literacy skills were examined in children schooled in zones with specific educational needs. To calculateExpand
Examining Factors Contributing to Variation in Effect Size Estimates of Teacher Outcomes from Studies of Science Teacher Professional Development
Abstract Developing and maintaining a high-quality science teaching corps has become increasingly urgent with standards that require students to move beyond mastering facts to reasoning and arguingExpand
Financial Education in Schools: A Meta-Analysis of Experimental Studies
We study the literature on school financial education programs for children and youth via a quantitative meta-analysis of 37 (quasi-) experiments. We find that financial education treatment has, onExpand
Mathematics Interventions for Upper Elementary and Secondary Students: A Meta-Analysis of Research
The purpose of this review was to conduct a meta-analysis of 25 years of mathematics interventions for students with mathematics difficulty or disability in Grades 4 through 12. A search of theExpand
Effectiveness of Literacy Programs Balancing Reading and Writing Instruction: A Meta‐Analysis
Reading and writing are critical to students’ success in and outside of school. Because they draw on common sources of knowledge and cognitive processes, involve meaning making, and can be usedExpand


The Relationship Between Sample Sizes and Effect Sizes in Systematic Reviews in Education
Research in fields other than education has found that studies with small sample sizes tend to have larger effect sizes than those with large samples. This article examines the relationship betweenExpand
Effectiveness of computer-based instruction: An updated analysis.
A meta-analysis of findings from 254 controlled evaluation studies showed that computer-based instruction (CBI) usually produces positive effects on students. The studies covered learners of all ageExpand
Perspectives on Evidence-Based Research in Education—What Works? Issues in Synthesizing Educational Program Evaluations
Key issues in the conduct of program evaluation syntheses are discussed: requirements for research design, sample size, adjustments for pretest differences, duration, and use of unbiased outcome measures. Expand
How features of educational technology applications affect student reading outcomes: A meta-analysis
Abstract The purpose of this review is to learn from rigorous evaluations of alternative technology applications how features of using technology programs and characteristics of their evaluationsExpand
Effects of Educational Technology Applications on Reading Outcomes for Struggling Readers: A Best Evidence Synthesis.
Findings indicate that educational technology applications produced a positive but small effect on the reading skills of struggling readers in comparison with “business as usual” methods. Expand
Measures Inherent to Treatments in Program Effectiveness Reviews
Abstract Program effectiveness reviews in education seek to provide educators with scientifically valid and useful summaries of evidence on achievement effects of various interventions. DifferentExpand
Effective Programs in Elementary Mathematics: A Best-Evidence Synthesis
It is concluded that programs designed to change daily teaching practices appear to have more promise than those that deal primarily with curriculum or technology alone. Expand
Effective Programs in Middle and High School Mathematics: A Best-Evidence Synthesis
This article reviews research on the achievement outcomes of mathematics programs for middle and high schools. Study inclusion requirements include use of a randomized or matched control group, aExpand
Effective Reading Programs for Middle and High Schools: A Best‐Evidence Synthesis
This article systematically reviews research on the achievement outcomes of four types of approaches to improving the reading of middle and high school students: (1) reading curricula, (2)Expand
The Effectiveness of Educational Technology Applications for Enhancing Mathematics Achievement in K-12 Classrooms: A Meta-Analysis. Best Evidence Encyclopedia (BEE).
The findings suggest that educational technology applications generally produced a positive, though modest, effect in comparison to traditional methods, however, the effects may vary by educational technology type. Expand