Randomized Experiments in Educational Policy Research: A Critical Examination of the Reasons the Educational Evaluation Community has Offered for not Doing Them

  title={Randomized Experiments in Educational Policy Research: A Critical Examination of the Reasons the Educational Evaluation Community has Offered for not Doing Them},
  author={Thomas D Cook},
  journal={Educational Evaluation and Policy Analysis},
  pages={175 - 199}
  • T. Cook
  • Published 2002
  • Psychology
  • Educational Evaluation and Policy Analysis
This article notes the paucity with which reform efforts in education have been evaluated experimentally, despite well-nigh universal acknowledgement that experiments provide the best justification for causal conclusions. And of the few experiments that have been completed, most were done by groups outside of the community of educational evaluators working in schools and colleges of education. The reasons educational evaluators cite for not doing experiments are critically appraised. Some are… Expand
Improving the Performance of the Education Sector: The Valuable, Challenging, and Limited Role of Random Assignment Evaluations
In an attempt to improve the quality of educational research, the US Department of Education's Institute of Education Sciences has provided funding for 65 randomized controlled trials of educationalExpand
Lessons Learned from the Use of Randomized and Quasi-Experimental Field Designs for the Evaluation of Educational Programs.
Abstract As a result of the federal No Child Left Behind Act (NCLB) of 2002, the field of education has seen a heavy emphasis on the use of “scientifically based research” for designing and testingExpand
An Examination of the Benefits, Limitations, and Challenges of Conducting Randomized Experiments With Principals
Purpose: The past decade has seen considerable debate about how to best evaluate the efficacy of educational improvement initiatives, and members of the educational leadership research community haveExpand
Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Impact Evaluations
In this article, I identify educational interventions with an impact on student learning in Sub-Saharan Africa. After a systematic literature search, I conducted a meta-analysis synthesizing 56Expand
Forthcoming in Brookings Papers on Education Policy 2005 CAN THE FEDERAL GOVERNMENT IMPROVE EDUCATION RESEARCH
Will recent federal policy changes succeed in improving the quality of education policy research? One explanation for the limited supply of high-quality evaluation evidence in education to date isExpand
The Moral, Social and Political Responsibility of Educational Researchers: Resisting the Current Quest for Certainty.
Abstract In the last decade a number of national and international activities and public policies in the US have converged to prescribe a particular conception of educational research. RandomizedExpand
Can the Federal Government Improve Education Research?
Recent dissatisfaction with public education in the United States has been matched by dismay with the current state of education research. A common complaint is that education research is good atExpand
Improving the Productivity of Education Experiments: Lessons from a Randomized Study of Need-Based Financial Aid
Given scarce resources for evaluation, we recommend that education researchers more frequently conduct comprehensive randomized trials that generate evidence on how, why, and under what conditionsExpand
Evaluating the impact of instruction in critical thinking on the critical thinking skills of English language learners in higher education
In 1994 the Lebanese government called for an education reform to introduce critical thinking (CT) in the curriculum. The reform failed as there was no consensus on how CT should be taught. SomeExpand
The Educational Science and Scientifically Based Instruction We Need: Lessons from Reading Research and Policymaking
In this article, Michael Pressley, Nell Duke, and Erica Boling discuss the impact various scientific approaches have on early reading instruction research. The authors call for a second generation ofExpand


Evidence matters : randomized trials in education research
By offering a variety of suggestions to improve the methods used to evaluate education programs, the contributors to this volume seek to improve education in the United States. Expand
Changing Federal Strategies for Supporting Educational Research, Development, and Statistics.
The 1994 reauthorization of the Office of Educational Research and Improvement (OERI) introduced significant changes in the structure of federal support for educational research, development, andExpand
Sustained Inquiry in Education: Lessons from Skill Grouping and Class Size
In this article, Frederick Mosteller, Richard J. Light and Jason A. Sachs explore the nature of the empirical evidence that can inform school leaders' key decisions about how to organize studentsExpand
Evaluation Findings in Education and Social Work Textbooks
Evaluation findings will probably make a long-term contribution to the improvement of social services and programs when they are cited in the textbooks used to train human services professionals.Expand
Reforming Educational Policy With Applied Social Research
Policy researchers have traditionally assumed that applied research produces authoritative and socially relevant knowledge and affects policy by affecting discrete decisions. The authors investigateExpand
Getting to Scale with Good Educational Practice
How can good educational practice move be~ond pockets of excellence to reach a much greater proportion of students and educators? While many children and young adults in school districts andExpand
Summary of findings of the School Health Education Evaluation: health promotion effectiveness, implementation, and costs.
Analysis of effects-to-classroom hours revealed that, while relatively few hours of instruction can produce large effects for knowledge, more hours are required for the development of attitude and practice effects, and that stable effects are established for all three domains at about 40-50 classroom hours. Expand
Comer's School Development Program in Prince George's County, Maryland: A Theory-Based Evaluation
A randomized experiment of Comer's School Development Program was conducted in 23 middle schools in Prince George's County, Maryland. The school population is predominantly African American, withExpand
The Education Gap: Vouchers and Urban Schools
While the merits of vouchers have been the subject of intense public debate in recent years, there has been very little available evidence upon which to gauge their efficacy. The first publiclyExpand
The Effectiveness of School Choice in Milwaukee: A Secondary Analysis of Data from the Programs Evaluation
In 1990, Milwaukee (Wisconsin) became the site of the first publicly funded school-choice program providing low-income parents with vouchers that could be used to send their children to secular,Expand