Why do evaluation researchers in crime and justice choose non-experimental methods?

  title={Why do evaluation researchers in crime and justice choose non-experimental methods?},
  author={Cynthia Lum and Sue-Ming Yang},
  journal={Journal of Experimental Criminology},
Despite the general theoretical support for the value and use of randomized controlled experiments in determining ‘what works’ in criminal justice interventions, they are infrequently used in practice. Reasons often given for their rare use include that experiments present practical difficulties and ethical challenges or tend to over-simplify complex social processes. However, there may be other reasons why experiments are not chosen when studying criminal justice-related programs. This study… 

History of randomized controlled experiments in criminal justice

This entry examines the history of randomized controlled experiments in criminology and criminal justice. First, fundamental characteristics of randomized controlled experiments are briefly

Justifying the use of non-experimental methods and disqualifying the use of randomized controlled trials: challenging folklore in evaluation research in crime and justice

The key limitation of non-experimental evaluation methods is that they require an assumption that all confounding factors related to treatment are identified in the statistical models developed. The

Conducting Randomized Controlled Trials With Offenders in an Administrative Setting

Evaluation research conducted in agencies that sanction law violators is often challenging and due process may preclude evaluators from using experimental methods in traditional criminal justice

The lack of experimental research in criminology—evidence from Criminology and Justice Quarterly

Objectives Despite experiments being termed the “gold standard,” criminology has been slow to adopt experimentation as a methodology. The goal of this research note is to better understand the use of

Implementing randomized experiments in criminal justice settings: An evaluation of multi-systemic therapy in the Netherlands

This paper addresses several issues that we encountered when implementing a randomized experiment to evaluate a promising intervention for serious juvenile delinquents, multi-systemic therapy (MST).

Randomized experiments in Scandinavian criminal justice: Reviewing the past and looking to the future

Randomized controlled trials are reported on with increasing frequency within the criminological literature. This development, which is commonly seen as being a part of a global shift towards

Experimental Criminology and the Free-Rider Dilemma

Experimental criminology promises a public good: when experiments generate findings about criminal justice interventions, everyone benefits from that knowledge. However, experimental criminology also

Issues in Defining and Applying Evidence-Based Practices Criteria for Treatment of Criminal-Justice Involved Clients

An overview of evidence-based practice, particularly as it applies to treatment and other interventions for offenders with problems involving drugs (including alcohol), and some challenges in disseminating and implementing EBPs are provided.

The growth of randomized experiments in policing: the vital few and the salience of mentoring

ObjectivesThe population of randomized experiments in policing is used to examine co-author and mentoring relations in the professional network of scholars and assess if experimental criminology is



Randomized Experiments in Criminal Justice Policy: Prospects and Problems

In theory, experimental designs provide the most reliable method to establish a relationship between interventions and outcomes. However, in practice, randomized experiments have remained a much less

Does Research Design Affect Study Outcomes in Criminal Justice?

Does the type of research design used in a crime and justice study influence its conclusions? Scholars agree in theory that randomized experimental studies have higher internal validity than do

Ethical Practice and Evaluation of Interventions in Crime and Justice

It is argued that the failure of crime and justice practitioners, funders, and evaluators to develop a comprehensive infrastructure for experimental evaluation represents a serious violation of professional standards and is supported by a statistical argument that makes randomized experiments the preferred method for ruling out alternative causes of the outcomes observed.

Lessons from Two Randomized Experiments in Criminal Justice Settings

Experiments are known to be powerful tools in assessing the effectiveness of interventions. Notwithstanding this knowledge, randomized field trials have been little used in criminal justice settings.

A Short History of Randomized Experiments in Criminology

It is concluded that feast and famine periods are influenced by key individuals and policy makers, practitioners, funders, the mass media, and the general public need better education in research quality so that they can tell the difference between good and poor evaluation studies.

Why have Educational Evaluators Chosen Not to Do Randomized Experiments?

This article analyzes the reasons that have been adduced within the community of educational evaluators for not doing randomized experiments. The objections vary in cogency. Those that have most

Preventing Crime: What Works, What Doesn't, What's Promising. Research in Brief. National Institute of Justice.

In 1996, a Federal law required the U.S. Attorney General to provide Congress with an independent review of the Many crime prevention programs work. Others don’t. Most programs have not yet been

The Campbell Collaboration Crime and Justice Group

Systematic reviews use rigorous methods for locating, appraising, and synthesizing evidence from prior evaluation studies. They have explicit objectives, explicit criteria for including or excluding

Meta-analysis and the rehabilitation of punishment

Do we know what “works” in the way of rehabilitative treatment in corrections? Not yet. Has the old “nothing works” literature been invalidated by new reviews of research claiming to show, through

Meta-Analytic Methods for Criminology

Meta-analysis was designed to synthesize empirical relationships across studies, such as the effects of a specific crime prevention intervention on criminal offending behavior. Meta-analysis focuses