The Problem of Infra-Marginality in Outcome Tests for Discrimination

  title={The Problem of Infra-Marginality in Outcome Tests for Discrimination},
  author={Camelia Simoiu and Sam Corbett-Davies and Sharad Goel},
  journal={Econometrics: Econometric \& Statistical Methods - General eJournal},
In the course of conducting traffic stops, officers have discretion to search motorists for drugs, weapons, and other contraband. There is concern that these search decisions are prone to racial bias, but it has proven difficult to rigorously assess claims of discrimination. Here we develop a new statistical method --- the threshold test --- to test for racial discrimination in motor vehicle searches. We use geographic variation in stop outcomes to infer the effective race-specific standards of… 
The threshold test: Testing for racial bias in vehicle searches by police
  • Economics
  • 2017
Claims of biased decision making occur in many disciplines, including lending, hiring, and policing. However, it is typically difficult to rigorously assess these claims. This is in large part
A large-scale analysis of racial disparities in police stops across the United States
It is found that black drivers were less likely to be stopped after sunset, when a ‘veil of darkness’ masks one’s race, suggesting bias in stop decisions and evidence that the bar for searching black and Hispanic drivers was lower than that for searching white drivers.
An Absolute Test of Racial Prejudice
  • P. Marx
  • Law
    The Journal of Law, Economics, and Organization
  • 2021
Disparities along racial and ethnic lines persist across domains. Distinguishing among the possible sources of such disparities matters. This article introduces an absolute test for identifying
Comparing Systemic and Individual Sources of Racially Disparate Traffic Stop Outcomes
  • Kelsey Shoub
  • Law
    Journal of Public Administration Research and Theory
  • 2021
The deaths of George Floyd and Breonna Taylor brought discussions of race and policing to the forefront in the summer of 2020 in the United States, spurring protests and calls for policing reform.
Ticket to Abide : The Role of Implicit Racial Bias in Chicago Parking Ticket Distribution
A recent rise in media attention regarding police discrimination towards minorities has brought the pervasiveness of biases to the forefront of the public’s attention. In the last decade alone,
A Simple Test for Prejudice in Decision Processes: The Prediction- Based Outcome Test Autores:
We propose a novel implementation of the outcome test for diagnosing prejudice in decision processes, the Prediction-Based Outcome Test (P-BOT). We motivate our approach with a model of prejudice in
Using Shifts in Deployment and Operations to Test for Racial Bias in Police Stops
We rely on a policy experiment in the New York City Police Department (NYPD) to address the well-known problems of omitted variable bias and infra-marginality in traditional outcomes tests of racial
Learning by Doing in Law Enforcement
This study examines task-specific learning by police officers. Using data on twenty million traffic stops, I show that rookie officers become significantly more likely to find contraband as they
Would Eliminating Racial Disparities in Motor Vehicle Searches have Efficiency Costs?
During traffic stops, police search black and Hispanic motorists more than twice as often as white motorists, yet those searches are no more likely to yield contraband. We ask whether equalizing


Racial Bias in Motor Vehicle Searches: Theory and Evidence
Police checking for illegal drugs are much more likely to search the vehicles of African‐American motorists than those of white motorists. This paper develops a model of police and motorist behavior
Assessing the Effect of Race Bias in Post-traffic Stop Outcomes Using Propensity Scores
 In response to community demands, case settlements, and state laws concerning racial profiling, police departments across the nation are collecting data on traffic stops. While the data collection
Testing for Racial Profiling in Traffic Stops From Behind a Veil of Darkness
The key problem in testing for racial profiling in traffic stops is estimating the risk set, or “benchmark,” against which to compare the race distribution of stopped drivers. To date, the two most
Combatting Police Discrimination in the Age of Big Data
The exponential growth of available information about routine police activities offers new opportunities to improve the fairness and effectiveness of police practices. We illustrate the point by
A New Look at Racial Profiling: Evidence from the Boston Police Department
This paper provides new evidence on racial profiling using information on the race of both motorists and officers. Extending the model of Knowles, Persico, and Todd (2001), we develop a new test for
Doubly Robust Internal Benchmarking and False Discovery Rates for Detecting Racial Bias in Police Stops
A statistical method to flag potential problem officers by blending three methodologies that are the focus of active research efforts: propensity score weighting, doubly robust estimation, and false discovery rates is presented.
An Analysis of the New York City Police Department's “Stop-and-Frisk” Policy in the Context of Claims of Racial Bias
Recent studies by police departments and researchers confirm that police stop persons of racial and ethnic minority groups more often than whites relative to their proportions in the population.
Toward a Better Benchmark: Assessing the Utility of Not-at-Fault Traffic Crash Data in Racial Profiling Research
As studies on racial profiling and biased policing have begun to proliferate, researchers are debating which benchmark is most appropriate for comparison with police traffic stop data. Existing
Fast Threshold Tests for Detecting Discrimination
A method is developed for fitting threshold tests that is two orders of magnitude faster than the existing approach, reducing computation from hours to minutes, and is demonstrated by analyzing 2.7 million police stops of pedestrians in New York City.
The Statistical Theory of Racism and Sexism
My recent book, Inflation Policy and Unemployment Theory, introduces what is called the statistical theory of racial (and sexual) discrimination in the labor market.' The theory fell naturally out of