Blind Justice: Algorithmically Masking Race in Prosecutorial Charging Decisions

How to cite

Goel, Sharad; Nyarko, Julian; Chohlas-Wood, Alex. 2023. "Blind Justice: Algorithmically Masking Race in Prosecutorial Charging Decisions." AEA RCT Registry. AEARCTR-0011327. https://doi.org/10.1257/rct.11327-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sharad Goel* , Julian Nyarko , Alex Chohlas-Wood

* Primary investigator

Registry ID
AEARCTR-0011327
DOI
https://doi.org/10.1257/rct.11327-2.0
First registered
Last updated
Status
In development
Trial dates
2025-01-01 – 2025-06-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/11327

Abstract

We designed a "blind charging" algorithm that automatically redacts race-related information from incident reports to prevent racial bias from influencing prosecutorial charging decisions. After successful pilots with two district attorneys, new legislation requires that prosecutors across California must use race-blind charging by 2025. This pending expansion, alongside high levels of interest from prosecutors across the country, makes blind charging a pressing policy issue that deserves further study—particularly in how its rollout affects Black, Hispanic, and other marginalized individuals and their communities. In a randomized control trial (RCT), we will test whether the use of our algorithm reduces bias in charging decisions or causes any unintended adverse impacts (e.g., changes in charging rates for all individuals). We will also estimate the amount of additional time it takes attorneys to conduct race-blind review.

Intervention

To prevent race from influencing charging decisions, we created an algorithm that automatically redacts race-related information from free-text police incident reports. Our tool finds and removes not only explicit mentions of race, but also other information that a prosecutor could use to guess an individual’s race, including physical descriptions, names, and locations. Our intervention is showing prosecutors a race-blind version of each case when they make charging decisions.

Experimental design

We will randomly assign each incoming case to either a control or treatment condition. In the control condition, cases will be processed according to the status quo procedure, where all evidence is available in an unmodified form at the time of the charging decision.

In the treatment condition, prosecutors will follow a new two-stage charging procedure that allows them to make race-blind charging decisions, while balancing their need to review all available evidence (including photos or videos, which would be difficult to redact). Prosecutors will begin a race-blind review by reading the redacted incident report and recording a preliminary charging decision. Within a couple days, prosecutors will return to the case to review all available materials, including an unredacted version of the incident report, and will make a final decision about whether or not to charge the individual. If their final decision differs from their preliminary, race-blind decision, they will be required to explain the reason for the change, discouraging unconscious or conscious changes made when race information becomes available.

Design details

Randomization method
Randomization done in software by a computer.
Randomization unit
Randomization by case. Different research sites may decide to randomize at different rates (e.g., 10% of cases to control instead of 50% of cases).
Clusters
5 research sites (see note below about site withdrawal). 4 research sites will randomize 50% of cases to each arm; with the remaining site randomizing only 10% of cases to control, and the remainder to treatment.
Observations
Site 1: 10,000 cases, with 5,000 in control Site 2: 2,000 cases, with 1,000 in control Site 3: 7,500 cases, with 3,750 in control Site 4: 24,700 cases, with 2,470 in control Site 5: 4,800 cases, with 2,400 in control This is 49,000 cases in total. We expect the final number may vary considerably depending on site willingness to continue participation in our experiment. We will run the experiment until we obtain the target number of cases, until two years have elapsed since the start of the experiment in that site, or until a site no longer wishes to participate in our experiment, whichever comes first.
Arms
34,380 cases in treatment, under race-blind review, and 14,620 cases in control. Note these may change closer to the launch date as sites finalize what proportion of cases they plan to send to treatment and control.
Primary outcomes
The primary outcome of interest for our RCT is whether race-blind reviews reduce differences in charging rates between Black or Hispanic arrestees and all other arrestees.
Secondary outcomes
Our secondary outcome of interest is whether race-blind reviews change overall charging rates (e.g., if the lack of personal information like names or neighborhoods causes prosecutors to lose empathy, increasing charging rates overall; or if the race-blind stage causes prosecutors to make decisions that lower the risk of a decision reversal in either direction). We also plan to measure the amount of time it takes to conduct a race-blind review, and compare it against a similar estimate for the status-quo review procedure.
Sponsors
Name: The Abdul Latif Jameel Poverty Action Lab, North America Location: Cambridge, MA, USA Url: https://www.povertyactionlab.org/na

Cited by

No citation data available for this registration yet.

Keywords