Algorithms and Legal Decisions: From Private Information to Common Knowledge

How to cite

Maqueda, Manuel Ramos. 2025. "Algorithms and Legal Decisions: From Private Information to Common Knowledge." AEA RCT Registry. AEARCTR-0014617. https://doi.org/10.1257/rct.14617-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Manuel Ramos Maqueda*

* Primary investigator

Registry ID
AEARCTR-0014617
DOI
https://doi.org/10.1257/rct.14617-1.0
First registered
Last updated
Status
In development
Trial dates
2025-01-28 – 2025-12-24
Countries
Private
JEL codes
D82, K14, K4
Registry record
http://www.socialscienceregistry.org/trials/14617

Abstract

This study investigates the impact of algorithmic risk assessments on prosecutorial decision-making, with a particular focus on how the publicity of such risk scores influences their decisions. In collaboration with the Public Prosecutor’s Office of the Czech Republic, we conduct a nationwide vignette experiment involving all public prosecutors in the country. Prosecutors in the control group evaluate two hypothetical theft cases, recommend sentences to the judge, and respond to a series of questions regarding their decisions. In the treatment groups, prior to making their decisions, prosecutors receive a risk assessment score indicating the defendant’s likelihood of reoffending. The experiment includes two treatment arms: in the public information treatment, prosecutors are informed that the risk assessment score is part of the official court docket and accessible to judges and other criminal justice actors; in the private information treatment, they are informed that the score is exclusively available to them as prosecutors. To our knowledge, this is the first experimental study to examine the effects of algorithmic risk assessments on prosecutorial decision-making. Additionally, we explore how the availability of private versus public information influences sentencing recommendations, providing novel insights into the interplay between algorithmic tools and prosecutorial behavior in the criminal justice system.

Intervention

This study employs a randomized controlled trial (RCT) conducted in collaboration with public prosecutors in the Czech Republic.All active public prosecutors, as well as those currently in training, will be invited to participate through an official email distributed by the Deputy Supreme Prosecutor. In the survey, participants will be presented with two hypothetical theft-related criminal cases and asked to make decisions on each. Following their decisions, prosecutors will respond to a series of questions about their decision-making process and their expectations regarding the outcomes of the cases.

In the treatment groups, prosecutors will receive an algorithmic risk assessment score indicating the defendant’s likelihood of reoffending before their sentencing recommendations and answering the questions. This risk assessment score is based on similar tools used internationally and within the Czech prison system. It provides detailed information on recidivism risk, scores across various predictive factors, and insights into the tool itself. By integrating this tool into the experiment, we aim to evaluate how algorithmic risk assessments influence prosecutorial decision-making and their subsequent justifications.

Experimental design

This study consists of an RCT that will be implemented with public prosecutors of the Czech Republic. All active public prosecutors and prosecutors in training will be invited to participate in the study via email. In this survey, prosecutors will be asked to decide on two cases related to theft offenses. After deciding on such cases, the prosecutors will be asked a series of questions regarding their beliefs on the case.

In the treatment groups, the prosecutors receive a risk assessment score prior to their decision, which indicates the defendant’s likelihood of reoffending. There are two treatment arms: in the public information treatment, prosecutors are informed that the risk assessment score is part of the official court docket—accessible to judges and other criminal justice actors—whereas in the private information treatment, they are informed that the score is only available to them as prosecutors.

Design details

Randomization method
Randomization done by the survey platform (Qualtrics). It will be a randomized experiment, where treatment arms will be stratified by gender and whether the prosecutors are district prosecutors or not. These two strata are significantly associated with case decisions according to previous research in the Czech context. We will implement the randomization only among prosecutors who open the survey. We do this by coding it into the survey platform, so that every time a respondent opens the survey they are randomly assigned into a treatment group (considering their stata).
Randomization unit
Individual prosecutors.
Clusters
The invitation to participate will be shared with 1,250 active prosecutors, with additional 80 prosecutors in training. However, based on prior research with this same population, we expect approximately 200/250 prosecutors to complete the survey. If there are less than 282 prosecutors who complete the survey after the first email invitation, a reminder will be sent by the prosecutors' office to remind prosecutors to participate. Adding responses from law students might be considered only as a last resort if the number of responses remains too low.
Observations
As above.
Arms
One third per treatment arm. So, if 300 prosecutors completed the survey, we would have approximately 100 prosecutors in each treatment group.
Primary outcomes
1. Decision to recommend incarceration. 2. Sentencing length. 3. Assessment of the defendant's risk. 4. Reasoning of the decision.
Secondary outcomes
1. Expectation on the judge's decision to incarcerate & incarceration length 2. Expectation of defendant's likelihood to appeal 3. Consistency or Variance 4. Their expectations on how other prosecutors would decide relative to them (i.e., more or less severe). 5. (Only for treatments): whether they agree with the risk assessment score provided. In addition to full specification, we will also consider the comparison only between the two treatment arms. In addition, depending on the final number of responses we receive (and the associated power), we may also consider grouping treatments 1 and 2 as a joint treatment group.
Partners
Name: Public Prosecution Office of the Czech Republic Partner_type: government Url: https://verejnazaloba.cz/en/ Name: Charles University in Prague Url: https://cuni.cz/UKEN-1.html

Cited by

No citation data available for this registration yet.

Keywords