AI Legal Summaries and Online Discourse

How to cite

Song, Lena; Ash, Elliott; Kesari, Aniket; Naidu, Suresh; Stammbach, Dominik. 2024. "AI Legal Summaries and Online Discourse." AEA RCT Registry. AEARCTR-0013885. https://doi.org/10.1257/rct.13885-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lena Song* , Elliott Ash , Aniket Kesari , Suresh Naidu , Dominik Stammbach

* Primary investigator

Registry ID
AEARCTR-0013885
DOI
https://doi.org/10.1257/rct.13885-1.0
First registered
Last updated
Status
On going
Trial dates
2024-06-26 – 2025-09-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/13885

Abstract

Our project facilitates public understanding of law by making legal documents transparent to the public through a novel system built with artificial intelligence. In this study, we quantify the effect of public understanding of the law on online discourse through field experiments randomizing the availability of legal document summaries. We will randomly assign some social media posts to receive accessible summaries. We will then compare on-platform engagement for treated conversations that received the accessible summaries relative to control conversations.

Intervention

To study the effect of exposure on outcomes, we will randomly embed our legal summaries in the comment sections of relevant YouTube videos.

Experimental design

We will use social media bots on YouTube to track discussions of SCOTUS cases for potential injection of text into the conversation. We will select high-profile cases in Summer 2024 that will be discussed on social media. We will randomly reply to some videos with accessible summaries.

Design details

Randomization method
randomization done by a computer
Randomization unit
YouTube video
Clusters
depends on number of videos posted on the topic; up to 10,000 videos
Observations
depends on number of videos posted on the topic; up to 10,000 videos
Arms
1/3 to each of Opinions, Facts, and Control
Primary outcomes
The primary outcomes are quantity of engagement, quality of engagement, and the prevalence and accuracy of legal reasoning in the discussions.

Cited by

No citation data available for this registration yet.

Keywords