Investigating the productivity impact of Generative AI in the public sector

How to cite

Wong, Christopher; Leigh, Andrew. 2024. "Investigating the productivity impact of Generative AI in the public sector." AEA RCT Registry. AEARCTR-0014140. https://doi.org/10.1257/rct.14140-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Christopher Wong* , Andrew Leigh

* Primary investigator

Registry ID
AEARCTR-0014140
DOI
https://doi.org/10.1257/rct.14140-1.0
First registered
Last updated
Status
On going
Trial dates
2024-07-22 – 2024-10-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/14140

Abstract

This project proposes to examine the impact of new generative AI tools on the productivity of public sector workers. It follows in the vein of recent research examining how new generative AI tools such as ChatGPT, Bard and Copilot can improve productivity across workforces and automate a variety of common tasks done by workers, freeing up their time. This study will examine whether generative AI tools hold similar promise for government workers, particularly those who work in roles that involve the development and implementation of policy.

Intervention

The study will involve having public servants complete fictional tasks, with and without the assistance of generative AI tools. The tasks will be tasks commonly performed by Australian public servants and are designed to both replicate their usual work experiences and provide a meaningful baseline against which the effects (or lack thereof) of generative AI can be ascertained.

Experimental design

All participants receive a primer on using generative AI and then four tasks, each involving reading some information and responding to a request(s). Participants perform two of the tasks without AI assistance, and two are performed with AI assistance.

Design details

Randomization method
Done in office by a computer
Randomization unit
Subject
Clusters
10-20 individuals
Observations
40-80 observations
Arms
10-20 individuals as controls and treatment
Primary outcomes
The primary outcome variable is the quality of the responses to each task. These will be measured against a marking rubric by senior public servants independent to the study.

Cited by

No citation data available for this registration yet.

Keywords