Production with and by AI

How to cite

Conlon, John. 2026. "Production with and by AI." AEA RCT Registry. AEARCTR-0019010. https://doi.org/10.1257/rct.19010-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

John Conlon*

* Primary investigator

Registry ID
AEARCTR-0019010
DOI
https://doi.org/10.1257/rct.19010-2.0
First registered
Last updated
Status
On going
Trial dates
2026-07-06 – 2026-09-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/19010

Abstract

Our experiment involves participants designing a product (a web game) with an AI coding agent to sell to other participants.

Intervention

Participants design a product (a web game) with an AI coding agent. We also vary whether and when participants see the AI design the game itself (i.e., without human input).

Experimental design

See above.

Design details

Randomization method
By a computer.
Randomization unit
Person level
Clusters
300 participants. August 4, 2026 update: The original experiment recruited 297 participants. The new experiment recruiting those who work in creative jobs (including graphic designers, game developers, content creators, and copywriters) will include up to 180 participants, unless we cannot recruit this many participants with these jobs from Prolific. In that case, we will recruit as many as we can.
Observations
300 participants, split across three treatment groups. The first treatment group sees the AI design a game after they design their first game. The second treatment group sees the AI design a game only after they design their second game. The final treatment group does not see the AI design a game at all. We exclude (by asking to return the study) participants who give more than three incorrect answers to comprehension questions. August 4, 2026 update: See above about the up to 180 new participants.
Arms
In expectation: 100 see the AI design after they design their first game, 100 only after they design their second game, and 100 not at all. August 4, 2026 update: Same randomization probabilities as the original experiment.
Primary outcomes
WTPs (predicted and actual), pride and enjoyment measures, beliefs about ability.

Cited by

No citation data available for this registration yet.

Keywords