Causal Reasoning and AI-Assisted Decision Making

How to cite

Camuffo, Arnaldo; Pandey, Abhinav; Gambardella, Alfonso; Mariani, Myriam; Salvucci, Giovanni; Betti, Chiara; Simic, Vladimir; Brown, Rachel; Asirvatham, Hemanth; Ramos, Steve; Chatterji, Ronnie. 2025. "Causal Reasoning and AI-Assisted Decision Making." AEA RCT Registry. AEARCTR-0017124. https://doi.org/10.1257/rct.17124-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Arnaldo Camuffo* , Abhinav Pandey , Alfonso Gambardella , Myriam Mariani , Giovanni Salvucci , Chiara Betti , Vladimir Simic , Rachel Brown , Hemanth Asirvatham , Steve Ramos , Ronnie Chatterji

* Primary investigator

Registry ID
AEARCTR-0017124
DOI
https://doi.org/10.1257/rct.17124-2.0
First registered
Last updated
Status
Completed
Trial dates
2025-10-29 – 2025-10-31
Countries
Italy (Lombardy)
JEL codes
O33
Registry record
http://www.socialscienceregistry.org/trials/17124

Abstract

This trial investigates the independent and interactive effects of causal reasoning training and large language model (LLM) assistance on strategic decision-making. Using a 2×2 factorial design with first year bachelor students (N = 800), we examine how these cognitive enhancement approaches influence the analysis of complex business cases by participants. The experiment tests three primary hypotheses: (1) complementarity (interaction effects) of combined interventions, (2) main effect of causal reasoning training, and (3) main effect of ChatGPT access. Performance is assessed through rubric-based evaluation and comparison with expert solutions, with a two stage least squares analysis that examines the underlying mechanisms.

Experimental design

The study implements a fully crossed factorial design with two treatment dimensions. The first dimension contrasts causal reasoning training with a placebo control. The second dimension provides access/non access to ChatGPT through the standard web interface at chatgpt.com. This design yields four experimental conditions: Placebo without ChatGPT, Placebo with ChatGPT, Treatment without ChatGPT, and Treatment with ChatGPT.

Design details

Randomization method
We use simple randomization using the random assignment of students to classes in the enrollment at the start of the academic year: Randomizing classes into treatments preserves the integrity of the analysis (as it implies random assignment to experimental conditions) while respecting organizational constraints. The participants’ samples in the 4 experimental conditions are similar–on average–along a set of meaningful covariates, as confirmed by the balance checks that ensure that participants in the 4 experimental conditions do not significantly differ. Randomization done in office using Python.
Randomization unit
First-year Bachelor's classes within three degree courses (CLEAM, BIEF, BIEM).
Clusters
A total of 13 classes participate, representing all first-year students in the courses scheduled during the experimental period.
Observations
800 first-year bachelor students.
Arms
3 classes for treatment condition Causal Training + No ChatGPT. 4 classes for treatment condition Causal Training + ChatGPT. 3 classes for treatment condition No Causal Training + No ChatGPT. 3 classes for treatment condition No Causal Training + ChatGPT.
Primary outcomes
Primary preformance Measure and Secondary Performance Measure.
Secondary outcomes
Mechanism, Process, and Behavioural Measures.

Cited by

No citation data available for this registration yet.

Keywords