Cognitive Load and Reliance on AI Recommendations

How to cite

Cao, Yunshu. 2026. "Cognitive Load and Reliance on AI Recommendations." AEA RCT Registry. AEARCTR-0019352. https://doi.org/10.1257/rct.19352-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Yunshu Cao*

* Primary investigator

Registry ID
AEARCTR-0019352
DOI
https://doi.org/10.1257/rct.19352-1.0
First registered
Last updated
Status
In development
Trial dates
2026-08-11 – 2027-02-28
Countries
Private
JEL codes
C91, D83, D91
Registry record
http://www.socialscienceregistry.org/trials/19352

Abstract

This study examines how task difficulty and the correctness of AI recommendations affect decision-making performance. We plan to recruit approximately 600 participants aged 18–65, with approximately 300 participants in China and 300 in the United States, including university students and members of the general public recruited through online and in-person methods. In a 2 × 2 within-subject design, each participant completes eight reasoning and decision-making tasks accompanied by AI recommendations. Task difficulty and AI recommendation correctness are assigned at the task level according to pre-generated pseudorandom participant schedules, while the eighth task family is randomly selected at the participant level from three additional task families. The primary outcome is task-level decision accuracy, and decision confidence is the secondary outcome. The study tests whether greater cognitive demands change how individuals respond to correct and incorrect AI-provided information.

Intervention

Participants will complete a series of reasoning and decision-making tasks accompanied by AI recommendations. The study experimentally varies task difficulty and whether the AI recommendation is correct or incorrect. This allows us to examine how cognitive demands and the quality of AI-provided information affect decision accuracy and confidence.

Experimental design

The study uses a 2 × 2 within-subject experimental design. The two experimentally varied factors are task difficulty (easy versus difficult) and AI recommendation correctness (correct versus incorrect). Participants complete multiple reasoning and decision-making tasks, allowing the study to compare decision accuracy across different combinations of cognitive demand and AI information quality.

Design details

Randomization method
Randomization is implemented by computer using pre-generated pseudorandom task schedules. Seven task families are administered to all participants, and one additional task family is randomly selected from three remaining task families. Across the administered tasks, task difficulty and AI recommendation correctness vary according to the assigned schedule. For online participants, Qualtrics assigns and displays the corresponding task versions.
Randomization unit
The primary experimental treatments—task difficulty and AI recommendation correctness—are randomized at the task level within participants. The selection of the eighth task family from the three additional task families occurs at the participant level.
Clusters
600 participants
Observations
Approximately 600 participants, contributing up to 8 core task-level observations each (approximately 4,800 task-level observations in total).
Arms
Approximately 600 participants. This is a within-subject design, so participants are not assigned to mutually exclusive treatment arms. Task difficulty (easy vs. difficult) and AI recommendation correctness (correct vs. incorrect) vary across tasks within participants.
Primary outcomes
Task-level decision accuracy
Secondary outcomes
Decision confidence

Cited by

No citation data available for this registration yet.

Keywords