Procedural Decision-Making in Response to Complexity-- Fixing Approaches--Cross-domain test

How to cite

Arrieta, Gonzalo; Nielsen, Kirby. 2025. "Procedural Decision-Making in Response to Complexity-- Fixing Approaches--Cross-domain test." AEA RCT Registry. AEARCTR-0016738. https://doi.org/10.1257/rct.16738-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Gonzalo Arrieta* , Kirby Nielsen

* Primary investigator

Registry ID
AEARCTR-0016738
DOI
https://doi.org/10.1257/rct.16738-1.0
First registered
Last updated
Status
In development
Trial dates
2025-09-15 – 2026-12-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/16738

Abstract

This project follows up on AEARCTR-0010977 and AEARCTR-0016228. We ran the AEARCTR-0016228 experiment on June 17 and 18. We found that implementers were significantly noisier in complex decisions than in simple decisions. After running the experiment, we realized a natural confound: Since we compared noise between 2- and 10-outcome lotteries for Simple messages, and between 10- and 20-outcome lotteries for Complex messages, finding higher noise in more complex decisions could instead result from the fact that the message was tailored to the relatively simpler environment (i.e., Simple messages were written for 2- rather than 10-outcome lotteries, and Complex messages were written for 10- rather than 20-outcome lotteries). In other words, the resulting higher noise could be driven by higher complexity, or it could be driven by moving away from the domain in which the choice process was developed. To test between these two hypotheses, we will run a nearly identical experiment, using Simple messages with 3- and 13-outcome lotteries, and Complex messages with 11- and 21-outcome lotteries, respectively. This controls for the “cross-domain” effect (under the assumption that 2- and 3-, and 10- and 11-outcome lotteries are not perceived to be the same domain), isolating the effect of complexity. The main outcome variable of this experiment will be the same as before: We will compare noise rates between simple (3-outcome and 11-outcome) and complex (13- and 21-outcome) lotteries, within each type of message.

Intervention

We provide implementers with a choice process description and ask them to implement it on simple and complex lotteries, some of which are repeated and some of which are related by FOSD. We test whether implementers are noisier (i.e., less likely to choose consistently in repeated menus) in complex decisions compared to simple ones. We also test whether implementers violate FOSD more in complex lotteries. We investigate the sensitivity of these effects to specific choice processes, such as "procedures."

Experimental design

Implementers face simple and complex lotteries. We randomly select lottery menus to be repeated.

Design details

Randomization method
All randomization occurs through oTree: (e.g., assignment of either a simple message or a complex message, randomly selected lotteries, and randomly selected lotteries to repeat).
Randomization unit
We randomize into treatments at the individual-level: Implementers receive either a simple or a complex message. This interacts with another source of randomness which is whether implementers receive a message that is procedural or non-procedural. The complex messages contain more procedural processes, so these two sources of randomness are not independent.
Clusters
The design is not clustered, so each cluster is one participant. We recruit 1650 implementers to implement simple messages and 1650 implementers to implement complex messages.
Observations
We have 3300 total implementers. Each faces 20 menus, including two repeated simple menus, two repeated complex menus, one simple FOSD menu, and one complex FOSD menu.
Arms
1650 implementers to implement simple messages and 1650 implementers to implement complex messages, each facing two repeated simple menus, two repeated complex menus, one simple FOSD menu, and one complex FOSD menu.
Primary outcomes
noise rates, FOSD violations
Secondary outcomes
self-reported difficulty

Cited by

No citation data available for this registration yet.

Keywords