AI, Belief Calibration, and Human Decision-Making: Evidence from a Large-Scale Field Experiment with Taxi Drivers

How to cite

Xiahou, Qinrui; He, Guojun. 2025. "AI, Belief Calibration, and Human Decision-Making: Evidence from a Large-Scale Field Experiment with Taxi Drivers." AEA RCT Registry. AEARCTR-0016775. https://doi.org/10.1257/rct.16775-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Qinrui Xiahou* , Guojun He

* Primary investigator

Registry ID
AEARCTR-0016775
DOI
https://doi.org/10.1257/rct.16775-1.0
First registered
Last updated
Status
In development
Trial dates
2025-09-15 – 2026-02-28
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/16775

Abstract

This study investigates how artificial intelligence (AI) and behavioral interventions can improve decision-making and productivity among gig workers. We partner with a leading mobility platform to conduct a large-scale randomized controlled trial (RCT) with 8,000 taxi drivers in a major city in China. The experiment tests two complementary channels: (1) ability improvement through AI-generated real-time demand predictions and (2) belief calibration through personalized feedback that corrects misperceptions about earnings across different strategies. We examine whether these interventions reduce inefficient behaviors—such as prolonged queuing at transport hubs despite lower earnings—and improve drivers’ income. The study contributes to understanding human-AI complementarity in labor markets and informs the design of technology systems that augment rather than replace human judgment.

Intervention

The study involves a series of in-app interventions delivered through a widely used taxi driver application in a major city in China. These interventions are designed to improve driver outcomes by providing real-time information and personalized feedback on earnings. There is also a control group that receives no new features.

Experimental design

The study is a large-scale, multi-arm randomized controlled trial (RCT) conducted in a major city in China. The interventions are delivered through a widely-used mobile application for taxi drivers. Drivers are randomly assigned to a control group or one of several treatment arms, which are designed to enhance driver productivity through AI-assisted ability improvement, belief calibration, or a combination of both.

Design details

Randomization method
Randomization will be performed by a computer using a stratified randomization protocol based on driver income levels and baseline characteristics to ensure balance across treatment and control groups.
Randomization unit
Individual driver
Clusters
8,000 drivers
Observations
8,000 drivers × daily observations for ~180 days ≈ 1,440,000 driver-day observations.
Arms
Control Group: 2000 Nine treatment arms (from the 3x3 factorial design): 667 drivers each.
Primary outcomes
1. Average hourly income (net of fees). 2. Time allocation (fraction of hours spent at transport hubs vs. city cruising). 3. Average queue duration at major transport hubs.
Secondary outcomes
1. Driver belief accuracy. 2. Compliance with AI recommendations (usage intensity of AI features). 3. Externalities (hub congestion, passenger wait times). 4. Work duration and total working hours.

Cited by

No citation data available for this registration yet.

Keywords