Consumer Choices over AI Assistant Services

How to cite

Lee, Jung Youn; Yang, Joonhyuk. 2025. "Consumer Choices over AI Assistant Services." AEA RCT Registry. AEARCTR-0017411. https://doi.org/10.1257/rct.17411-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jung Youn Lee* , Joonhyuk Yang

* Primary investigator

Registry ID
AEARCTR-0017411
DOI
https://doi.org/10.1257/rct.17411-1.1
First registered
Last updated
Status
In development
Trial dates
2025-12-11 – 2027-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/17411

Abstract

Consumers are increasingly adopting general-purpose AI assistants, which can be offered by both private firms and public-sector institutions. This project examines how individuals evaluate AI-powered assistant services when provider type and service design vary. Using a discrete choice experiment, we study how stated preferences respond to differences in provider, capabilities, and pricing and recover consumer preferences over these attributes. The findings will be used to assess how the availability and design of a publicly provided AI assistant affect adoption, substitution patterns with private providers, and consumer welfare.

Intervention

This study employs an online survey experiment targeting U.S. adults to examine preferences for hypothetical AI assistant services through a series of discrete choice tasks. The experiment uses two layers of randomization. First, participants are randomly assigned to a choice environment that differs in whether a public-sector AI assistant option is available alongside private alternatives. Second, across tasks, the attributes of each AI service, such as provider type, performance, access conditions, and monthly fees, are randomized.

Experimental design

The study is a randomized survey experiment in a sample of U.S. adults.

- Screening: Participants first complete a short screening module that asks about prior use of, or interest in, AI assistants. Only those who indicate some prior use or interest are invited to proceed to the choice tasks; those who do not are routed directly to the remainder of the survey.

- Randomization: Eligible participants are randomly assigned to one of two experimental conditions that differ in the composition of the AI services shown in the choice tasks (with vs. without a public-sector provider).

- Choice tasks: Each respondent completes a series of discrete choice tasks (conjoint questions) in which they choose between several AI assistant profiles or an explicit "None" option. Attribute levels (e.g., price, performance, access conditions, provider type) vary across profiles and tasks according to a pre-generated experimental design.

- Survey module: A separate survey section collects covariates such as institutional trust, privacy attitudes, attitudes toward AI, fiscal attitudes, and demographics.

Design details

Randomization method
Randomization will be implemented within the online survey platform using built-in randomization routines and pre-generated design files. - Respondents are randomly assigned with equal probability to one of two experimental conditions (with vs. without a public-sector provider in the choice set). - Within the condition that includes a public-sector provider, the description of the public option is randomized within respondents across choice tasks (rather than being fixed at the respondent level). - For each experimental condition, we use pre-generated discrete choice designs in which task order, alternative positions, and attribute combinations are randomized ex ante subject to pre-specified constraints (e.g., no identical profiles or no strictly dominated alternatives within a task). Respondents are then randomly assigned to one design block (survey version) within their condition; within each block, task order and the positions of alternatives are held fixed for all respondents assigned to that block. - The position of the choice tasks within the survey (before vs. after the additional survey modules) is randomized. All randomization is done by computer; the research team does not observe or modify treatment assignment during data collection.
Randomization unit
Individual (assignment to experimental condition and design block) and option/profile level within choice tasks (attribute profiles, including the public-option description when applicable).
Clusters
Not clustered.
Observations
Approximately 5,000 respondents (yielding 50,000 choice observations, as each respondent completes 10 tasks).
Arms
- Condition A (choice sets with only privately provided AI assistants): approximately 2,500 respondents. - Condition B (choice sets that also include a publicly provided AI assistant): approximately 2,500 respondents.
Primary outcomes
- Adoption propensity: A binary indicator for whether a participant selects any AI assistant or opts out (chooses "None") in each choice task. - Provider choice shares: The distribution of choices across different provider types across experimental conditions. - Market substitution effects: Changes in the choice shares of private providers when a public option is available in the choice set.

Cited by

No citation data available for this registration yet.

Keywords