User interface effects in preference elicitation

How to cite

Drichoutis, Andreas; Nacka, Marina. 2025. "User interface effects in preference elicitation." AEA RCT Registry. AEARCTR-0017233. https://doi.org/10.1257/rct.17233-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Andreas Drichoutis* , Marina Nacka

* Primary investigator

Registry ID
AEARCTR-0017233
DOI
https://doi.org/10.1257/rct.17233-1.1
First registered
Last updated
Status
In development
Trial dates
2025-11-18 – 2025-12-17
Countries
Private
JEL codes
C91, C92, D12, D90
Registry record
http://www.socialscienceregistry.org/trials/17233

Abstract

This study investigates how input formats affect willingness to pay in incentive-compatible valuation tasks. Using a between-subjects design, participants provide bids through one of three user interface formats: increment/decrement buttons, a slider, or an open numeric box. Within subjects, bidding occurs in two rounds. In Round 1, participants submit bids for four alternative cookie packages based on visual information only. In Round 2, they first taste the cookies and then submit bids again. One product and one round are randomly selected as binding, and participants have their decisions realized with 20% chance according to the Becker–DeGroot–Marschak (BDM) mechanism. The experiment therefore examines both (i) the influence of interface design on bid levels and consistency, and (ii) how sensory experience modifies willingness to pay in a homegrown elicitation context. Results will provide evidence on how seemingly neutral input formats and valuation ranges can shape economic preferences in laboratory settings.

Intervention

The experiment employs a between-subjects, within-subjects design implemented in a controlled laboratory setting. The between-subjects intervention consists of an input format treatment (three levels): Participants are randomly assigned to one of three user interface formats for submitting their bids in a Becker–DeGroot–Marschak (BDM) mechanism: a) Button input: participants adjust their bid using increment/decrement buttons labeled –10, –5, –2, –1, +1, +2, +5, and +10. b) Slider input: participants indicate their bid using a continuous slider. c) Numeric box input: participants type their bid directly into an open text box.

Within each between-subjects treatment, participants complete two valuation rounds for four cookie products as follows:
- Round 1: participants view four alternative cookie packages and place bids for each based on visual information only.
- Round 2: participants taste the cookies and then place bids again for all four products.

At the end of the session, one product and one round are randomly selected as binding, and participants have their decisions realized with 20% chance according to the BDM mechanism procedure.

Experimental design

The study follows a three level between-subjects factorial design combined with two within-subject valuation rounds. Participants are randomly assigned to one of three input format conditions (buttons, slider, or numeric box). Randomization is conducted at the individual level using the Qualtrics randomizer to ensure equal allocation across conditions.

Within each treatment combination, participants complete two valuation rounds involving the same four cookie products. In Round 1, participants place bids based only on visual information about the packages, while in Round 2, they first taste the cookies before bidding again. This within-subject structure allows measurement of how experience (tasting) affects willingness to pay, holding interface constant.

At the end of the session, one product and one round are randomly selected as binding. Participants have their choices realized with 20% chance implemented following the BDM procedure, introducing real monetary incentives while maintaining feasibility for a lab setting. The design therefore enables identification of the causal effects of (i) input format on elicited willingness to pay, as well as (iii) within-subject changes in valuation before and after product experience.

Design details

Randomization method
Randomization is implemented at the individual level through the Qualtrics platform. Each participant is automatically and independently assigned to one of the three input format conditions (buttons, slider, or numeric box). The Qualtrics randomizer uses built-in random number generation to ensure equal allocation probabilities across all treatment. Assignment information is stored as embedded variables for use in subsequent data analysis.
Randomization unit
The unit of randomization is the individual participant.
Clusters
~64 subjects * 3 between-subjects treatments = 192 subjects
Observations
192 subjects * 4 products * 2 rounds = 1536 observations
Arms
1536/3 ~ 512 observations per treatment arm
Primary outcomes
Bids or WTP

Cited by

No citation data available for this registration yet.

Keywords