The effect of participation incentives on preference revelations in real discrete choice experiments

How to cite

Kassas, Bachir; Penn, Jerrod; Hu, Wuyang. 2025. "The effect of participation incentives on preference revelations in real discrete choice experiments." AEA RCT Registry. AEARCTR-0014904. https://doi.org/10.1257/rct.14904-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Bachir Kassas* , Jerrod Penn , Wuyang Hu

* Primary investigator

Registry ID
AEARCTR-0014904
DOI
https://doi.org/10.1257/rct.14904-1.0
First registered
Last updated
Status
Completed
Trial dates
2024-12-02 – 2025-01-06
Countries
United States of America ()
JEL codes
C90, D11
Registry record
http://www.socialscienceregistry.org/trials/14904

Abstract

To overcome hypothetical bias, many study designs opt for real incentives, introducing consequentiality into the subjects' decisions by linking their participation compensation to decisions and outcomes realized in the study. While this can encourage truthful preference revelations in discrete choice experiments (DCEs), which improves the validity of estimated preference parameters, the common practice for inducing such incentives relies on providing subjects with a participation compensation then deducting any real payments from this compensation based on their decisions and outcomes. This leaves a critical question regarding how the level of participation compensation used impacts subjects' decisions in the study. In other words, does a higher (or lower) participation compensation impact the decisions subjects make in a DCE? This study addresses this question by varying the participation compensation provided to subjects in a real DCE and comparing preference estimates with a hypothetical DCE as a benchmark. Specifically, it looks at two scenarios where the participation compensation is equal to vs. greater than the maximum price level of the product used in the DCE. By comparing behavior in these two scenarios to a hypothetical DCE, this study can provide useful insights on the parameterization of real DCEs to study consumer valuations for different products and product attributes.

Experimental design

Each subject will complete 6 choice sets in their DCE, with each choice set containing two alternatives and a no-purchase option. Subjects will be randomly assigned to one of 3 groups. The control group will complete a hypothetical DCE. In the other two treatments, subjects will complete a real DCE, however, their participation compensation will be set to either match the maximum price of the products in the DCE (T1) or exceed this maximum price (T2). A comparison of coefficient estimates on price and opt-out will be conducted between the control and two treatments to determine potential differential effects of the treatments on subjects' price sensitivity and willingness to opt out of making a purchase in the study.

Design details

Randomization method
Subjects will be randomized across the 3 treatment groups using the randomizer feature in Qualtrics. This feature allows complete randomization of subjects evenly across the treatments to ensure comparable sample sizes and subject characteristics across treatments.
Randomization unit
Randomization will be conducted at the individual level.
Clusters
Each of the three treatment groups will consist of 150 subjects for a total of 450 subjects in the study.
Observations
Each subject will make 6 choices in the DCE. With a total of 450 subjects, the total number of observations from the DCE will be 2,700.
Arms
Each of the 3 treatments will consist of 150 subjects.
Primary outcomes
Subjects' choices in the DCE will be used to estimate their marginal preferences for product attributes. The coefficient estimates on the price attribute and the opt-out option will be compared between the control and two treatments. This will help examine potential differential effects of the two treatments on subjects' price sensitivity and their willingness to opt out of making a purchase.

Cited by

No citation data available for this registration yet.

Keywords