Preferences for mixing in multiple-choice questions

How to cite

Zhang, Xing; Fu, Jingcheng; Zhong, Songfa. 2019. "Preferences for mixing in multiple-choice questions." AEA RCT Registry. AEARCTR-0005034. https://doi.org/10.1257/rct.5034-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Xing Zhang* , Jingcheng Fu , Songfa Zhong

* Primary investigator

Registry ID
AEARCTR-0005034
DOI
https://doi.org/10.1257/rct.5034-1.0
First registered
Last updated
Status
In development
Trial dates
2019-11-14 – 2020-11-14
Countries
Private
JEL codes
C93, D83, D91
Registry record
http://www.socialscienceregistry.org/trials/5034

Abstract

Using a large-scale IQ test, this experiment investigates whether and how performance on multiple choice questions is affected by the opportunity of mixing the answers. Prior research shows that when facing difficult choices over similarly attractive options, people tend to choose the default option or procrastinate, and mixing the answers might enhance their performance. Each participant is randomly assigned a scoring rule. Under the standard scoring rule, participants can choose only one option, and receive the maximum score for the question if the correct option is chosen and zero otherwise. Under two nonstandard scoring rules, participants can choose any number k of options, and the scores will be determined either by probability mixing or outcome mixing.

Experimental design

The experiment will be carried out by university students of different majors. There is a random incentive for participation: a small number of randomly drawn participants will receive a fixed payment, plus a bonus which depends on their score in the IQ test. The participants will complete the experiment using their mobile device in a classroom. For the IQ test we employ a factorial design with three scoring rules (Standard, Randomization and Split) and two time constraints (Tight vs. Loose), which gives six treatments. Each participant will be randomly assigned into one of the treatments. Before the test, participants will complete some practice items, and a series of comprehension questions on the experimental instructions. After the IQ test, the participants fill in a questionnaire with the following questions:
1. Hypothetical lottery choice questions (Global Preference Survey, Falk et al. 2018);
2. Big Five Personality Test: a brief, 10-question version (Rammstedt and John 2007);
3. Maximization and Regret Scales (Schwartz et al. 2002);
4. Self-assessed willingness to take risk (Global Preference Survey, Falk et al. 2018);
5. Questions on preference for randomization (Rubinstein 2002);
6. Task-related questions, e.g. opt-in for feedback on relative performance.

Design details

Randomization method
Treatment group assignment will be randomized by the oTree software.
Randomization unit
Individual participant.
Clusters
Around 3000 participants.
Observations
Around 3000 participants.
Arms
Around 500 participants.
Primary outcomes
Scores from the IQ test (both total score and score by question).

Cited by

No citation data available for this registration yet.

Keywords