Cross-Cultural Biases and Inattention
How to cite
Mughogho, Winnie; Owsley, Nicholas; Tang, Chang. 2021. "Cross-Cultural Biases and Inattention." AEA RCT Registry. AEARCTR-0007965. https://doi.org/10.1257/rct.7965-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Inattention (or careless responding) is prevalent in self-administered surveys, posing a threat to data quality and biasing results. Risk of low-attention is especially high in remote and self-administered settings, owing to the lack of direct monitoring and supervision by lab staff. As remote and self-administered surveys are increasingly preferred for conducting research, the risk of inattention becomes increasingly prevalent.
In this context, we will test the use of a set of established survey inattention measures (Craig & Meade, 2012; Berinsky et al. 2019), tailored to the Kenyan population but with a generalizable framework that can be used in similar contexts. These will allow us to detect low survey attention in a wider cross-cultural study while expanding the literature on survey inattention in remote surveys. Literature suggests that respondents tend to respond differently on a range of substantive indicators (Bowling et al. 2016). Removing inattentive respondents from a dataset because of data quality therefore poses a risk to the generalizability of estimates. Faced with the issue of inattention, we test two basic interventions in order to reduce survey inattention. These are:
- A small financial incentive for answering a question in the survey correctly
-The placement of an obvious attention check early in the survey (Hauser & Schwarz, 2015)
Implementing the above provides the opportunity to measure the sensitivity of attention to interventions specifically designed to manipulate it. With this, we will be able to derive recommended survey design features to reduce inattention in mobile surveys.
Experimental design
Our aim is to test interventions aimed at increasing survey attention. To that end we will randomly assign participants to either a) be offered a ‘bonus’ (small financial incentive) for completing certain questions correctly, or not, and to b) complete an “instructional manipulation check'' at the beginning or end of the survey on cross-cultural biases. This will generate a 2x2 design, with 4 treatment cells, allowing us to identify whether each intervention, or their interaction, affects survey inattention.
Design details
Cited by
No citation data available for this registration yet.