Cross-Cultural Biases and Inattention

How to cite

Mughogho, Winnie; Owsley, Nicholas; Tang, Chang. 2021. "Cross-Cultural Biases and Inattention." AEA RCT Registry. AEARCTR-0007965. https://doi.org/10.1257/rct.7965-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Winnie Mughogho* , Nicholas Owsley , Chang Tang

* Primary investigator

Registry ID
AEARCTR-0007965
DOI
https://doi.org/10.1257/rct.7965-1.0
First registered
Last updated
Status
In development
Trial dates
2021-09-19 – 2022-01-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/7965

Abstract

Inattention (or careless responding) is prevalent in self-administered surveys, posing a threat to data quality and biasing results. Risk of low-attention is especially high in remote and self-administered settings, owing to the lack of direct monitoring and supervision by lab staff. As remote and self-administered surveys are increasingly preferred for conducting research, the risk of inattention becomes increasingly prevalent.

In this context, we will test the use of a set of established survey inattention measures (Craig & Meade, 2012; Berinsky et al. 2019), tailored to the Kenyan population but with a generalizable framework that can be used in similar contexts. These will allow us to detect low survey attention in a wider cross-cultural study while expanding the literature on survey inattention in remote surveys. Literature suggests that respondents tend to respond differently on a range of substantive indicators (Bowling et al. 2016). Removing inattentive respondents from a dataset because of data quality therefore poses a risk to the generalizability of estimates. Faced with the issue of inattention, we test two basic interventions in order to reduce survey inattention. These are:

- A small financial incentive for answering a question in the survey correctly
-The placement of an obvious attention check early in the survey (Hauser & Schwarz, 2015)

Implementing the above provides the opportunity to measure the sensitivity of attention to interventions specifically designed to manipulate it. With this, we will be able to derive recommended survey design features to reduce inattention in mobile surveys.

Experimental design

Our aim is to test interventions aimed at increasing survey attention. To that end we will randomly assign participants to either a) be offered a ‘bonus’ (small financial incentive) for completing certain questions correctly, or not, and to b) complete an “instructional manipulation check'' at the beginning or end of the survey on cross-cultural biases. This will generate a 2x2 design, with 4 treatment cells, allowing us to identify whether each intervention, or their interaction, affects survey inattention.

Design details

Randomization method
Randomization done in office using statistical software
Randomization unit
Individual
Clusters
0
Observations
1500 individuals from low income population; 500 students from universities in Kenya.
Arms
Group 1 (Early IMC, Bonus Incentive); Group 2 (Early IMC, No Bonus Incentive); Group 3 (Late IMC, Bonus Incentive); Group 4 (Late IMC, No Bonus Incentive)
Primary outcomes
Index of attention

Cited by

No citation data available for this registration yet.

Keywords