Experiments on survey measurement error and high frequency data collection in Bangladesh
How to cite
Markhof, Yannick; Wollburg, Philip; Palacios-Lopez, Amparo; Castaing, Pauline; Contreras, Ivette.
2026. "Experiments on survey measurement error and high frequency data collection in Bangladesh." AEA RCT Registry. AEARCTR-0018450.
https://doi.org/10.1257/rct.18450-2.1
Download:
BibTeX
·
RIS— for reference managers without a browser
translator. Zotero and most
others pick up this page's citation metadata directly.
We use a series of survey experiments embedded over multiple rounds of a panel survey to study the sources, causes, and remedies of measurement error in survey data. The topical focus of our surveys is on living standards, extreme climate events, and their interaction with welfare at the household and intra-household level. Within each survey round, we randomize survey mode (in-person vs. over the phone), collect a series of data quality proxies, and conduct a range of experiments to study mechanisms.
Intervention
This study embeds a set of randomized experiments within a multi-round household panel survey in flood-prone districts of Bangladesh. The experiments are designed to identify the sources and mechanisms of measurement error in household surveys.
Experimental design
A multi-round panel survey experiment with approximately 1,500 households in flood-prone districts of Bangladesh, surveyed four times between April and October 2026. Two respondents per household are interviewed with identical instruments. The study embeds several randomized experiments within the survey to identify sources of measurement error. The main randomizations vary survey mode (phone vs. in-person), respondent incentive levels, enumerator assignment, and the ordering of modules within the questionnaire. A digital monitoring component operates between the final two rounds.
Design details
Randomization method
Computer-generated randomization using Stata, stratified as described below.
Randomization unit
Multiple levels: - EA level: Incentive amounts. - Household level (within EA): Survey mode (stratified by EA), recording visibility (household level for in-person interviews). - Respondent level (within household): Module ordering, high-frequency monitoring via Resonance. - Interview-level: Enumerators to interviews (conditional on EA), audit announcement (conditional on enumerator selected for any audit announcement), planted errors in dwelling description. - Enumerator level: any audit announcements.
Clusters
50 enumeration areas (EAs).
Observations
Approximately 1,500 households with 2 respondents each (approximately 3,000 respondents).
Arms
Survey mode: ~750 households phone, ~750 households in-person (15 per arm per EA × 50 EAs).
Incentives: ~17 EAs low, ~17 EAs medium, ~16 EAs high (~510/510/480 households).
Module order: ~500 respondents per version (6 versions, respondent-level).
Recording visibility: Round 0: ~2,700 respondents with visible external microphone, ~300 respondents tablet-only;
High frequency monitoring system: ca. 1000 respondents to receive invite, 500 willing respondents to receive no invite.
Primary outcomes
Data quality indicators:
Data accuracy (match rates between enumerator-observed and respondent-reported dwelling characteristics and observation items); internal consistency (FIES attention check, PHQ-8 attention check, locus of control consistency, climate adaptation question pair consistency, income aggregate vs. itemized discrepancy); enumerator-assessed interview quality (1–10 ladder); paradata-based measures (interview duration, response heaping, straightlining, acquiescence bias, RISSK Unit Risk Score).
Substantive welfare outcomes:
PHQ-8 score; FIES raw score; total household labor income (aggregated from sources); child school attendance and absenteeism; any work in last week and hours worked and employment status (working, unemployed, inactive); road conditions (water/mud visible); flood likelihood perception.
Secondary outcomes
Share with any depressive symptoms (score ≥ 4); Depressive symptom severity categories (moderate, moderately severe, severe); binary food insecurity indicators; income by source; days of school absence; work by type; WASH indicators; climate adaptation perceptions (inverse framing); within-household outcome agreement; enumerator feedback index.
Cited by
No citation data available for this registration yet.