Privacy, Truth-Telling, and Data Quality: Experimental Evidence on Sensitive Questions Measurement in Surveys
How to cite
Saavedra, Melanie; Muñoz, Ercio; Medellin, Nadin. 2026. "Privacy, Truth-Telling, and Data Quality: Experimental Evidence on Sensitive Questions Measurement in Surveys." AEA RCT Registry. AEARCTR-0018619. https://doi.org/10.1257/rct.18619-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Household surveys routinely include questions on sensitive topics, yet responses are widely believed to underestimate true prevalence due to social desirability bias. This study reports on a survey experiment in the urban area of the Metropolitan Region of Chile, randomly assigning 1,260 households to a text-only computer-assisted self-interview (CASI) or an audio computer-assisted self-interview (ACASI), in which respondents listen to questions through headphones. We estimate the effect of audio assistance on disclosure rates for sensitive items related to gender identity, sexual orientation, discrimination, violence, self-harm and mental health. We further examine effects on item nonresponse and a range of response quality indicators derived from questionnaire responses and survey paradata. Placebo items are included to distinguish privacy-driven effects from changes in comprehension or attentiveness. Within each household, mental health items (PHQ-4) are duplicated across interviewer-administered (CAPI) and self-administered modes, with the order of these components independently randomized, to compare the gap between interviewer- and self-administered measurement across the CASI and ACASI arms.
Intervention
The intervention is the mode used to administer the self-administered sections of the individual questionnaire (the mental health section and the sensitive block). Households assigned to the control arm administer these sections via text-only computer-assisted self-interviewing (CASI): the interviewer hands the device to the selected respondent, who reads the questions on screen and inputs responses directly. Households assigned to the treatment arm administer the same sections via audio computer-assisted self-interviewing (ACASI): the selected respondent uses individual headphones to listen to the questions and response options through audio and inputs responses on the device. Question wording, response options, and skip patterns are identical across arms. The sensitive block covers items on gender identity, sexual orientation, discrimination, violence, and self-harm behaviors, and also includes placebo items. Prior to the first self-administered section, all respondents complete a brief practice item to familiarize them with the assigned mode. Interviewers follow a privacy protocol during the self-administered sections, ensuring the screen is not visible to third parties and maintaining appropriate spacing.
Experimental design
This is a household-level randomized controlled trial conducted in urban areas of the Metropolitan Region of Chile. A target of 1,260 households is randomly assigned in a 1:1 ratio to either text-only computer-assisted self-interviewing (CASI, control, 630 households) or audio computer-assisted self-interviewing (ACASI, treatment, 630 households) for the sensitive block of the individual questionnaire. Within each household, one eligible member aged 14 or older is randomly selected to complete the individual questionnaire, which combines an interviewer-administered (CAPI) component and the assigned self-administered (CASI or ACASI) component. Independently of the mode assignment, households are randomized 1:1 to one of two orderings of these two components: CAPI-first/self-second or self-first/CAPI-second. Mental health items (PHQ-4) are duplicated across the CAPI and self-administered components; because each respondent is assigned to only one self-administered mode, this allows the gap between interviewer- and self-administered measurement to be compared across the CASI and ACASI arms, with the order randomization allowing identification of this contrast net of order or fatigue effects. The household sample is selected through a stratified multistage probability design with five geographic strata corresponding to zones of Greater Santiago (Centro, Norte, Oriente, Poniente, Sur).
Design details
Cited by
No citation data available for this registration yet.