Privacy, Truth-Telling, and Data Quality: Experimental Evidence on Sensitive Questions Measurement in Surveys

How to cite

Saavedra, Melanie; Muñoz, Ercio; Medellin, Nadin. 2026. "Privacy, Truth-Telling, and Data Quality: Experimental Evidence on Sensitive Questions Measurement in Surveys." AEA RCT Registry. AEARCTR-0018619. https://doi.org/10.1257/rct.18619-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Melanie Saavedra* , Ercio Muñoz , Nadin Medellin

* Primary investigator

Registry ID
AEARCTR-0018619
DOI
https://doi.org/10.1257/rct.18619-1.0
First registered
Last updated
Status
In development
Trial dates
2026-06-17 – 2026-08-06
Countries
Private
JEL codes
C83, C93, J15, J16
Registry record
http://www.socialscienceregistry.org/trials/18619

Abstract

Household surveys routinely include questions on sensitive topics, yet responses are widely believed to underestimate true prevalence due to social desirability bias. This study reports on a survey experiment in the urban area of the Metropolitan Region of Chile, randomly assigning 1,260 households to a text-only computer-assisted self-interview (CASI) or an audio computer-assisted self-interview (ACASI), in which respondents listen to questions through headphones. We estimate the effect of audio assistance on disclosure rates for sensitive items related to gender identity, sexual orientation, discrimination, violence, self-harm and mental health. We further examine effects on item nonresponse and a range of response quality indicators derived from questionnaire responses and survey paradata. Placebo items are included to distinguish privacy-driven effects from changes in comprehension or attentiveness. Within each household, mental health items (PHQ-4) are duplicated across interviewer-administered (CAPI) and self-administered modes, with the order of these components independently randomized, to compare the gap between interviewer- and self-administered measurement across the CASI and ACASI arms.

Intervention

The intervention is the mode used to administer the self-administered sections of the individual questionnaire (the mental health section and the sensitive block). Households assigned to the control arm administer these sections via text-only computer-assisted self-interviewing (CASI): the interviewer hands the device to the selected respondent, who reads the questions on screen and inputs responses directly. Households assigned to the treatment arm administer the same sections via audio computer-assisted self-interviewing (ACASI): the selected respondent uses individual headphones to listen to the questions and response options through audio and inputs responses on the device. Question wording, response options, and skip patterns are identical across arms. The sensitive block covers items on gender identity, sexual orientation, discrimination, violence, and self-harm behaviors, and also includes placebo items. Prior to the first self-administered section, all respondents complete a brief practice item to familiarize them with the assigned mode. Interviewers follow a privacy protocol during the self-administered sections, ensuring the screen is not visible to third parties and maintaining appropriate spacing.

Experimental design

This is a household-level randomized controlled trial conducted in urban areas of the Metropolitan Region of Chile. A target of 1,260 households is randomly assigned in a 1:1 ratio to either text-only computer-assisted self-interviewing (CASI, control, 630 households) or audio computer-assisted self-interviewing (ACASI, treatment, 630 households) for the sensitive block of the individual questionnaire. Within each household, one eligible member aged 14 or older is randomly selected to complete the individual questionnaire, which combines an interviewer-administered (CAPI) component and the assigned self-administered (CASI or ACASI) component. Independently of the mode assignment, households are randomized 1:1 to one of two orderings of these two components: CAPI-first/self-second or self-first/CAPI-second. Mental health items (PHQ-4) are duplicated across the CAPI and self-administered components; because each respondent is assigned to only one self-administered mode, this allows the gap between interviewer- and self-administered measurement to be compared across the CASI and ACASI arms, with the order randomization allowing identification of this contrast net of order or fatigue effects. The household sample is selected through a stratified multistage probability design with five geographic strata corresponding to zones of Greater Santiago (Centro, Norte, Oriente, Poniente, Sur).

Design details

Randomization method
Both the mode assignment (CASI vs. ACASI) and the order assignment (CAPI-first vs. self-first) are determined by the Survey Solutions (SUSO) electronic questionnaire. The assigned mode and order are revealed to the interviewer by the device only after the household module has been completed and the eligible respondent has been randomly selected by the software. The interviewer has no role in, and no discretion over, the mode or order assigned to each household.
Randomization unit
Household level. The primary intervention (CASI vs. ACASI) and the secondary order randomization (CAPI-first vs. self-first) are both assigned at the household level in a 1:1 ratio, independently of each other. Within each household, one eligible member aged 14 or older is randomly selected by the software to complete the individual questionnaire.
Clusters
1260 households
Observations
1,260 individuals (one randomly selected eligible member aged 14 or older per household)
Arms
630 households CASI (control), 630 households ACASI (treatment). Independently, 630 households CAPI-first ordering and 630 households self-administered-first ordering. The crossing of the two randomizations yields four implementation arms of approximately 315 households each: (i) CASI / CAPI-first, (ii) CASI / self-first, (iii) ACASI / CAPI-first, (iv) ACASI / self-first.
Primary outcomes
(i) Disclosure of sensitive items in the self-administered block, measured as standardized family-level disclosure indices for four item families: (a) gender identity and sexual orientation, (b) discrimination, (c) violence, and (d) self-harm behaviors. (ii) Item nonresponse rates in the sensitive block. (iii) Response quality indicators for the sensitive block, derived from survey paradata and questionnaire responses.
Secondary outcomes
Survey duration (total and by module), breakoff rates (partial completion of the sensitive block), and the difference in mental health responses between the interviewer-administered (CAPI) and self-administered modes, compared across the CASI and ACASI arms.

Cited by

No citation data available for this registration yet.

Keywords