Are Voters Updating when Audit Reports are Informative?
How to cite
Raposo, Felipe Torres; Duch, Raymond. 2020. "Are Voters Updating when Audit Reports are Informative?." AEA RCT Registry. AEARCTR-0005932. https://doi.org/10.1257/rct.5932-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This experimental design is implemented in collaboration with the NGO Chile Transparencia. Beginning in February 2020 the Chilean Comptroller General Office rolled out 167 audits in municipalities throughout the country. The treatment consists of the audit report for each municipality in addition to a short information video that highlights the extent to which the municipality has high or low malfeasance counts. We have recruited approximately 49,000 online subjects from these municipalities (plus a control group of 177 non-audited municipalities). All 10,000 subjects will receive a pre-treatment survey measuring their pre-treatment beliefs regarding corruption in their municipality.
Within each audited municipality subjects randomly assigned to the treatment will receive a video publicizing the municipality's audit report -- those randomly assigned to control will receive a placebo ad. We organize the outcomes from this information treatment into three groupings: 1) beliefs about the prevalence of corruption; 2) the salience of these beliefs, and 3) whether these beliefs affect voting behaviour. Relatively few of these audit studies directly measure belief updating as a response to malfeasance information treatments.
Treated subjects are targeted with video treatment within five days of the release of the audit report. A post-treatment survey will be conducted for two weeks and one month after the audit report is released. They are questioned again regarding their beliefs about the prevalence of malfeasance in their municipal government. With similar pre-treatment measures we are able to fairly precisely measure belief updating. In addition, we have subjects in control who are targeted with a placebo video treatment.
Intervention
Our focus here is on individual-level priors regarding malfeasance in municipal governance and whether individuals update when they are informed about malfeasance in their local municipality. The information in question here is the 2020 municipal audits that will be conducted in 168 of the Chilean municipalities. The content of these audits will provide the basis for the information treatments that we implement in this experiment.
The malfeasance information treatment essentially summarizes the level of malfeasance the Contraloria reports for each municipality. All of the treated subjects see two pieces of information: One element is a simple count of the number of irregularities identified by the Contraloria audit. And a second provides a summary score that is generated by the Contraloria and reflects both the irregularities committed but also their seriousness and their importance relative to the size of the municipal budget. These are presented to subjects on a horizontal colour-coded scale anchored on the left by 0 (Green/Very Good) and on the right by 100 (Red/Very Bad).
%-- does a message about malfeasance in government matter? Scaling up is another matter. But ideally to address this first issue we want to compare a large N of individuals who are randomly assigned to treatment (and who we know are treated) to a large N of individuals randomly assigned to control (and who we know have not been treated).
Subjects are also informed about the relative malfeasance performance of their municipality. There are two versions of the information treatment: ``spatial'' and ``temporal''. A temporal benchmark compares the municipality's performance (irregularities plus score) to its previous audits. We do this by placing the benchmark information on an identical horizontal axis just below the actual audit results. A spatial benchmark version compares the municipality's performance to an average of municipalities from the last audit.
Experimental design
The experimental design builds on an annual audit that is conducted by the CGO of municipal governments. For the year 2020, the CGO has selected 167 municipalities for an audit. Our audit information treatments are designed in conjunction with the CGO's roll-out of these municipal audits.
The audit outcomes will provide the content for the information treatments that we will implement via WhatsApp. We are leveraging the fact that the audit outcomes will vary -- the number of reported irregularities varies quite significantly across municipalities. Figure 1 in our pre-analysis summarizes the distribution of municipality irregularities reported by the Contraloria audits in 2016. On average, the audits report about 30 irregularities. The sample frame aims to have a balance of subjects in municipalities with above average, ``negative'', audit reports and with below-average, ``positive'', audit reports.
The treatment condition in the experiment is receiving a short video summarizing the results of the CGO audit report. Our subjects are individuals residing in any of the 167 municipalities audited by the CGO in 2020. The video treatments are customized for each municipality. As a result, we expect the treatments to range from very positive -- virtually no irregularities -- to very negative -- in the neighborhood of 90-100 irregularities. We can think of the treatment as a positive or negative "dosage'' rather than a dichotomous treatment arm. As we pointed before, the outcomes of interest are the subjects' beliefs about the prevalence of corruption in municipal government; their attitudes regarding municipal governance; and their vote intentions. The outcome variables are measured at three different periods in the experiment: pre-treatment; post-treatment; and pre-election.
Design details
Cited by
No citation data available for this registration yet.