Belief formation, signal quality and information sources: Experimental evidence on air quality from Pakistan

How to cite

Nakamura, Shotaro; Nasim, Sanval; Rezaee, Arman; Imtiaz, Isra. 2023. "Belief formation, signal quality and information sources: Experimental evidence on air quality from Pakistan." AEA RCT Registry. AEARCTR-0011489. https://doi.org/10.1257/rct.11489-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Shotaro Nakamura* , Sanval Nasim , Arman Rezaee , Isra Imtiaz

* Primary investigator

Registry ID
AEARCTR-0011489
DOI
https://doi.org/10.1257/rct.11489-2.0
First registered
Last updated
Status
Completed
Trial dates
2023-01-12 – 2023-07-31
Countries
Pakistan ()
Registry record
http://www.socialscienceregistry.org/trials/11489

Abstract

An emerging body of empirical work emphasizes the demand for effective mitigation measures against severe seasonal ambient air pollution in developing cities. Yet, governments in developing countries often struggle to provide consistent and reliable air quality information. In such an environment, private alternatives to government services may improve citizens' access to air quality information. However, the efficacy of private alternatives may depend upon citizens' preferences for and beliefs about the accuracy of the information sources. We study how the source of environmental information affects citizens’ beliefs about the level of air quality and their protection measures against polluted air. In this field experiment, we vary the salience of information sources---the government vs. a private citizens group---of air pollution forecasts we provide in Lahore, Pakistan. We will measure the changes in people’s beliefs about air pollution levels and preferences for government services on air quality information through incentive-compatible elicitation games.

Intervention

In our intervention, we send air quality forecasts via SMS to a sample of Lahore residents in a working class neighborhood. We developed an ensemble forecast model of day-ahead air pollution using data inputs from multiple sources, including government and private monitors. We then experimentally vary the salience of information sources when we give forecasts to the participants, holding constant the actual forecast. In one arm, respondents are told that the forecasts are constructed using data from Punjab Environmental Protection Department (EPD), a government agency responsible for reporting on air quality. In the other arm, respondents are told that the forecasts are constructed using data from a citizens’ group called Pakistan Air Quality Initiative (PAQI). We identify treatment effects on measures of their beliefs over air quality and preferences via incentive-compatible elicitation.

Experimental design

We study how citizens update their beliefs about air quality and modify their behaviors, and how that depends on the information source. We also study how information quality affects citizens’ beliefs about the reliability of, and preference for, government vs. private sources. We will run a field experiment in which we provide a day-ahead pollution fore- cast via SMS to lower-middle income citizens in Lahore. We construct ensemble forecast models taking inputs from both government and private sources. We experimentally vary to which source the information is attributed (Government or Private). We collect incentivized forecast measures of air pollution before and after the intervention to track the evolution of citizens’ beliefs about air quality. We conduct lab-in-the-field games to identify citizens’ trust and preferences for the two sources, as well as their willingness to pay for the forecast service, which we provide for free during the experimental phase. We also measure impact on avoidance behavior from poor air quality by collecting time-use data and reported uses of high-filtration masks. Further detail will be made available in the pre-analysis plan after the conclusion of our trial.

Design details

Randomization method
We conducted the blocking and randomization on R using blockTools, a package that al- lows us to block observations on a large number of covariates and can accommodate continuous variables without discretizing them. We use the optimal-greedy algorithm and generate blocks using the Minimum Volume Elipsoid (MVE) estimator. We are primarily concerned about balance on outcome variables at baseline, as well as the “take-up” in terms of exposure and comprehension of our SMS forecast messages.
Randomization unit
individual
Clusters
1010
Observations
1010
Arms
505 for government (EPD) arm, 505 for private (PAQI) arm
Primary outcomes
1. Demand for air quality information as the willingness-to-pay (WTP) for SMS-based air quality forecasts 2. Beliefs about air quality levels as the absolute error of incentivized t + 1 forecast of PM2.5 concentration 3. Perceived accuracy of air-quality information source as the absolute error of incentivized guess of the SMS’s forecast 4. Preference for information source as the share of donations to government vs. citizens’ group
Secondary outcomes
All secondary outcomes are listed in the pre-analysis plan, which will be made publicly available after the conclusion of our trial.

Papers from this trial

  1. Imtiaz, Isra, Shotaro Nakamura, Sanval Nasim, and Arman Rezaee. "Beliefs, signal quality, and information sources: Experimental evidence on air quality in Pakistan." (2025). https://escholarship.org/uc/item/3z476268

Cited by

No citation data available for this registration yet.

Keywords