How to raise awareness during a pandemic? Evidence from Pakistan

How to cite

Montresor, Giulia; Gartner, Jakob; Zudenkova, Galina; Montenbruck, Laura; Gillaizeau, Marc; Pasha, Atika; Karbala, Ghida; Avdeenko, Alexandra. 2020. "How to raise awareness during a pandemic? Evidence from Pakistan." AEA RCT Registry. AEARCTR-0006555. https://doi.org/10.1257/rct.6555-1.2000000000000002

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Giulia Montresor* , Jakob Gartner , Galina Zudenkova , Laura Montenbruck , Marc Gillaizeau , Atika Pasha , Ghida Karbala , Alexandra Avdeenko

* Primary investigator

Registry ID
AEARCTR-0006555
DOI
https://doi.org/10.1257/rct.6555-1.2000000000000002
First registered
Last updated
Status
On going
Trial dates
2020-07-01 – 2021-03-31
Countries
Private
JEL codes
D8, D83, I1, I15, O1, J22, L3
Registry record
http://www.socialscienceregistry.org/trials/6555

Abstract

Public health authorities in high-income countries encourage excessive testing as a strategy to break the chain of COVID-19 infections and to identify high risk areas. This strategy is usually unfeasible in many Low and Middle Income Countries (LMICs) countries, such as Pakistan. In this study, we design and test the effectiveness of different awareness campaign strategies aiming at encouraging preventive behavior during a pandemic where ground mobilization is limited. The awareness campaign is designed and implemented in close cooperation with two implementing partners, Acted Pakistan and the National Rural Support Programme (NRSP). The target population are beneficiaries of the two NGOs across the three provinces of Pakistan, Khyber Pakhtunkhwa, Punjab, and Sindh. As of early November 2020, contacts of NGO beneficiaries and community representatives (incl. community leaders) were collected in 1526 (sampled in two waves: 1147+379) villages. Out of these, 1016 (764+252) villages were randomized to receive the awareness campaign. The remaining 510 (383+127) villages serve as control group (with no intervention). The awareness campaign is conducted via two modalities: via phone calls only 762 (573+189) villages or phone calls and remote mobilization of local task forces 254 (191+63) villages. Additionally, individuals in the treatment villages were randomized to receive five different awareness messages via phone calls. The survey is conducted remotely, over the phone. Outcomes at baseline were captured for beneficiaries and community representatives (incl. community leaders). We plan to follow the same individuals over five bi-monthly short surveys capturing key main outcomes. The endline survey is planned for December 2020. The main aim of the study is to test the effectiveness of the awareness campaign on knowledge, perceptions, behavior (labor supply and adherence to preventive measures) as well as health status. In addition, we capture information on intervention delivery (implementation and take-up). The awareness campaign is being launched in the last week of September 2020 and continues until the enplane data collection in December. While the baseline data for randomization is fixed, we do collect additional refresher contacts in the same villages and also plan to collect a new sample of additional villages to which the study will be extended. Thus, once baseline outcomes and characteristics are retrieved, these contacts will also become part of the eligible pool for the research study.

Experimental design

We conduct an RCT with ten treatment arms (excluding the control group). The RCT is designed to evaluate two different strategies of conducting remote awareness campaigns for NGO beneficiaries. The first one consists in an awareness campaign over the phone and the second one is awareness campaign over the phone accompanied by awareness via a local health task force (LHTF) team mobilized over the phone but conducting awareness activities on the ground(e.g. awareness via posters, loudspeakers). We followed a two-stage randomization process.
First, we stratify the prioritized universe of revenue villages by the implementing partner. In each stratum, 33% of revenue villages were assigned to control, and 67% to treatment. Among the treated villages, 75% were assigned to receive awareness campaign over the phone, while 25% were assigned to receive the awareness campaign over the phone and – in addition – via the LHTF.
Secondly, treated individuals were randomized to receive five different awareness treatments about COVID-19 over the phone: basic awareness(t0); basic awareness + additional message on the potential severity of sickness (t1); basic awareness + additional message on the potential likelihood of contracting COVID-19 (t2); basic awareness + additional message on the potential likelihood of infecting others (t3); basic awareness + additional message on the potential cost of contracting COVID-19 (t4).
While the baseline data for randomization is fixed, we do collect additional refresher contacts in the same villages and also plan to collect a new sample of additional villages to which the study will be extended.
The same experimental design will be applied.

Design details

Randomization method
We apply the procedure outlined above for randomization. In each stage, we apply a re-randomization procedure incorporating multivariate balance checks. In order to allow us to test the null hypothesis that the treatment effect is zero (or any other value) and to calculate confidence intervals we will apply randomization inference. To reduce the number of tests in our analysis, we pool primary outcomes that are similar in the sense that they are expected to be proxies of the same underlying behavior and test the same hypotheses or sub-hypotheses. Details on this and other strategies to adjust for multiple hypothesis testing are presented in the PAP.
Randomization unit
Randomization at revenue village (RVs) and individual level.
Clusters
1526 (sampled in two waves: 1147+379) villages
Observations
18,789 individuals (12,883 in sample 1 and 5,906 in sample 2). More individuals will be added and randomized into the study following two upcoming data collection waves.
Arms
Number of clusters (villages) by treatment arms No awareness: 510 villages Awareness via phone only: 762 villages Awareness via phone + loudspeakers: 254 villages Cross-randomized messages via phone: Basic awareness phone calls in 204 villages Basic awareness phone calls + info on severity of coronavirus 193 villages Basic awareness phone calls + info on individual's prob of getting infected 203 villages Basic awareness phone calls + info on HHm's prob of getting infected 222 villages Basic awareness phone calls + info on cost of health treatment 194 villages
Primary outcomes
For each of our sub-hypotheses, we construct one index consisting of several related outcome variables. These are used as the main outcome variables to test the effects of the awareness campaign. Note that hypotheses 1 and 2 refer to intermediary outcomes, whereas hypotheses 3, 4 and 5 refer to final outcomes. Awareness: We expect treated individuals to have higher levels of awareness of the ongoing COVID-19 pandemic compared to the control group. Improved awareness is manifested in increased knowledge about the corona virus, the symptoms related to COVID-19, and possible preventive measures. Additionally, we expect that treated individuals are able to better identify misconceptions or false information about the virus as compared to those assigned to the control group. Hypothesis 1 The treatment increases respondents’ awareness of the COVID-19 virus. H 1.1 The treatment increases knowledge about the COVID-19 virus. H 1.2 The treatment reduces misconceptions about the COVID-19 virus. H 1.3 The treatment reduces stigma about the COVID-19 virus. Perceptions: We expect the treatment to alter perceptions about: (1) the severity of the disease, (2) the likelihood of contracting COVID-19, (3) the likelihood of infecting other family members, (4) the expected cost of getting infected, and (5) the influence of individual behavior on the likelihood of contracting the virus. Hypothesis 2 The treatment changes respondents’ perceptions about COVID-19. H 2.1 The treatment changes perceptions about the severity of the COVID-19 virus [d]. H 2.2 The treatment changes perceptions about the likelihood of getting infected with the COVID-19 virus [p(l + s; h; V)]. H 2.3 The treatment changes perceptions about the likelihood of infecting others with the COVID-19 virus [pi(.)]. H 2.4 The treatment changes perceptions about the costs of getting infected with the COVID- 19 virus [C]. H 2.5 The treatment changes perceptions about own behavior and the probability of getting infected with the COVID-19 virus. Here, we do not make claims about the direction of changes. For instance, a positive adjustment indicates that the individual will report at endline a higher likelihood of contracting the virus and/ or infecting others, relative to the baseline and to peers in the control group. Additionally, selected beneficiaries may report perceiving the virus to be more severe and/ or perceiving treatment costs to be higher. The direction of change is governed by a number of factors that will be examined further in Section 3.3 on the heterogeneity of effects. Behavior The treatment is expected to improve adherence to preventive measures. The preventive measures under scrutiny include: Hand hygiene practices, wearing of a mask, reduced labor supply and reduced social interactions. Following the theoretical framework presented in Section 2.2, reduced labor supply and social interactions are more costly for individuals given their direct impact on the household’s utility. Hypothesis 3 The treatment increases respondents’ adherence to preventive measures. H 3.1 The treatment increases the number of reported prevention measures. H 3.2 The treatment reduces mobility. H 3.3 The treatment reduces social interactions. H 3.4 The treatment reduces labor supply. Health: We further test the hypothesis that the treatment has an effect on the health status of recipients. We capture (only) self-reported health status. Hypothesis 4 The treatment improves respondents’ general health status. The awareness treatment is administered to only one of the household members. However, in addition to the anticipated direct impact of the awareness treatment on the respondent’s behavior and health status, we expect an indirect impact of the treatment on other household members through a spillover of information. We expect this indirect effect to be larger if the respondent is the household head and hence the main decision maker. In the case of the LHTF treatment, which is administered at the village level, all individuals in treatment villages can directly benefit from information provided by the program. Effects on household members other than the main respondent can thus be understood as indirect effects only, or a combination of indirect and direct effects, depending on whether a household member was reached by the LHTF. Hypothesis 5 The treatment impacts the prevention behavior and health status of other house- hold members and village residents. H 5.1 The treatment reduces mobility of other household members. H 5.2 The treatment reduces social interaction of other household members. H 5.3 The treatment reduces the labor supply of other household members. H 5.4 The treatment improves the general health status of other household members and village residents. Finally, we expect that the higher the intensity of the intervention, the higher the impact on the outcome variables. Intensity is defined in terms of exposure to more than one treatment at the same time, with a maximum of three possible treatments, Tba, Tad, and LHTF, at the same time. Hypothesis 6 The higher the intensity of treatment, the higher the impact on key outcome variables.
Secondary outcomes
see above
Partners
Name: ACTED Pakistan Partner_type: ngo Url: https://www.acted.org/en/

Cited by

No citation data available for this registration yet.

Keywords