Improving Adolescent Lives in Pakistan: An Impact Evaluation

How to cite

Avdeenko, Alexandra; Frölich, Markus; Mannheim, University of. 2020. "Improving Adolescent Lives in Pakistan: An Impact Evaluation." AEA RCT Registry. AEARCTR-0006438. https://doi.org/10.1257/rct.6438-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Alexandra Avdeenko* , Markus Frölich , University of Mannheim

* Primary investigator

Registry ID
AEARCTR-0006438
DOI
https://doi.org/10.1257/rct.6438-1.1
First registered
Last updated
Status
On going
Trial dates
2015-06-01 – 2021-12-01
Countries
Private
JEL codes
C93, J13, I25, O12
Registry record
http://www.socialscienceregistry.org/trials/6438

Abstract

In this study, we evaluate the program “Improving Adolescent Lives in Pakistan” funded by the Ikea Foundation and implemented by UNICEF. It had three overarching goals: To reduce the rate of child marriage, decrease the number of early pregnancies as well as increase school attendance and years of formal education in Sindh and Punjab, Pakistan. The program focused on adolescents, empowering them to be “agents of change” for themselves and their communities. It also targeted parents and community representatives by providing them with knowledge about adolescents’ rights and how to protect and advocate for them. Furthermore, an improvement in services for adolescents was envisioned. Between 2017 and 2019, 446 randomly selected treatment rural communities received the relevant workshops of the program whereby in 141 villages more female participants, and in 129 villages more male participants were mobilized, and in 176 villages no gender-specific mobilization took place. Additionally, in a subset of eligible rural communities (N=212), in 100 villages we cross-randomized non-formal basic education interventions. 167 villages remained in the control group, receiving none of the program interventions. Outcomes at baseline were captured for adolescents, parents, community leaders, and marriage registrars (Nikah Khwans). In the evaluation we first capture information on program delivery (awareness, implementation, and take-up). We additionally capture a number of intermediate outcomes, such as on communication (intergenerational and intragenerational dialogue as well as interpersonal communication competence), service provision (access to services over time, adolescent-friendly services, marriage service provision), and social norms and practices (on child marriage, child rights, equal opportunities). Finally, we are interested in indicators of adolescent empowerment (awareness on child rights, confidence, corporal punishment, self-efficacy, general well-being), child marriage rates and practices, engagement rates and practices, child pregnancy rates, as well as education attendance, attitudes towards education, and learning outcomes.

Due to the COVID-19 pandemic, the in-person endline survey (which was planned for 2020Q1) is split into two waves, starting with interviews with key community representatives. Before these interviews via phone, we register the study. We also indicate outcomes that we hope to collect once in-person interviews are feasible again.

Intervention

Two broad types of interventions were implemented: (1) in child protection and (2) in education, operated from different units at UNICEF Pakistan. Child protection (CP) life-skills training and workshops under the IKEA-II program were expected to change norms and skills. Outcomes such as self-esteem, empathy and respect, communication and expression, coping skills with stress and managing emotions were expected on average more favorable towards adolescents in CP’s program areas as compared to control ones. CP’s training for community influencers under the IKEA-II program was anticipated to improve their attitudes toward adolescents. In more detail, activities with primary focus were interactive theaters, action plan implementation, adolescents’ trainings and workshops, establishment of youth information centers, and the provision of vocational skills trainings. Additionally, the program was characterized by the implementation of intergenerational dialogues, the identification of so-called “adolescent champions”, “trickle down” sessions from these selected peers, reproductive health sessions, and in general regular, structured meetings with adolescents. We expect that attitudes in CP operating areas are on average more favorable towards adolescents as compared to control areas.

Moreover, in 2017 non-formal basic education centers (NFBEC) were established. NFBEC implemented by the Education Unit under the IKEA-II program were expected to directly improve outcomes related to enrollment and drop-outs out of school. We expect higher completion of primary level education through condensed NFE curriculum for adolescent.

Experimental design

We conduct an RCT with seven treatment arms (excluding the control group). The RCT is designed to evaluate two interventions, the first one is on child protection (CP) and the second one is an education intervention (NFBE). We followed a two-stage randomization process. First, 30% of the prioritized universe of union councils (UCs) were assigned to control, and 70% to treatment. Then, within treatment UCs, we randomly assigned villages to one of three CP treatment arms (or the control group). CP treatment arms differed in the number of male and female participants were more mobilized. Depending on treatment assignment, in particular an equal number of girls and boys (treatment arm 1), more girls (treatment arm 2), or more boys (treatment arm 3) were mobilized. On the top, we later cross-randomized educational interventions in 212 eligible villages (a subset of CP eligible villages). 40 CP control villages were randomly assigned to receive the educational intervention, as were 60 additional villages that are part of the CP treatment group. Contrary to the original plan (in which, urban areas became ineligible for the interventions resulting in total number of 653 rural villages.

Design details

Randomization method
We apply the procedure outlined above for randomization. In order to allow us to test the null hypothesis that the treatment effect is zero (or any other value) and to calculate confidence intervals we applied randomization inference, i.e. calculated all possible random allocations that met a specified balance criterion. Of all admissible random allocations, the first one is taken for the actual treatment assignment. A re-randomization procedure incorporating multivariate as well as univariate balance checks. We calculated all possible random allocations that met a specified balance criterion.
Randomization unit
Randomization at Union Councils (UCs) and village level.
Clusters
653 villages.
Observations
Due to the COVID-19 outbreak we amended our original plan and start in 653 villages with 1 phone interview with community representative per village. Thereafter, once data collection can be resumed, 10 in-person household interviews per village, 1 community leader and 1 marriage registrar per village will be interviewed per person. Additionally, 5 (formal) HHs with drop-out children will be interviewed per village in NFBE eligible villages.
Arms
We cross-randomize two interventions: (1) interventions on child protection (CP intervention in 446 villages) and (2) intervention on non-formal basic education (NFBE in 100 villages). Moreover, the CP intervention is split into 3 different versions, as mentioned above. In total we get the following eight groups: (1) Pure control (no CP and no NFBE intervention; 167 villages) (2) “Mixed gender” CP , no NFBE intervention (156 villages) (3) “Female” CP, no NFBE intervention (121 villages) (4) “Male” CP, no NFBE intervention (109 villages) (5) NFBE intervention, no CP intervention (40 villages) (6) NFBE intervention, “mixed gender” CP intervention (20 villages) (7) NFBE intervention, female CP intervention (20 villages) (8) NFBE intervention, male CP intervention (20 villages)
Primary outcomes
adolescent empowerment (awareness on child rights, confidence, corporal punishment, self-efficacy, general well-being), child marriage rates and practices, engagement rates and practices, child pregnancy rates, as well as education attendance, attitudes towards education, and learning outcomes.
Secondary outcomes
information on program delivery (awareness, implementation, take-up); intermediate outcomes, such as on communication (intergenerational and intragenerational dialogue as well as interpersonal communication competence), service provision (access to services over time, adolescent-friendly services, marriage service provision), social norms and practices (on child marriage, child rights, equal opportunities)
Sponsors
Name: IKEA Foundation (through 3ie) Url: https://ikeafoundation.org
Partners
Name: UNICEF (implementing partner) Partner_type: none Url: https://www.unicef.org/pakistan/

Cited by

No citation data available for this registration yet.

Keywords