A Randomized Impact Evaluation of the Graduation Program Strengthen Productive Safety Net Program Phase 4 (PSNP4) Institutions and Resilience (SPIR) in Ethiopia

How to cite

Gilligan, Daniel; Alderman, Harold; Hidrobo, Melissa; Leight, Jessica; Mulford, Michael; Taffesse, Alemayehu Seyoum. 2021. "A Randomized Impact Evaluation of the Graduation Program Strengthen Productive Safety Net Program Phase 4 (PSNP4) Institutions and Resilience (SPIR) in Ethiopia." AEA RCT Registry. AEARCTR-0008281. https://doi.org/10.1257/rct.8281-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Daniel Gilligan* , Harold Alderman , Melissa Hidrobo , Jessica Leight , Michael Mulford , Alemayehu Seyoum Taffesse

* Primary investigator

Registry ID
AEARCTR-0008281
DOI
https://doi.org/10.1257/rct.8281-2.1
First registered
Last updated
Status
Completed
Trial dates
2018-02-08 – 2021-09-30
Countries
Ethiopia ()
JEL codes
I32, O12
Registry record
http://www.socialscienceregistry.org/trials/8281

Abstract

The SPIR project supports delivery of the Fourth Phase of the Productive Safety Net Program (PSNP4) in Ethiopia’s Amhara and Oromia Regions while also delivering multisectoral programming to enhance livelihoods, increase resilience to shocks, improve food security and nutrition and strengthen gender equality for PSNP4 beneficiaries. The impact evaluation uses a clustered randomized controlled trial (RCT) design with four intervention arms (three treatments and a control group) to compare alternative graduation model program strategies to improve livelihoods, food security and nutrition of PSNP4 beneficiaries.

Intervention

The impact evaluation evaluates combinations of four SPIR interventions described below; L and N correspond to the primary SPIR interventions around livelihoods and nutrition, respectively, while L* and N* represent enhanced versions of these interventions.

Intervention L: SPIR livelihood activities: starting Village Economic and Social Associations (VESAs), financial literacy training, agriculture and livestock value chain development, home gardening and forage production
Intervention L*: SPIR livelihoods activities plus: (i) Social Analysis and Action (SAA) to improve women’s access to markets, (ii) aspirations promotion activities in randomly selected kebeles (subdistricts), and (iii) targeted poultry or cash livelihood transfers
Intervention N: SPIR nutrition activities: Nutrition Behavior Change Communication (BCC); WASH activities
Intervention N*: SPIR nutrition activities plus: (i) Timed and Targeted Counseling (TTC) (more intensive nutrition BCC), (ii) Community-based Participatory Nutrition Promotion (CPNP), (iii) male engagement in BCC, and (iv) Interpersonal Therapy in Groups (IPT-G) interventions for women and men screened for depression (provided after the midline survey)

Experimental design

All households in the study are PSNP4 beneficiaries. The quantitative impact evaluation design compares the impact of combinations of these L, L*, N and N* activity packages by randomly assigning kebeles to one of the following intervention arms:
• Treatment 1: L* + N*
• Treatment 2: L* + N
• Treatment 3: L + N*
• Control: PSNP only
T1, T2 and T3 are each multifaceted graduation programs delivering different combinations of livelihoods and nutrition interventions. For L* activities, SAA was implemented in all L* kebeles, while the aspiration intervention was implemented in a randomly-selected half of the L* kebeles. Poultry or cash was randomly assigned to L* kebeles and provided to the poorest 10 out of 18 of sample households in those kebeles.

Design details

Randomization method
Of the 196 study kebeles that were randomized, 49 were assigned to each of the four treatment arms: T1: L*+N*; T2: L*+N; T3: L+N*; and C: PSNP only. Randomization was stratified at the woreda level to provide balance of treatment assignment geographically and because the woreda is the main administrative structure for local government which shapes local public expenditure and public service delivery. Randomization was conducted by computer at IFPRI offices in Washington DC.
Randomization unit
Randomization was done at the kebele (subdistrict) level.
Clusters
After the initial randomization of 196 kebeles across the four treatment arms, two kebeles were dropped because they had no PSNP beneficiaries and one was dropped for security reasons. The randomization across the 193 remaining kebeles is shown in Table 3.3.2. Table 3.3.2: Number of kebeles in each treatment arm, by region Amhara Oromia Total T1: L*+N* 27 19 46 T2: L*+N 28 21 49 T3: L+N* 29 20 49 C: L+N 29 20 49 Total 113 80 193
Observations
In each of 193 kebele, we randomly sampled 18 households, leading to a planned baseline sample of 3,474 households.
Arms
The randomization across the 193 kebeles is shown in Table 3.3.2. Table 3.3.2: Number of kebeles in each treatment arm, by region Amhara Oromia Total T1: L*+N* 27 19 46 T2: L*+N 28 21 49 T3: L+N* 29 20 49 C: L+N 29 20 49 Total 113 80 193
Primary outcomes
Child stunting (height-for-age Z-scores (HAZ)<-2) for children under 24 months; Minimally acceptable diet for children under 24 months; food security as measured by the household food gap in months; depression severity score (PHQ-9); gender norms and female empowerment (attitudes toward female mobility; attitudes toward IPV; input into productive decisions, mobility, group membership, respect, self-efficacy; prevalence of intimate partner violence; gender norms); Assets (Total Index, Productive, Livestock); Access to savings (primary male/female membership in Rusacco/VSLA/MFI/Bank Account); Access to credit total value of productive/consumption loan primary male/female took out); Income from livestock and poultry; Aspirations (Current level of education of the oldest child, level of education primary male/female would like the oldest child to receive, level of education primary male/female would like the oldest child to receive in 10 years)
Secondary outcomes
Other anthropometry measures (HAZ, WHZ, WAZ, wasting, SAM, MAM) for children under 24 months; Infant and young child feeding practices; Infant and young child feeding knowledge; Household dietary diversity score; Minimum dietary diversity-Women; Food Security Index; Food Insecurity Experience Scale; Value of household food consumption per adult equivalent; Child health history - ANC during last pregnancy, IFA during last pregnancy, receiving nutrition information or counseling during last pregnancy, receiving breastfeeding information during last pregnancy, birth in a medical facility (last born); Childcare activities (adult male and female); change in depression scale; Net income from farming; Assets (Consumer, Land Index separate); All other access to savings - primary male/female membership to Rusacco/VSLA/MFI/Bank Account, primary male/female deposited money in a Rusacco/VSLA/MFI/Bank Account with a specific frequency in the past 12 months, primary male/female membership with Eqqub, primary male/female membership with Iddir; All other access to credit - primary male/female took out productive/consumption loan in past 12 months, took out loan from primary source (i.e. Rusacco), took out loan from other secondary sources, primary reason for taking out loan (i.e. to buy livestock), other reasons for taking out loans, total value of productive/consumption loan primary male/female took out, total value of loan the primary male/female still owes, primary reason for difficulty in loan repayment, other reasons for difficulty in loan repayment

Materials

Papers from this trial

  1. Ranganathan, Meghna; Pichon, Marjorie; Hidrobo, Melissa; Tambet, Heleene; Sintayehu, Wastina; Tadesse, Seifu; and Buller, Ana Maria. 2022. Government of Ethiopia's public works and complementary programmes: A mixed-methods study on pathways to reduce intimate partner violence. Social Science and Medicine 294(February 2022): 114708. https://doi.org/10.1016/j.socscimed.2022.114708 https://doi.org/10.1016/j.socscimed.2022.114708
  2. Alderman, Harold; Gilligan, Daniel O.; Leight, Jessica; Mulford, Michael; and Tambet, Heleene. 2022. The role of poultry transfers in diet diversity: A cluster randomized intent to treat analysis. Food Policy 107(February 2022): 102212. https://doi.org/10.1016/j.foodpol.2021.102212 https://doi.org/10.1016/j.foodpol.2021.102212

Cited by

No citation data available for this registration yet.

Keywords