Unconditional cash transfers in Kiryandongo refugee settlement, Uganda

How to cite

Stein, Daniel; Lanthorn, Heather; Rukundo, Emmanuel Nshakira. 2020. "Unconditional cash transfers in Kiryandongo refugee settlement, Uganda." AEA RCT Registry. AEARCTR-0006271. https://doi.org/10.1257/rct.6271-3.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Daniel Stein* , Heather Lanthorn , Emmanuel Nshakira Rukundo

* Primary investigator

Registry ID
AEARCTR-0006271
DOI
https://doi.org/10.1257/rct.6271-3.1
First registered
Last updated
Status
Completed
Trial dates
2019-09-23 – 2022-05-31
Countries
Uganda (Kiryandongo District)
Registry record
http://www.socialscienceregistry.org/trials/6271

Abstract

GiveDirectly aims to understand the role of unconditional cash transfers as one possible route to improving the self-reliance of refugees in protected displacement contexts. The program intends to provide around USD$1000 in unconditional cash transfers to all of the ~10,000 refugee households in Kiryandongo Refugee Settlement and about 5,000 host community households in Kiryandongo district, Uganda.

GiveDirectly recently conducted a pilot in Kyaka II Settlement in Uganda. Cash transfers were provided to 4,371 refugee and host community households. An internal evaluation of the pilot concluded that the transfer had positive indicative results and was operationally feasible. The project in Kiryandongo will build on the pilot by conducting a larger and more rigorous independent study. The impact evaluation of the transfer will be conducted by IDinsight and consists of a randomized control trial (RCT) with refugee households, a cross-sectional study with host recipients, and a longitudinal qualitative study with both refugee and host community households. The mixed methods approach will examine the impact of the cash transfers by carefully identifying what changed as well as why and how the change happened. Results of the program will inform future decision-making regarding cash transfers by donors and implementing organizations.

IDinsight will answer the following research questions in this evaluation:
1) What is the impact of large, unconditional cash transfers on refugee households for outcomes such as income, assets, consumption, enterprise, food security and psychological well-being?
2) What do any changes caused by the cash transfers mean for the lives of refugee households and how did those changes come about?
3) What is the effect of cash transfers on host communities, and the relationship between host and refugee communities?

Intervention

GiveDirectly is an international nonprofit that implements unconditional cash transfer programs directed at communities living in extreme poverty. GiveDirectly implements a range of transfer designs across its projects, including one-off amounts that roughly equal the annual income of poor households. To ensure the integrity of the process, GiveDirectly employs a set of independent checks to verify that recipients meet the eligibility criteria and were not asked to pay bribes during the selection process.

GiveDirectly aims to understand the role of unconditional cash transfers as one possible route to improving the self-reliance of refugees in protected displacement contexts. The program intends to provide around USD$1000 in unconditional cash transfers to all of the ~10,000 refugee households in Kiryandongo Refugee Settlement and about 5,000 host community households in Kiryandongo district, Uganda.

UNHCR estimates indicate that there are around 1.4 million refugees in Uganda. Many of the forcibly displaced people are expected to remain in Uganda over the long-term given the prolonged character of the conflicts in their countries of origin. The expected long-term stay and progressive refugee policies in Uganda designate the country as an appropriate setting to analyze the lasting impacts of cash transfers.

Experimental design

The study has three major parts: 1) A randomized control trial will be used to measure the causal impact of the cash transfers for refugees, 2) A longitudinal qualitative study to examine how and why change does (or doesn’t) take place in refugee and host community households, and 3) An observational study will examine cash transfer recipients from the host community.

The mixed methods approach will examine the impact of the cash transfers by carefully identifying what changed as well as why and how the change happened. Results of the program will inform future decision-making regarding cash transfers by donors and implementing organizations. This pre-analysis plan primarily relates to the randomized control trial. Details regarding the analysis approach for the longitudinal qualitative study can be found in the attached, more detailed analysis plan.

The randomized control trial will use a phased-in design. Under GiveDirectly’s program, eligible households in the refugee settlement have been divided into 24 cohorts through a public lottery (see ‘Assignment method’ below). Cash transfers will be distributed by cohort, with cohort 1 receiving its cash transfers in the first, cohort 2 receiving its cash transfer second etc. Cohorts are expected to be phased-in on a monthly basis, though in practice operational factors will cause some deviations from the planned schedule. For the randomized control trial’s phased-in design, the treatment group will consist of households in cohorts 1, 2, and perhaps 3. The control group is households in cohorts 17-20.
The timing of this study overlaps with the global COVID-19 pandemic of 2019-2020. The first transfers to our treatment group took place in late February 2020. On March 30, Uganda’s president ordered a nationwide lockdown, which restricted almost all movement and commerce throughout the country. This had an immediate effect on livelihoods in Kiryandongo, as many members in the settlement make money by traveling for casual labor or through running small enterprises. Therefore, the study will provide evidence as to the efficacy of cash transfers in the context of the COVID crisis.

Design details

Randomization method
The sampling frame will be built on data provided by UNHCR which encompasses information on all (~10,000) registered refugee households living in Kiryandongo. UNHCR and GiveDirectly have identified around 1005 households as PSN (persons with specific needs), who will receive the cash transfer first but will not be a part of the study. The remaining 8886 non-PSN refugee households were placed in a public lottery for random assignment into one of 24 cohorts. The lottery was conducted during the World Food Programme’s (WFP) monthly food and cash distributions in August 2019. The lottery was run publicly to ensure transparency and buy-in of the community. This approach was recommended by community leaders. During the lottery, each household was given the opportunity to draw a cohort number. A household representative drew a single number from a bucket containing 24 ping-pong balls labeled 1 to 24. The number that each refugee picked corresponds to their assigned cohort number. After each draw, the ping-pong ball was returned into the bucket for the next participant. This lottery with replacement approach was chosen to ensure that each respondent had the same chance of picking a number between 1 and 24. 574 households that did not attend food and cash distribution were randomized in a separate public event, during which community leaders picked the cohort number on behalf of those remaining households. One of the limitations of this large public lottery randomization process came from the practical challenge of ensuring no tampering from interested groups. The early cohorts 1 and 2 together comprise 9.56% of the non-PSN settlement population, compared to the expected value of 8.33% (2/24) and are thus over-represented. The later cohorts of 23 and 24, on the other hand, together represent 7.5% of the lotterized households and are thus under-represented by 0.83% compared to the expected value of 8.33%. These differences from the expected value are statistically significant at p<0.01, indicating some tampering with the lottery process. Our control cohorts (17 to 20) together represent 16% of the non-PSN settlement population, compared to the expected value of 16.67%. The difference is not statistically significant (p=0.0886). Despite these disappointing findings from the lottery, we believe we can still achieve credible results given the limited magnitude of tampering and the ability to control for some of the differences.
Randomization unit
The treatment and control groups have been constructed by a random allocation of refugee households through the public lottery. Randomization will happen at the household level. For the purposes of this study, a household is defined as a group of individuals who have registered as a single household under the UNHCR/OPM system.
Clusters
Design not clustered
Observations
The treatment group consists of refugee households in cohorts 1 and 2 who will have received their cash transfer before the endline survey (note that we may add some households from cohort 3 to the treatment group if non-compliance or attrition cause statistical power to dip to unacceptable levels). The control group consists of a random sample of households from cohorts 17-20 who will have not yet received their cash transfer at the endline survey. There are no additional criteria beyond being a GiveDirectly cash transfer recipient, the assignment to treatment timing through GiveDirectly’s public randomization, and the ability and willingness to provide informed consent to participate in the study. Prior to the lottery process, we planned to sample approximately 1500 households (750 treatment, 750 control). This would have resulted in a minimal detectable effect size (MDES) of 0.145 SDs with 80% power. This effect size is less than the 0.18 SD effect of business revenue observed in a previous GiveDirectly evaluation (Haushofer and Shapiro 2016). IDinsight has powered the study on business outcomes, as the smallest effect size is expected for business outcomes compared to other outcomes of interest. During baseline data collection, IDinsight learned that some physical households will receive more than one cash transfer. This is because cash transfers will be made based on a list of households as registered with UNHCR. However, the group of people that live together and the “household” registered with UNHCR are not always the same. This would be problematic for the study as some of our control households live with family members who will receive a cash transfer before our endline survey, essentially meaning these control households will be treated. Such “spillover” households in the control group, as well as equivalent households from the treatment group, were therefore dropped from the study. As a result of both the issue of multiple transfers per household and challenges locating some of the sampled households, our sample size dropped to 1264 at baseline.
Arms
642 households in the treatment group, and 622 households in the control group.
Primary outcomes
The primary outcome is the economic well-being of our households. This will be measured using three primary indicators: 1) Household consumption, 2) Household assets (including savings and loans), and 3) Agricultural and non-agricultural business revenue
Secondary outcomes
We will investigate the following supplementary outcomes to understand other aspects of welfare: 1.1) Psychological well-being, 1.2) Food security, 1.3) Female empowerment, 1.4) Business ownership, 1.5) Employment status of survey respondent, 1.6) Migration, and 1.7) Household composition. We will also explore two community level outcomes as part of the study, including: 2.1) Social cohesion, and 2.2) Safety and security.

Materials

Papers from this trial

  1. Prankur Gupta, Daniel Stein, Kyla Longman, Heather Lanthorn, Rico Bergmann, Emmanuel Nshakira-Rukundo, Noel Rutto, Christine Kahura, Winfred Kananu, Gabrielle Posner, K.J. Zhao, Penny Davis, Cash transfers amid shocks: A large, one-time, unconditional cash transfer to refugees in Uganda has multidimensional benefits after 19 months, World Development, Volume 173, 2024, 106339, ISSN 0305-750X, https://doi.org/10.1016/j.worlddev.2023.106339. https://www.sciencedirect.com/science/article/abs/pii/S0305750X23001572?dgcid=coauthor
  2. Stein D, Bergemann R, Lanthorn H, et al Cash, COVID-19 and aid cuts: a mixed-method impact evaluation among South Sudanese refugees registered in Kiryandongo settlement, Uganda BMJ Global Health 2022;7:e007747. https://doi.org/10.1136/bmjgh-2021-007747

Cited by

No citation data available for this registration yet.

Keywords