A randomized control trial study of the Mali branch of the multi-country programme: “Responding to COVID-19 through Social Protection Systems in the Sahel”
How to cite
Tirivayi, Nyasha; Groppo, Valeria; Groot, Richard de; Otchere, Frank; Elouard, Yajna; Sessou, Eric; Bersudskaya, Vera; Sidiki, Guindo; Guindo, Abdoulaye. 2023. "A randomized control trial study of the Mali branch of the multi-country programme: “Responding to COVID-19 through Social Protection Systems in the Sahel”." AEA RCT Registry. AEARCTR-0012377. https://doi.org/10.1257/rct.12377-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
The study is a phase-in cluster randomized control trial mixed-methods impact evaluation of the Mali cash plus programme targeted to members of women’s savings groups (WSG) in three regions of the country: Koulikoro, Ségou, and Sikasso. The overall objective is to mitigate the socioeconomic impact of COVID-19. Members of the savings groups will receive five unconditional cash transfers over the course of six months, complemented with sensitization measures on key family practices and capacity development on business skills, women’s rights, leadership, and decision-making. Key outcomes areas include household consumption and food security; child related outcomes (nutrition, health care, early childhood development, child protection); gender related outcomes (women’s empowerment, women’s participation in agriculture and business activities, intra-household time use, gender norms and intimate partner violence,); and indicators at WSG level (membership, participation rates, amounts received, savings and credit amounts). Key contextual factors hypothesized to moderate programme impact include gender norms, religion, marital status/household structure (monogamy vs polygamy). Quantitative baseline and endline data collections include household, women’s, community and WSG questionnaires, while qualitative components include focus groups discussions with beneficiaries, and in-depth interviews with beneficiaries, women’s groups and community leaders, programme staff, and other key social protection stakeholders. Analysis of Covariance (ANCOVA) will be used to estimate impacts using baseline and endline surveys. The study will be carried out over about two years starting in April 2022, led by the UNICEF Innocenti – Global Office of Research and Foresight (UNICEF Innocenti), in collaboration with UNICEF Mali, Groupement d'Intérêt Scientifique des Statisticiens Économistes (GISSE) and l'Institut National de la Statistique (INSTAT).
Intervention
In response to the COVID-19 pandemic and subsequent economic downturn, the Government of Mali, with support from BMZ/KfW, is implementing a cash transfer programme targeted to members of WSG in the southern regions of Koulikoro, Segou and Sikasso.
Treatment 1: An unconditional cash transfer plus complementary services
This intervention combines unconditional cash transfers with complementary services. WSG members receive five cash transfers over the course of six months (between March 2023 and August 2023), each with a value of 45,000 XOF (~68 USD). In this intervention arm, cash transfers are accompanied by complementary activities including:
• Child-sensitive training on key family practices, which cover areas of breastfeeding, nutrition, health (including on COVID-19), girl schooling.
• Gender-sensitive economic empowerment activities, covering (1) sensitization to invest part of the transfer in productive activities, (2) platform for selling and marketing group products, (3) training on basic business accounting, (4) set up women’s savings & credit groups, where appropriate (to ease access to credit), (5) group guarantees when applying for microfinance credit.
• Gender-transformative leadership and decision-making training on women’s rights, responsibilities and advocacy, covering (1) women’s rights and leadership, (2) women’s standing within household and community via financial contributions from transfers, (3) environmentally friendly practices for waste reduction / disposal, (4) sustainable agriculture & livestock practices.
Complementary services will be implemented partly by (i) Direction Nationale du Développement Social through the “Mama Yeleen” strategy which is based on interpersonal communication and women leadership; (ii) implementing NGO partners and (iii) Jigisemeyiri, the national social safety net programme.
Treatment 2: Services only
This treatment arm will only receive the complementary services but not the unconditional cash transfer. They will start receiving the cash transfers after the endline survey (November 2023).
Experimental design
The quantitative study is a cluster randomized control trial (cRCT), which exploits a gradual horizontal expansion of the cash plus programme to an additional 245 WSGs (starting from the 310 already being served). The 245 WSG will be randomly assigned into two treatment arms (cash plus complementary services and complementary services only, 82 WSGs each) and one control arm (81 WSG). The complementary services only arm would start receiving cash after 9 months (November 2023, after the end of the follow-up data collection), when also the control group will start receiving the full cash plus programme. More specifically, the study arms are as follows:
• T1: Cash transfers + complementary services to WSG members, starting March 2023. A total of five cash transfers payments of 45,000 XOF are planned in 2023 (March, April, June, July, August).
• T2: Complementary services only to WSG members, starting May 2023 (this study arm will then start receiving cash transfers in November 2023)
• Control: No intervention to WSG members until November 2023 (cash transfers + complementary services will start in November 2023)
Randomization of WSG into the three study arms will be carried out at village level, with all WSGs in the same village being assigned the same treatment. Prior to randomization, villages will be stratified according to their size in terms of the number of WSGs, considering that some villages have high concentration of WSGs. WSGs have, on average, 25 members.
Quantitative data collection instruments
At baseline, the impact evaluation included five types of instruments:
• Quantitative household survey: administered to the head of household or another adult sufficiently informed about household matters. Key outcomes measured include modules on household socio-demographic characteristics, subjective well-being, schooling, health status, time use, housing, household assets, expenditures, economic activities, land / livestock, revenues, savings and credit, consumption, COVID-19 awareness, practices and perceived impacts, social assistance, shocks and coping strategies. In order to track households between waves, in addition to the exact location, the contact details of the interviewed households as well as of their neighbours were collected. This will help to track households and main respondents at follow-up.
• Quantitative women’s questionnaire: to be administered to women WSG members to whom the cash transfers are targeted – the same woman will then be tracked to be interviewed in follow-up surveys. Key outcomes to be measured include subjective well-being, nutritional knowledge, child health, child nutrition, child development, anthropometrics, income generating activities, land, crop use and sales, agricultural production, revenues, savings group practice and perceptions, social support, mental health, bargaining power in household decision making, gender preferences and attitudes, gender norms and exposure to intimate partner violence.
• Quantitative WSG questionnaire: to be administered to WSG president to determine group composition, participation rates, savings amounts mobilized, access to formal financial services, including credit, credit volumes disbursed by the group, consequences of COVID-19 on group operations and current challenges.
• Quantitative community questionnaire: to be administered to community leaders or other well-informed members of the community in every village to explore socio-demographics of the village, access to markets and social services, prices, gender social norms, shocks (including COVID-19), agriculture, sustainable environmental practices and existing humanitarian/ development programs.
At follow-up, three modules will be added to the quantitative women questionnaires: child discipline, vaccinations, and programme’s operational performance. Moreover, the following questionnaire will be added:
• Quantitative questionnaire for Mama Yeleen: The questionnaire will gather information on the specific training received by Mama Yeleen, and the training activities delivered by them.
Data analysis
The data collected will be analysed both at baseline and endline. Baseline data will be used to examine balance between the three groups (two treatment and one control group) with respect to the outcome variables of interest and among relevant household and individual characteristics using simple Wald tests of equality. This is an essential requirement to verifying that the randomization worked and a valid counterfactual is established. Knowledge of the similarities and differences between the groups will inform selection of control variables for the impact estimation model.
We intend to use Analysis of Covariance (ANCOVA) to estimate impacts using baseline (June/July 2022) and endline (November/December 2023, about 16 months after baseline) surveys. We will test for robustness of results using difference-in-difference methods. For outcomes only collected at endline, cross-sectional impacts will be calculated, including baseline covariates. Standard errors will be clustered at the level of randomization, i.e. the village level.
Heterogeneity analysis
Key contextual factors hypothesized to moderate programme impact include gender norms, marital status/household structure (monogamy vs polygamy). These indicators will be interacted with the treatment indicator to examine heterogeneous effects along these measures.
Multiple hypothesis testing
For the primary outcomes, the analysis will apply a correction for multiple hypothesis testing (MHT) to account for the large number of hypothesis tests. When estimation many different impacts, there is a risk of falsely rejecting a null hypothesis (i.e. finding a significant impact) just by chance. The analysis will apply the procedure to control for this False Discovery Rate (FDR) proposed by Anderson (2008) based on Benjamini, Krieger and Yekutieli (2006) and will calculate sharpened q-values for selected indicators. We will also construct domain indexes by aggregating several indicators of the same domain into one index to reduce the number of tests that we run and to get a sense of whether the programme had a general effect on certain domains. These domains will be determined at the household, woman and child level and their indicators will include:
• Household wellbeing index: household consumption per AE, household FSC and household CSI
• Women’s wellbeing index: women’s empowerment score, mental health and IPV
• Child wellbeing index (among children under 5 at baseline): health status in the last 2 weeks, nutritional status and early childhood development
Design details
Cited by
No citation data available for this registration yet.