Impact evaluation of an agroforestry tree-seedling distribution program in Rwanda

How to cite

Bayer, Judith; Kangabe, Belise; Langbeen, Laura; Linssen, Rik. 2024. "Impact evaluation of an agroforestry tree-seedling distribution program in Rwanda." AEA RCT Registry. AEARCTR-0011152. https://doi.org/10.1257/rct.11152-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Judith Bayer* , Belise Kangabe , Laura Langbeen , Rik Linssen

* Primary investigator

Registry ID
AEARCTR-0011152
DOI
https://doi.org/10.1257/rct.11152-1.0
First registered
Last updated
Status
In development
Trial dates
2023-10-01 – 2025-03-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/11152

Abstract

We will conduct three data collection activities with aims to benchmark assessment and monitoring results in terms of planting and survival of agroforestry trees, and developing an improved tree-value model for farmers that benefit from an agroforestry intervention. The intervention consists of farmers collecting tree seedlings from centralized tree nurseries at the cell level. First, we will conduct a cluster (cell level) randomized controlled trial (RCT) in 4 provinces, 6 randomly selected districts of Rwanda and 60 randomly selected cells (4,130 households). Due to already high coverage of the program across the country, control cells will be created by pausing the agroforestry tree-seedling delivery in selected control areas for 1 year and replacing it with fruit tree (avocado) seedlings as compensation. We will randomly select 30 treatment and 30 control cells and conduct data collection at two points in time: a planting survey after seedlings are distributed to farmers, and a survival survey shortly before the start of the next planting season. Through this random assignment of treatment and control areas, this study aims to a) obtain estimates of incremental agroforestry trees planted (trees planted by treated group – trees planted by control group), incremental agroforestry trees survived (trees survived in treated group – trees survived in control group) b) estimate potential substitution effects of 1AF trees by all other 1AF and non-1AF species. The second data collection activity will be a tree usage and value survey for farmers with mature trees of our species of interest focused on a selection of the sampled individuals in the baseline survey of the RCT. The third data collection activity will be a tree price survey for tree product vendors and traders. Both surveys will provide necessary information for the tree-value model that allows to quantify the benefits of the program in monetary terms and based on tree use of farmers.

Intervention

The intervention consists of providing farmers with agroforestry tree seedlings of mainly grevillea species (though in combination with other species depending on the agroecological zone) in an “opt in” setting. In 2023, around 90% of the program will be designed as a decentralized nursery model, in which one single nursery will be set up in a central location in a cell (admin 4 level in Rwanda). A nursery manager from the community will nurture the seeds until the seedling stage and will be paid a unit sum for each healthy tree seedling produced. Around three months after planting, farmers of each cell will come to the nursery to pick up the seedlings for free.
Since the tree distribution program already has nearly country-wide coverage, there are no suitable control areas outside of the program areas. Only regions that are particularly hard to reach or otherwise differ significantly from the existing program areas have not yet been reached by the program. Thus, we have decided to use cells from within the existing program areas as controls. To create a valid counterfactual the program will be modified in control cells by providing farmers with fruit (avocado) rather than agroforestry tree seedlings. With this design the impact estimates will capture the incremental effect of delivering the tree program on agroforestry outcomes for one additional year.

Experimental design

This study is a cluster randomized controlled trial, which is considered the gold standard to measure programme effectiveness. 1AF's nurseries are operating across Rwanda, so we have randomized clusters (nurseries that operate at the cell level) divided into control cells and treatment cells. We have randomized 30 cells into the control group and another 30 cells in the treatment group in 3 provinces: South (Amajyepfo), East (Iburasirazuba), and West (Iburengerazuba). We have implemented a stratified randomization by first stratifying cells into 4 artificial agro-ecological zones based on 1AF's programme implementation and the prevalence of tree species. These are regions where Grevillea trees (in the Northwest and Southwest as separate strata), lightwood ornamental trees, or lightwood medicinal trees are most prevalent. Rutsiro, Gicumbi, and Nyarugenge districts and cells adjacent to international borders and cells at the border with Rutsiro and Nyarugenge districts were excluded.
All program elements will remain the same in both treatment and control cells with one exception in the control group: instead of agroforestry tree seedlings, people will receive avocado trees in the control cells in case they decide to participate and collect tree seedlings on the tree distribution days.
We have implemented a stratified randomization. First, cells were stratified into 4 artificial agro-ecological zones. This was based on 1AF’s programme implementation and on the prevalence of tree species. These are regions where Grevillea trees (in the Northwest and Southwest as separate strata) lightwood ornamental trees, or lightwood medicinal trees are most prevalent. Subsequently, we have excluded Rutsiro, Gicumbi and Nyarugenge districts, excluded cells adjacent to international borders and cells at the border with Rutsiro and Nyarugenge districts. This is because in some of these districts 1AF programme implementation slightly differs -there are no nurseries present - and to avoid possible spillover effects to and from other nearby nurseries. In each stratum we have randomized cells into a treatment (distribution and pick-up of tree seedlings) and a control group (distribution and pick-up of avocado trees).
One Acre’s fund programme is currently active all across Rwanda. It is unrealistic to stop or alter implementation (distributing avocado trees) in all potential 1897 cells. Therefore, we have randomized 30 cells into control, where 1AF will distribute avocado trees. Note that all other programme elements remain the same, that is: nurseries and farmers in control cells will be notified that they are to receive avocado trees (instead of tree seedlings). And the nurseries will only receive avocado trees very shortly before the distribution day.
We immediately combine randomization and sampling strategy at the cell level. This means that 1AF will thus only alter implementation (distributing avocado trees) at nurseries in cells randomized into the control group who are also selected into the sample for surveying. The remaining treatment cells will have tree seedling distribution as normal. This results in 30 treatment cells, and 30 control cells. In each cell, we will sample 2 village to conduct household level surveys among both people who pick-up seedlings or avocado trees (compliers) and those who do not pick-up seedlings or avocado trees (non-compliers).
See Annex (Figure 3) for schematic representation of randomization strategy.

Design details

Randomization method
Stratified randomization by computer
Randomization unit
Cell (admin 4)
Clusters
59 clusters (cells) in total. 29 on treatment and 30 on control arms.
Observations
4,130 households in treatment and control cells. 2,100 in control and 2,030 in treatment clusters. 60 villages (2 villages in each cell) 35 households per village (17 compliers and 18 non compliers)
Arms
Planned Number of Clusters 59 clusters (cells) in total. 29 on treatment and 30 on control arms.
Primary outcomes
1) Agroforestry Tree count survey • Total trees planted (both 1AF and non-1AF species) • Total trees survived (both 1AF and non-1AF species) • Trees planted by species (1AF species) • Trees survived by species (1AF species)
Secondary outcomes
2) Agroforestry Tree usage and value survey (8 species) • 1AF programme take-up • Tree use cases • Timing and frequency of tree uses • Prices of tree products • Volume and prices of tree products sold • Direct financial and opportunity costs of maintaining mature trees • Timing and frequency of costs for maintaining mature trees 3) Agroforestry Tree price survey (4 species) • Prices of tree products • Volume of sales for tree products • Average cut age of tree (by species) • Average value of tree cut sales • Characteristics impacting the value of trees (by species) • Tree value (Net present value)

Cited by

No citation data available for this registration yet.

Keywords