The Role of Mechanistic Explanations in Technology Experimentation and Adoption: Evidence from a Lab-in-the-Field Experiment in Uganda
How to cite
Dulin, Robert; Sankar, Anirudh; Nourani, Vesall; Rudder, Jess; Davies, Ben; Salomon, Abraham; Taulya, Godfrey. 2024. "The Role of Mechanistic Explanations in Technology Experimentation and Adoption: Evidence from a Lab-in-the-Field Experiment in Uganda." AEA RCT Registry. AEARCTR-0014649. https://doi.org/10.1257/rct.14649-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In many environments, agents need to learn a payoff function of their choices. The fact that these functions are often qualitatively complicated, for example encoding many interaction effects among several choice dimensions, has led many economists to model agents' learning of these functions as black boxes. Since it is costly to explore choices, risk averse agents learning payoffs through a black box can easily get stuck in some local maxima, usually only alleviated by observing an exogenous signal of a better alternative. But black-box learning is not the only learning mode available to real world agents, who can appeal to scientific advancements. Science has tapered the complexity of complicated functions to make them more useful for both ex-ante prediction and ex-post extrapolation, trading off exactness with a global model of the “first order” structure. We consider two levels of scientific advancements: (1) a conceptual dimension reduction, rewriting complicated functions in a smaller space of conceptual features, and (2) mechanistic knowledge of an approximating function to the true payoff function, described on the domain of conceptual features. We examine whether equipping agents we hypothesize to be predominantly black-box learners of a relevant payoff function, with information about these two levels of scientific discovery, progressively improves their learning efficiency.
Specifically, we consider the problem of synthetic fertilizer choice among smallholder tomato farmers in Eastern Uganda. Qualitative evidence tells us that they have a black-box understanding of this important technology and are not deploying them optimally, which is also supported by other empirical work in Africa. We provide agricultural extension demonstrations to 900 tomato farmers where we demonstrate the causal impact of an interesting fertilizer recipe, and randomize the provision of two additional explanations relevant to why (biophysically) this recipe achieved its result: (1) a conceptual dimension reduction of fertilizers to the three macronutrients that drive their effects; (2) mechanistic knowledge about how these nutrients move through observable features of the soil and participate in plant growth. We measure impacts of these components on incentivized beliefs about fertilizer use, WTP for novel fertilizers, and choices in a bandit problem. We consider payoffs (yields and profits) on both a grey soil archetype on which we demonstrated the recipe, as well as a counterfactual “black soil’, to speak to signal translation across contexts with heterogeneous returns. We also measure a variety of other welfare-relevant aspects documented in the psychology literature to improve with mechanistic understanding.
Intervention
We study the impacts of mechanistic explanations on beliefs about fertilizers and adoption choices among smallholder tomato farmers in Eastern Uganda. Mechanistic explanations are explanations which break down a system or process into the causal interactions among its parts. In the context of this study, these explanations include descriptions of fertilizer nutrients, their roles in plant growth, and the processes through which they move through the soil and the plant. We recruit 900 smallholder farmers in Bugisu sub-region, Uganda. Fieldwork conducted by the authors found that farmers in this region have little understanding of how fertilizers work, rarely experiment with novel combinations on their own, and rely on outside recommendations that may or may not fit their own context or be based in agronomic evidence. We design a set of treatments to test whether mechanistic explanations can address these challenges. One-half of the farmers will receive a placebo training that introduces an agronomist-recommended fertilizer recipe and demonstrates it yield, but provides no further explanations. The other half will in addition receive mechanistic explanations about fertilizers and the mechanistic rationale behind the demonstrated recipe.
In the first group, the control group, farmers attend a demonstration of a specific agronomist-recommended fertilizer recipe for grey soil. The training will inform the farmers of the types, timings, and amounts of fertilizer used, and the yields that were generated. Farmers will be able to see for themselves the condition of the fruiting plants, and ask the facilitator questions about the fertilizer recipe. The training will also cover methods of fertilizer application, such as how fertilizer should be inserted into planting holes or dispersed around the plant stem as a top dressing. Importantly, this control training will not inform farmers about the macronutrients that are contained in fertilizers, nor the functions of these nutrients and the processes through which they affect plant growth. The control training corresponds in content to what is typically seen in a standard extension or commercial demo.
The treatment group, will receive the control training as well as two additional modules. One module describes which macronutrients are contained in synthetic fertilizers, and the macronutrient composition of common fertilizers on the market. The second describes how nutrients affect plant growth, and the processes by which they move and interact in the soil and the plant. This module will describe different soil archetypes, including how soil texture and components affect the ability to retain nutrients, the nutrients that are naturally available in different soils, and mechanisms through which nutrients are retained or lost (e.g., nitrogen leaching, potassium binding). The module also also describes the roles of each of the primary macronutrients in plant growth. These roles are then given mechanistic explanations: for example, phosphorus is needed early in the planting season because the plant can recycle this nutrient many times throughout the season. This training, if leveraged by the farmer, can generate beliefs about the production function through deductive reasoning. It can do this ex-ante. For example, a farmer who learns about clay’s tendency to contain and retain potassium can deduce ex ante (without experimentation) that a soil with high clay content needs little potassium supplementation. A farmer who understands mechanisms can also generalize more effectively from observed experiments (ex-post learning). If the above farmer observes a high return to a certain amount of potassium supplementation on a high-clay soil, he can extrapolate that the marginal return will be even higher on a gray soil that is low in clays.
Experimental design
This study explores the impact of mechanistic explanations on the adoption of and experimentation with synthetic fertilizers among smallholder farmers in Eastern Uganda. A total of 900 tomato farmers will be randomly assigned to one of two groups: control and treatment. The randomization will be stratified by locality to account for geographic differences in soil types and agricultural practices. Treatment is assigned at the individual farmer level. The randomization is not clustered.
After the training sessions, farmers participate in two activities designed to measure the impact of the interventions. First, they engage in lab-in-the-field activities that test their knowledge and beliefs about fertilizers. Second, they take part in a digital multi-armed bandit game simulating multiple growing seasons, allowing them to experiment with different fertilizer applications and observe the resulting yields.
To analyze the results, we will use standard regression techniques, regressing the outcome on treatment indicators and (in some specifications) baseline covariates.
Design details
Cited by
No citation data available for this registration yet.