Understanding Measurement Error in Agriculture

How to cite

Vecci, Joe; Baranov, Victoria. 2020. "Understanding Measurement Error in Agriculture." AEA RCT Registry. AEARCTR-0005760. https://doi.org/10.1257/rct.5760-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Joe Vecci* , Victoria Baranov

* Primary investigator

Registry ID
AEARCTR-0005760
DOI
https://doi.org/10.1257/rct.5760-1.1
First registered
Last updated
Status
On going
Trial dates
2018-04-17 – 2020-11-02
Countries
India (Odisha)
JEL codes
I3, N5
Registry record
http://www.socialscienceregistry.org/trials/5760

Abstract

While measurement of agricultural production is critical to empirical development analyses and answering fundamental questions on the role of agriculture in household and individual welfare, there is a lack of understanding about the accuracy of farmer reported crop production and area measurement. In this project, we conduct a large, state-representative survey in Odisha, India containing self-reported and objective measures of agricultural variables to examine the extent of misreporting and measurement error in agricultural area, production, and yield. Using rich data on farmer characteristics, their psychological state, and personality traits, we explore whether misreporting and measurement error are systematically related to these characteristics. Finally, we conduct priming experiments to test if measurement error is affected by incentives to misreport.

Intervention

The project consists of priming experiments that aim to test the extent to which measurement error in farmer reported production/area/yield is due to intentional misreporting.
Experiment 1: Financial Incentives.
The lower bound treatment group prior to asking questions related to agricultural activity were read the following preface:“We will now ask you some questions about your land holdings and agricultural production. This information will remain anonymous and it will not influence your chances of receiving benefits from any organisation including the government or IRRI.”

The upper bound treatment group were told the following preface.“We will now ask you some questions about your land holding and agricultural production. This information may influence your chances of receiving benefits from the government and organisations including IRRI in the future.” This did not involve deception as we will randomly select 25% of these households to receive a cash grant to be distributed between 2 and 6 months after the endline.

The control were not given any preface prior to eliciting agricultural activity.

Experiment 2: Lying (misreporting for any reason)
In this experiment subjects are given a prime prior to eliciting agricultural information.

In the honest prime treatment prior to eliciting agricultural information, farmers are given a list of words that are related to honesty such as truth and integrity, subjects must then list synonyms related to each of the listed words.

In the neutral prime treatment the word list is unrelated to honesty such as home and music.

A separate control contains no prime.

Experimental design

The study was conducted in Odisha, India. The sample was selected as follows. First, we randomly selected 15 out of the 30 districts in the state. We then randomly selected 300 villages, from which we undertook a full village census. From the census we randomly selected 10 farmers in each village combining for a total sample of 3000 households prior to harvest. The sample is representative of farmers in the state.

Prior to harvest (Nov-Dec, 2019), trained enumerators conducted crop cutting of the largest plot of each farmer. Crop cutting (CC) has been recognised as the gold standard for objective agricultural production measurement since the 1950s by the Food and Agriculture Organization of the United Nations (FAO). At this time, enumerators also objectively measured plot area. In particular, a polygon of the plot is drawn using a GPS device by walking along the boundary of the plot, using geospatial software a complete polygon of the plot is then created.

After harvest (February-June), enumerators return to households and elicit farmer self reported measures of production, area and yield of the largest plot.

Design details

Randomization method
Randomisation took place via computer and was conducted by the International Rice Research Institute
Randomization unit
Individual
Clusters
We expect a sample size of 2400 participants after subjects drop out in part due to crop failure and migration
Observations
2400
Arms
Experiment 1 Lower Bound: 540 Upward Bound: 420 Experiment 2: Honesty Prime: 540 Neutral Prime: 540 Pure Control: 650
Primary outcomes
Are key outcomes are the following: 1. Measurement error in production: self-reported production based of the crop cut plot minus the plot production derived from the crop cut experiment. 2. Measurement error in area: self-reported area of the crop cut plot minus the area for the crop cut plot taken from GPS measures 3. Measurement error in yield: Calculated based on self-reported production and area, yield=production/area, minus yield calculated using the above mentioned objective measures of production and area.

Cited by

No citation data available for this registration yet.

Keywords