Incentives: Evidence from Uganda

How to cite

Katreniak, Dagmara Celik. 2019. "Incentives: Evidence from Uganda." AEA RCT Registry. AEARCTR-0002781. https://doi.org/10.1257/rct.2781-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Dagmara Celik Katreniak*

* Primary investigator

Registry ID
AEARCTR-0002781
DOI
https://doi.org/10.1257/rct.2781-1.0
First registered
Last updated
Status
Completed
Trial dates
2011-09-01 – 2013-08-15
Countries
Uganda (Mukono and Buikwe District)
JEL codes
C93, D91, D04, I21, O55
Registry record
http://www.socialscienceregistry.org/trials/2781

Abstract

Throughout our lives, we are routinely offered different incentives as a way to motivate us. Many researchers have studied the effects of incentives on people’s performance. There can also be important psychological outcomes in terms of stress and happiness. The current project contributes to the literature by explicitly accounting for this performance-versus-well-being trade-off introduced by incentives. In total four different incentives and their interactions were provided to students. Such cross-cutting design allows me to study the complementarities of the incentives. Additional outcome of tee project is to study the role of feedback in shaping subjects' expectations. Finally, having friendship network structure of each student within his/her class allows me to study how various competitive environments influence group formations in classes at different school levels.

Intervention

I implement two types of social comparative feedback regimes, within and across-class group comparisons, and two types of incentive regimes, financial and reputation rewards. I also allow for their interaction. In total, eight different treatment groups are formed. More than 5000 primary and secondary school students in Uganda, who were repeatedly tested and interviewed over one academic year. In total, five testing rounds were administered between January and December 2012.

Experimental design

Students were randomly assigned to two feedback treatment groups and a control group. Students in the within-class feedback group (within) were randomly divided into units of three to four classmates and evaluated as units (using the unit averages) within their respective classes. Students in the within group received feedback about their own performance, the performance of their unit members, and the relative position of their unit within their class. Moreover, they received detailed information about whether they and the position of their unit have improved or worsened from one testing round to the next.
Students in the across-class feedback group (across) were evaluated as a class (using the class average) and were compared to other classes of the same grade in the district. Students in the across group received feedback about their own performance, the average performance of their class, the relative position of their class with respect to other classes, and whether they and/or their class have improved or worsened between two subsequent testing rounds
Students in the control group received no information but only took exams. In order to motivate all students to participate in the experiment, we began our visits reminding students that the exams serve as an additional practice for national leaving examinations (which are compulsory for seventh graders in primary schools and fourth and sixth graders in secondary schools).
In order to study the effects of monetary and non-monetary rewards, students were orthogonally re-randomized at the school level into a tournament for financial or reputational rewards. Re-randomization took place after round 4 and students had no information about tournaments beforehand. The qualification criteria differed based on initial randomization into treatments but the general rule was to reward the 15% best performing students/units/classes, and the 15% most improved students/units/classes. In order to avoid confusion, students were given exact information regarding the number of winning students/units/classes. Therefore, all students, despite the class size or treatment allocation, had the same probability of winning. Students in the monetary reward treatment groups could win 2,000 UGX (about .80 USD). Students in the reputational reward group could receive a certificate and their names were announced in the most popular local newspaper in the region, Bukedde.
Overall, the orthogonal randomization divided the sample into 9 groups – one control group, four sole treatment groups (i.e., one type of treatment only) and four combined treatment groups (two types of feedback interacted with two types of rewards). Such cross-cutting design allows me to compare the impact of feedback and reward incentives on students’ performance expectations and their well-being, and to study the complementarities of feedback and rewards.

Design details

Randomization method
In order to increase the balance between control and treatment groups, the sample was stratified along three dimensions: school area (the sample divided into four areas differing by level of remoteness), average school performance in national testing (above average or below average), and student level (grade 6 and 7 of primary education, and grades 1 to 4 of secondary education). The randomization was done in two stages. First, after the stratification of the sample by school performance and area, I randomized the whole sample of 53 schools into treatment and control groups in a 2:1 ratio (which resulted into 36 (17) schools being selected into treatment (control) group). In the second stage, I divided classes of the treatment schools randomly into within-class feedback and across-class feedback groups in a 1:1 ratio (class-level randomization). In this scenario, no student in a control-group school received any treatments, and students in the treatment group schools received either within- or across-class feedback depending on the type of the intervention their class was randomized into. Exposure to the treatment is the only difference in the outcomes between the control and treatment groups.
Randomization unit
I did two-stage randomization, first at the school level (to randomize the schools into feedback-treatment and control groups) and then at the class level I randomized classes into within group versus across group feedback treatment groups.
Clusters
In total I had 53 schools in my sample - 31 primary and 22 secondary schools. In primary schools I included students in the 6th and 7th grades, while in the secondary schools I included students in the "O-level", which means from grade 1 to grade 4. In total, 150 classes participated.
Observations
I had 7,209 students who participated in the first testing round. The number changes in each round due to new admissions and high absence and drop-out rates.
Arms
There are 17 schools in the control group, 36 in the treatment group (combining within-class and across-class feedback treatment groups). In terms of classes, there are 48 classes in the control group, 50 in the within-class feedback group and 52 in the across-class feedback group. In terms of students, based on the number of students present in the baseline testing, I had 2,343 students in the control group, 2,395 among the within-class feedback, and 2,412 among the across-class feedback group.
Primary outcomes
Performance in Mathematics and English, students' expectations about their performance in Mathematics and English collected before and after every testing (which happened 5 times in total), students' subjective levels of effort exerted before and after every testing, students' subjective happiness before and after every testing, and students overall happiness and stressed measured by standard psychological questionnaires. Finally I have data about friends of each student within his/her class before and after the experiment.

Papers from this trial

  1. Katreniak Celik, Dagmara. 2019. “Persistent overconfidence: evidence from a field experiment in Uganda.” Working paper. https://docs.google.com/viewer?a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxkYXNhY2VsaWt8Z3g6MzI3MmUxMDhlMGEzZWM2Yg
  2. Katreniak Celik, Dagmara. 2019. “Dark side of incentives: evidence from a field experiment in Uganda.” CERGE-EI https://sites.google.com/site/dasacelik/DarkSideOfIncentives_Celik_JMP.pdf?attredirects=0

Cited by

No citation data available for this registration yet.

Keywords