Do teacher assessments and track recommendations discriminate against Roma minority students? – A randomized experiment among Hungarian primary school teachers

How to cite

Kisfalusi, Dorottya; Hermann, Zoltán; Centre for Labour Economics, Corvinus University of Budapest, Budapest, Hungary; Keller, Tamás; Centre for Social Sciences, Budapest Hungary. 2021. "Do teacher assessments and track recommendations discriminate against Roma minority students? – A randomized experiment among Hungarian primary school teachers." AEA RCT Registry. AEARCTR-0007838. https://doi.org/10.1257/rct.7838-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Dorottya Kisfalusi* , Zoltán Hermann , Centre for Labour Economics, Corvinus University of Budapest, Budapest, Hungary , Tamás Keller , Centre for Social Sciences, Budapest Hungary

* Primary investigator

Registry ID
AEARCTR-0007838
DOI
https://doi.org/10.1257/rct.7838-2.0
First registered
Last updated
Status
On going
Trial dates
2021-06-18 – 2021-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/7838

Abstract

Conducting a randomized experiment, we examine whether discrimination exists among teachers against Roma minority students in Hungary. Our target population consists of teachers who teach Hungarian grammar and literature or mathematics in the 5th-8th grades of Hungarian primary schools. The experiment will be carried out online. We will contact every Hungarian primary school with an invitation letter sent to the schools’ central e-mail address that is publicly available. The first 200 mathematics and 200 Hungarian and grammar school teachers who are willing to participate can take part in the experiment. Teachers will be asked to evaluate six mathematics/Hungarian tests and recommend a secondary school track to the fictive student. Students’ names on the tests will be randomized (Roma male, Roma female, non-Roma male, non-Roma female names). We hypothesize that tests with Roma names receive lower evaluations and track recommendations on average than tests with non-Roma names. We test our hypotheses estimating linear regression models with teacher and test fixed effects. We preregister the analysis plan before having any endline data.

Intervention

Our experimental manipulation consists of a random manipulation of students’ names (Roma male, Roma female, non-Roma male, non-Roma female names) on mathematics/Hungarian tests evaluated by primary school teachers.

Experimental design

Teachers have four tasks in the experiment:
1. They evaluate six mathematics or Hungarian grammar and literature tests on a 30-point scale first. Students’ names on the tests will be fictive and randomly assigned (Roma male, Roma female, non-Roma male, non-Roma female names).
2. Teachers recommend a grade based on the evaluation of the test on the 5-grade scale used in the Hungarian educational system (1 = fail, 2 = pass, 3 = satisfactory, 4 = good, 5 = excellent).
3. They recommend a secondary school track to the students whose tests they evaluated. (1 – vocational school, 2 – secondary vocational school, 3 – secondary grammar school). Besides the points and grades assigned by the teacher in the given subject, we will provide an additional information: fictive points the student received for their test in the other subject.
4. Teachers are asked to fill out a questionnaire focusing on background information, seating arrangements in the class, and tracking in school.

Design details

Randomization method
The experimental procedure employs randomization at different levels: 1. Based on the value of a random number, teachers will receive a random test package from the eight different test packages. 2. Within the assigned package, teachers will see the tests in a random order (based on the value of a random number). 3. Before deciding on the track recommendations, we communicate teachers the fictive points that students received for a test in another school subject (e.g., if the teacher evaluated the Hungarian test, we communicate the students’ fictive achievement on the math test, and vice-versa). This procedure is based on randomization in which we randomly choose one out of the six possible functions below with 1/6 probablity: i. points given by the teacher – 6 point; ii. points given by the teacher – 4.5 point; iii. points given by the teacher – 3 point; iv. points given by the teacher + 3 point; v. points given by the teacher + 4.5 point; vi. points given by the teacher + 6 point
Randomization unit
The experimental procedure employs randomization at different levels: 1. Based on the value of a random number, teachers will receive a random test package from the eight different test packages. 2. Within the assigned package, teachers will see the tests in a random order (based on the value of a random number). 3. Before deciding on the track recommendations, we communicate teachers the fictive points that students received for a test in another school subject (e.g., if the teacher evaluated the Hungarian test, we communicate the students’ fictive achievement on the math test, and vice-versa). This procedure is based on randomization in which we randomly choose one out of the six possible functions below with 1/6 probablity: i. points given by the teacher – 6 point; ii. points given by the teacher – 4.5 point; iii. points given by the teacher – 3 point; iv. points given by the teacher + 3 point; v. points given by the teacher + 4.5 point; vi. points given by the teacher + 6 point
Clusters
we do not have clusters
Observations
Having a single-level trial and expecting 400 teachers, each of them grading six tests, our planned number of observations will be 2,400 tests.
Arms
Students' names will be randomized on the tests. The planned number of observations is 2,400 tests, half of them (1200) is expected to be assigned to Roma names, half of them (1200) is expected to be assigned to non-Roma names.
Primary outcomes
1. total points assigned to the test by the teachers 2. track recommendations by the teachers
Secondary outcomes
grade assigned to the test by the teachers

Cited by

No citation data available for this registration yet.

Keywords