Examining Bias in Teacher Evaluations of Students

How to cite

Reiling, Rune Borgan; Alne, Ragnar; Herstad, Eyo I.. 2023. "Examining Bias in Teacher Evaluations of Students." AEA RCT Registry. AEARCTR-0012510. https://doi.org/10.1257/rct.12510-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Rune Borgan Reiling* , Ragnar Alne , Eyo I. Herstad

* Primary investigator

Registry ID
AEARCTR-0012510
DOI
https://doi.org/10.1257/rct.12510-3.0
First registered
Last updated
Status
Completed
Trial dates
2023-11-15 – 2025-08-31
Countries
Norway (Oslo)
Registry record
http://www.socialscienceregistry.org/trials/12510

Abstract

We present causal evidence regarding the impact of a student's ethnicity and gender on teacher evaluations in middle school. In this study, we engage teachers to assess written assignments for full classes in two subjects: mathematics and Norwegian language. By randomly assigning names that signal both gender and ethnicity to the assignments within teachers, we investigate whether students with equal ability but different names receive equal grades, on average. While our primary focus is on the average effects of student gender and ethnicity, we also conduct an extensive analysis of heterogeneity, considering factors such as ability, student gender, teacher experience, and the gender of the teacher. This document outlines our analysis plan, including our primary specifications of interest.

Intervention

Student grades in schools are supposed to be a reflection of the students’ real ability in the subject, and commonly decide which students go to which high school, higher education and job. As such, from a fairness perspective, it is important that student grades reflect the the student’s ability in the subject. To identify whether students are treated fairly, we recruit real teachers to evaluate real student assignments.

Experimental design

The interventions will be randomized across teachers.

Design details

Randomization method
Randomization done in office by a computer.
Randomization unit
30 student assignments
Clusters
Our goal is to recruit approximately 150 teachers for the project, with an anticipated participation of over 100 teachers who will each grade approximately 30 assignments. This amounts to a total of roughly 3,000 graded assignments clustered at the teacher level.
Observations
Our goal is to recruit approximately 150 teachers for the project, with an anticipated participation of over 100 teachers who will each grade approximately 30 assignments. This amounts to a total of roughly 3,000 graded assignments.
Arms
Each teacher will grade an entire class of student assignments. This amounts to a sample size equal to the number of teachers per name that is randomly assigned. Our goal is to recruit approximately 150 teachers for the project, with an anticipated participation of over 100 teachers who will each grade approximately 30 assignments. This amounts to a total of roughly 3,000 graded assignments.
Primary outcomes
Our primary outcome is the assessment of students’ ability levels by teachers.

Papers from this trial

  1. Alne, Ragnar H., Herstad, Eyo I. and Reiling, Rune B., Fairness in Grading: Randomizing Ethnicity and Gender in Teacher Assessments (October 28, 2024). Available at SSRN: https://ssrn.com/abstract=5002237 or http://dx.doi.org/10.2139/ssrn.5002237 https://papers.ssrn.com/sol3/papers.cfm?abstract_id=5002237

Cited by

No citation data available for this registration yet.

Keywords