Can blind grading on online platforms reduce grade gaps in education?

How to cite

Ren, Tamara. 2023. "Can blind grading on online platforms reduce grade gaps in education?." AEA RCT Registry. AEARCTR-0011694. https://doi.org/10.1257/rct.11694-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tamara Ren*

* Primary investigator

Registry ID
AEARCTR-0011694
DOI
https://doi.org/10.1257/rct.11694-1.0
First registered
Last updated
Status
In development
Trial dates
2023-06-29 – 2023-10-31
Countries
Private
JEL codes
I2, D8, J1
Registry record
http://www.socialscienceregistry.org/trials/11694

Abstract

I conduct an online laboratory experiment with Prolific and Qualtrics to evaluate whether blind grading on online platforms like Canvas might promote grade equity. I report the average impact on grade gaps by race and gender and the underlying behaviors that drive those gaps. In particular, I measure information seeking, time spent grading, order effects, and self-reported ratings. Motivated by rational inattention theory consistent with a Bayesian learning model with costly signal extraction, this experiment provides empirical evidence on whether statistical discrimination and endogenous inattention can explain grade differences.

Intervention

Participants grade in either a blind or nonblind environment.

Experimental design

I will recruit participants online. Participants will grade a sequence of homework submissions on the same prompt. Participants in the treatment group will see a randomly generated fictitious identity attached to each submission. The fictitious identities include names and photos to mimic the information graders can see on grading platforms like Canvas. The remaining participants in the blind group will not observe any fictitious student information. In both groups, participants can choose to view the grading rubric and the class notes on every submission.

Design details

Randomization method
I use Qualtrics to randomize participants into a treatment or control group.
Randomization unit
Individual
Clusters
500 participants
Observations
4000
Arms
250 individuals in the blind group; 250 individuals in the nonblind group.
Primary outcomes
- Grades given to each submission
Secondary outcomes
- Time spent grading each submission - Whether participants opened the grading rubric and lecture notes. - Whether participants opened lecture notes - Self-reported ratings on "grading is exhausting" and others (did they use the grading rubric/lecture notes, how did they feel about grading overall) - Accuracy of grading (difference in scores relative to pre-determined scores)

Cited by

No citation data available for this registration yet.

Keywords