Mitigating Bias in Evaluations

How to cite

Wang, Tong; Ramdas, Kamalini; Heller, Monika. 2025. "Mitigating Bias in Evaluations." AEA RCT Registry. AEARCTR-0015968. https://doi.org/10.1257/rct.15968-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tong Wang* , Kamalini Ramdas , Monika Heller

* Primary investigator

Registry ID
AEARCTR-0015968
DOI
https://doi.org/10.1257/rct.15968-1.0
First registered
Last updated
Status
In development
Trial dates
2025-05-07 – 2028-06-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/15968

Abstract

Ratings are essential for service providers to signal quality to customers, helping them make informed decisions. However, publishing prior ratings may inadvertently introduce bias in follow-up service evaluations. We explore the operational interventions to mitigate such prior ratings bias.

Experimental design

This experiment investigates how different formats of rating displays influence follow-up service evaluations. Participants in the control group will not be exposed to any prior ratings, while those in the treatment group will view ratings presented in various formats. Further details can be found in the pre-analysis plan, titled "Ratings Display_PAP_May2025."

Design details

Randomization method
Randomization of the survey will be done via the randomizing function in Qualtrics.
Randomization unit
Individual
Clusters
We plan to recruit 900 participants.
Observations
900 individuals.
Arms
There are 150 participants per condition, and in total, six conditions. Details regarding random assignments are in the pre-analysis plan.
Primary outcomes
Described in the pre-analysis plan.

Cited by

No citation data available for this registration yet.

Keywords