Reducing impact of student bias on feedback surveys: A pilot study
How to cite
Genetin, Brandon; Kalish, Alan; Kogan, Vladimir; Chen, Joyce. 2020. "Reducing impact of student bias on feedback surveys: A pilot study." AEA RCT Registry. AEARCTR-0006868. https://doi.org/10.1257/rct.6868-1.2000000000000002
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This project utilizes a randomized controlled trial to assess the efficacy of utilizing modified introductory language to mitigate implicit bias in student evaluations of instruction. So-called "cheap talk" scripts are presented to survey respondents in advance and describe the hypothetical biases that tend to arise in the study context (Cummings and Taylor, 1999). This is potentially a highly cost-effective strategy to improve the quality of information generated by student evaluations of instruction, while also minimizing inequities for under-represented populations.
Intervention
All interventions related to the study will be administered by the investigators via the standard online platform for student evaluations of instruction. A subset of student participants will be randomly selected to receive additional introductory text related to the research study prior to completing the usual online evaluation of instruction for their enrolled courses. Instructor participants will not be asked to complete any activities for the study, other than to give their consent to participate. Data collected as part of the intervention will also be linked to student records (race, gender, course grade, major, rank) and instructor records (race, gender) to assess whether the effects of the intervention are heterogeneous across groups.
Experimental design
This research will utilize a “survey experiment” design, which involves embedding randomized text within a survey given to subjects. While all subjects will see the same questions (the current questions asked on the OSU Student Evaluation of Instruction), the introductory paragraph will vary across respondents.
Design details
Cited by
No citation data available for this registration yet.