An Experimental Investigation of AI Fairness in Education

How to cite

XUE, Lian; Cartwright, Edward; Huang, Chinglu; Wei, Lijia. 2024. "An Experimental Investigation of AI Fairness in Education." AEA RCT Registry. AEARCTR-0014596. https://doi.org/10.1257/rct.14596-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lian XUE* , Edward Cartwright , Chinglu Huang , Lijia Wei

* Primary investigator

Registry ID
AEARCTR-0014596
DOI
https://doi.org/10.1257/rct.14596-1.0
First registered
Last updated
Status
On going
Trial dates
2024-09-10 – 2025-02-28
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/14596

Abstract

Our study investigates how the integration of AI tools in educational contexts influences perceptions of fairness. Driven by ongoing discussions around the ethical implications of AI use by students, this research seeks to understand fairness perceptions across various settings, including competitive and non-competitive scenarios.
Utilizing a structured experimental design, participants are presented with situations involving two hypothetical students, one engaging with AI tools and the other not. The study examines how different conditions related to AI usage affect third-party perceptions of fairness and their decisions regarding score redistribution.
We explore several hypotheses regarding fairness perceptions, including the notion that AI use in competitive situations may be viewed as less equitable and that specific types of AI encouragement influence the desire for score adjustments. The findings aim to contribute to the understanding of fairness in the context of AI, with implications for educational practices.

Intervention

We conducted a 2*4 survey experiment using a mixed-method design that incorporates both between-subject and within-subject variables to examine third-party perceptions of fairness in the use of AI within educational contexts. We investigated differences in subjects' fairness perceptions across two contexts: a competitive environment and a non-competitive environment.

Experimental design

We will conduct a 2*4 survey experiment using a mixed-method design that incorporates both between-subject and within-subject variables to examine third-party perceptions of fairness in the use of AI within educational contexts.

Design details

Randomization method
Our randomization at the recruitment is done with the assistance of the Weikeyan system, a WeChat-based recruitment system that facilitates researchers' economic or marketing experiments. The system will send advertisements to subjects pool ensuring randomization across treatments.
Randomization unit
Our unit of observation is at the individual level.
Clusters
The experiment will be clustered at the session level. We aim to conduct 10-20 participants per session, conditioning the participants' registration conditions. For each treatment arm, we aim to get at least ten sessions for a sufficient number of observations.
Observations
200-400 student participants
Arms
100-200 per treatment arm (10 sessions * 10-20 participants/session)
Primary outcomes
Redistribution decision
Secondary outcomes
Willingness to pay for AI use; Willingness to punish AI users

Cited by

No citation data available for this registration yet.

Keywords