Framing Student Feedback: A randomised controlled trial comparing gain- and loss-framed personalised feedback on academic performance and engagement

How to cite

Ireland, Andrew; Garivaldis, Filia; Fenton, Andrea; Yap, Simon. 2024. "Framing Student Feedback: A randomised controlled trial comparing gain- and loss-framed personalised feedback on academic performance and engagement." AEA RCT Registry. AEARCTR-0012792. https://doi.org/10.1257/rct.12792-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Andrew Ireland* , Filia Garivaldis , Andrea Fenton , Simon Yap

* Primary investigator

Registry ID
AEARCTR-0012792
DOI
https://doi.org/10.1257/rct.12792-1.0
First registered
Last updated
Status
In development
Trial dates
2024-02-26 – 2025-01-01
Countries
Private
JEL codes
C93 I21 I23 D91
Registry record
http://www.socialscienceregistry.org/trials/12792

Abstract

Education tells us that providing students with timely and constructive feedback is key to their learning. Behavioural science tells us that feedback that is personalised and aligns with students’ motivational styles, is more engaging and more likely to be acted on. In this research, we will apply these principles by sending ‘personalised’ progress emails to students throughout a semester, to ‘nudge’ them towards better quiz engagement and performance. The emails will be worded using loss vs gain framing (how much they have lost vs gained) to appeal to different motivational styles, and impact will be measured using learning analytics and quiz grades.

Experimental design

We plan to measure students' motivational style via baseline survey in the first week of semester. Then, students will be randomly and unknowingly assigned to one of either the Gain Group or the Loss Group, upon submitting their responses to the survey.
During the semester students will receive three personalised emails with feedback on their in-semester quiz performance. The emails will be gain- or loss- framed depending on their treatment arm. The emails will also contain a link to request further teacher consultation. The primary outcome is performance on in-semester assessment (following each email) and on the final exam. We are looking for differences between performance of gain- and loss- framed groups depending on motivation style.

Design details

Randomization method
Randomization will be done by the computer.
Randomization unit
The unit of randomization is the university student.
Clusters
800 students.
Observations
800 students.
Arms
Four groups of 200 students based on motivational style and gain- or loss- treatment.
Primary outcomes
Student grades on subsequent assessment (quiz and exam)
Secondary outcomes
Student engagement measured through requests for teacher consultation

Cited by

No citation data available for this registration yet.

Keywords