Feedback in University Education

How to cite

Hardt, David. 2019. "Feedback in University Education." AEA RCT Registry. AEARCTR-0004457. https://doi.org/10.1257/rct.4457-1.5000000000000002

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

David Hardt*

* Primary investigator

Registry ID
AEARCTR-0004457
DOI
https://doi.org/10.1257/rct.4457-1.5000000000000002
First registered
Last updated
Status
On going
Trial dates
2019-07-17 – 2022-07-31
Countries
Private
JEL codes
C93, D83, D91, H41, I21, I23, I26
Registry record
http://www.socialscienceregistry.org/trials/4457

Abstract

It is of public interest that students achieve high returns from public education and perform well in exams. In a field experiment, I study the impact of randomized pre-exam test feedback on exam performance in an undergraduate macroeconomic class. Before and after the test participants reveal beliefs regarding their individual effort-performance relationship. Only students in the treatment group receive feedback on their performance in the test before the second belief elicitation. In addition, I elicit students’ self-confidence regarding their performance in the test. I can measure each student’s consecutively exerted study effort by tracking her activity on the e-study platform. Finally, I link the experiment and platform data to the students’ exam grades. In doing so, I can examine to what extent the exogenous feedback treatment shifted students’ believed effort-performance relationship, their exerted study effort and their final exam performance.

Intervention

I provide randomized feedback on a pre-exam test to undergraduate university students. I compare shifts in beliefs about expected exam performance (for a constant level of effort), actual exerted study effort and actual exam performance between students that received feedback on the pre-exam test to those that did not receive any feedback. The feedback has a debiasing character regarding participants’ believed individual effort-performance relationship and/or their self-confidence and should therefore influence their study decisions (i.e. exerted effort) and outcomes (i.e. performance in the exam).

Experimental design

All students that signed up for an undergraduate macroeconomics exam are invited to visit a newly implemented e-study-platform with exam preparation material. In order to access the platform, students need to participate in a short test on exam relevant material. Before that test, students reveal beliefs about their assumed individual effort-performance relationship, e.g. how much they believe they need to study in order to achieve their desired grade.
After the test, students guess how well they performed in it. Next, only students in the treatment group receive feedback on their test performance before once more beliefs on individual effort-performance relationship are elicited. Next, students get access to the e-study platform. The platform consists of an overview page with some instructions and hyperlinks to the lessons 1 to 11. Higher lessons are only unlocked if all respectively lower lessons have been completed by providing answers to all the containing exercises. I monitor each student’s activity on the platform closely. In doing so, not only the number of completed lessons but also the intensity of the use of the platform can serve as an objective measure of study effort in the analyses. Finally, I link the experiment and platform data to the students’ exam grades. I can therefore examine to what extent the feedback treatment shifted students’ believed effort-performance relationship, their exerted study effort and their final exam performance. In addition, I can determine students’ self-confidence regarding test performance.

Design details

Randomization method
Randomization done in office using Stata. Randomization into treatment and control takes place before students arrive on the platform. Leading up to the exam, students have the option to hand in solved exercises and receive feedback afterwards. I make sure that the number of students who handed in material is balanced between treatment and control group. Furthermore, I also stratify on students’ A-levels grade point average.
Randomization unit
Individual Student
Clusters
400-800 students
Observations
400-800 students
Arms
Symmetric sample sizes between treatment and control.
Primary outcomes
Belief elicitation of each student’s self-confidence. Elicitation of beliefs about individual effort-performance relationship and shifts therein. Difference in actually exerted study effort on the platform (between treatment and control group). Difference in actual exam performance (between treatment and control group).
Secondary outcomes
Heterogeneity analyses (with respect to personality traits, A-levels GPA etc.)

Cited by

No citation data available for this registration yet.

Keywords