Improving Student's Financial Proficiency by Differentiating Computer-Assisted Instruction and Feedback? Evidence from a Randomised Control Trial.

How to cite

Iterbeke, Kaat; Declercq, Koen; Schelfhout, Wouter; Witte, Kristof De. 2019. "Improving Student's Financial Proficiency by Differentiating Computer-Assisted Instruction and Feedback? Evidence from a Randomised Control Trial.." AEA RCT Registry. AEARCTR-0004431. https://doi.org/10.1257/rct.4431-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kaat Iterbeke* , Koen Declercq , Wouter Schelfhout , Kristof De Witte

* Primary investigator

Registry ID
AEARCTR-0004431
DOI
https://doi.org/10.1257/rct.4431-1.0
First registered
Last updated
Status
Completed
Trial dates
2018-08-15 – 2019-01-31
Countries
Belgium (Flanders)
JEL codes
C93; I21;O16
Registry record
http://www.socialscienceregistry.org/trials/4431

Abstract

This study examines the impact of within-class differentiation on the learning outcomes of Flemish students in eighth and ninth grade. In particular, using a computer-based learning environment, we evaluate the impact of two differentiation practices on the effectiveness of a financial education programme. First, differentiating instructions to the particular needs of students is examined for which high-ability students follow a more challenging learning path and low-ability students a basic path with additional instructions. Second, we examine whether providing students with elaborated feedback on own performances improves their learning outcomes. In order to establish the results on the effects of both practices, we conducted a large-scale randomised control trial involving 32 schools and 1,177 students.

Intervention

In order to examine the impact of the within-class computer-assisted differentiation practices, i.e. differentiated instruction and feedback, we designed four conditions, i.e. one control condition and three experimental conditions.
- The control condition did not receive the financial education programme.
- In the first experimental condition, all students had to follow an intermediate-level learning path, regardless of their proficiency level. Elaborated feedback was given after all exercises.
- In the second experimental condition, students followed a differentiated learning path. The paths included simple verification feedback.
- In the third experimental condition, students followed a differentiated learning path and elaborated feedback was provided. This experimental condition contains the most extended form of differentiation. A comparison with the first experimental condition allows us to evaluate the impact of differentiating instruction. The value added of elaborated feedback is investigated via a comparison with the second experimental condition.

Experimental design

The financial education programme was developed for students in eighth and ninth grade in Flemish secondary education. Schools were invited to participate in the financial education programme in an open call. Teachers were given the liberty to plan the lectures in October or in November. From the schools willing to participate in either wave, we randomly assigned them to the control condition or one of the experimental conditions. In order to guarantee a uniform implementation, we requested the teachers to give the lectures during the pre-specified periods, depending on the particular wave, and during regular class hours. In order to evaluate the programme, students had to take three financial literacy tests, i.e. a first test prior to the lectures to measure students’ baseline financial proficiency, a second test at the start of the last lecture to capture the short-term effectiveness of the programme, and third test administered as an homework approximately six weeks after the lectures for students in the experimental conditions to measure longer-term effects. Students in the control condition completed the pre- and first post-treatment test at the same time as students in the experimental conditions.

Design details

Randomization method
Stratified randomization was performed by a computer.
Randomization unit
Randomization was done at the level of the school to avoid spillover effects and contamination of the treatment within the same school.
Clusters
46 schools signed up to participate in the financial education programme of which 32 schools entirely followed the protocol (students completed both the pre- and post-treatment financial literacy test).
Observations
1,177 students
Arms
Control condition: 312 students, 9 schools Experimental condition I: 159 students, 5 schools Experimental condition II: 281 students, 8 schools Experimental condition III: 425 students, 10 schools
Primary outcomes
We measure financial proficiency using a computer-aided multiple-choice test that contains questions covering both financial knowledge and financial behaviour.

Cited by

No citation data available for this registration yet.

Keywords