The effect of teacher professional development on financial literacy education. Evidence from a randomized experiment
How to cite
Compen, Boukje; Witte, Kristof De; Schelfhout, Wouter; Declercq, Koen.
2018. "The effect of teacher professional development on financial literacy education. Evidence from a randomized experiment." AEA RCT Registry. AEARCTR-0003501.
https://doi.org/10.1257/rct.3501-4.0
Download:
BibTeX
·
RIS— for reference managers without a browser
translator. Zotero and most
others pick up this page's citation metadata directly.
We study the impact of professional development of teachers in secondary education in the Flemish region of Belgium. We investigate whether an online training module affects financial knowledge and behavior of both teachers and students. To identify a causal effect, we make use of a randomized controlled trial in which 48 schools and approximately 2000 students participate. Schools are randomly assigned to one of the treatment conditions. We compare financial literacy test scores in schools in which teachers follow a training module to test scores in schools in which teachers do not follow this module.
Intervention
Schools are assigned to the following four experimental conditions: 1) Control group: Students do not follow a course on financial education. 2) Treatment group 1: Students follow a course on financial education. Teachers do not follow an online training module. 3) Treatment group 2a: Students follow a course on financial education. Teachers can follow an online training module. 4) Treatment group 2b: Students follow a course on financial education. Teachers can follow an online training module and are activated to participate in this training by a facilitator.
Experimental design
Schools were randomized to the aforementioned four experimental conditions. We measured the level of financial literacy before and after students followed the course. Students who were assigned to the control group completed the same tests at the same time as students in the several treatment groups. The experiment was conducted in two waves. In the first wave, students in the second year of secondary education (age 13-14) participated in the experiment. All teachers who could follow the online training module were assigned to treatment group 2a. In the second wave, students in the third year of secondary education (age 14-15) followed exactly the same course and completed the same questionnaires. All teachers who could follow the online training module in this wave were assigned to treatment group 2b.
Design details
Randomization method
Schools were randomly assigned to the different experimental conditions by a random number generator in Stata.
Randomization unit
In both waves, we randomized at the school level. All students and teachers in the same school were assigned to the same condition. In this way, all teachers in the same school received the same teaching material and instructions. This minimizes the possibility of spill-over effects and contamination of the different treatment conditions.
Clusters
Because we already executed the experiment, and collected the data for both the pretest and the posttest, we report the actual number of students and schools for which we have observations for both the pretest and the posttest. This will be the final sample for our analysis. We also use this sample size for the calculation of the minimal detectable effect size.
Wave 1: 35
Wave 2: 13
Observations
Wave 1: 1628
Wave 2: 321
Arms
Wave 1: second year of high school
Control group = 739 students, 13 schools
Treatment group 1 = 408 students, 12 schools
Treatment group 2a = 481 students, 10 schools
Wave 2: third year of high school
Control group = 111 students, 5 schools
Treatment group 1 = 91 students, 4 schools
Treatment group 2b = 119 students, 4 schools
Total sample
Control group = 850 students, 18 schools
Treatment group 1 = 499 students, 16 schools
Treatment group 2 = 600 students, 14 schools
Average number of schools per condition = 16
Average number of students per condition = 649.7
Average number of students per school = 40.6
Please note that as teacher characteristics were included as control variables in the final analyses, this resulted in missing values for a selection of students. Consequently, the final sample reported in the article is somewhat smaller:
Wave 1: second year of high school
Control group = 675 students, 13 schools
Treatment group 1 = 401 students, 11 schools
Treatment group 2a = 481 students, 10 schools
Wave 2: third year of high school
Control group = 111 students, 5 schools
Treatment group 1 = 91 students, 4 schools
Treatment group 2b = 86 students, 3 schools
Total sample
Control group = 786 students, 18 schools
Treatment group 1 = 492 students, 15 schools
Treatment group 2 = 567 students, 13 schools
Primary outcomes
We measure financial literacy of students by a test that contains 9 questions. This test consists of questions that measures both financial knowledge and financial behavior. We measure the financial literacy of teachers by a separate questionnaire. We are able to measure the intensity of treatment because we observe the activity of the teachers in the online training module (for example the number of clicks on each item).
Cited by
No citation data available for this registration yet.