Targeted remedial mathematics teaching to improve upper secondary completion rates

How to cite

Kirkebøen, Lars. 2017. "Targeted remedial mathematics teaching to improve upper secondary completion rates." AEA RCT Registry. AEARCTR-0002308. https://doi.org/10.1257/rct.2308-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lars Kirkebøen*

* Primary investigator

Registry ID
AEARCTR-0002308
DOI
https://doi.org/10.1257/rct.2308-1.0
First registered
Last updated
Status
On going
Trial dates
2016-02-15 – 2020-03-01
Countries
Private
JEL codes
I21, C93
Registry record
http://www.socialscienceregistry.org/trials/2308

Abstract

The project randomizes, at the school level, a set of interventions to study the effectiveness of remedial mathematics teaching and certain components of the remediation. The interventions are targeted at low-performing students in mathematics as measured by standardized tests. We conduct two experiments; one in Grade 8 (at the lower secondary level) and one in Grade 11 (at the upper secondary school level). The study's hypothesis is that the target groups have important gaps and misconceptions in mathematics from their early schooling that can be remediated by the interventions, and that the students subsequently will be more likely to pass math subjects and graduate from upper secondary school. The remediation replaces 20 hours of the regular mathematics classes during the first semester and 15 hours in the second semester. Total instruction time is unchanged.

Intervention

We conduct two randomized controlled trials (RCTs). Common features of the two are the didactics of mathematics promoted in the teacher trainings, and the time allocated for the remediation classes. Specifications of the target group, class size, the topics covered, and the level of additional financial resources differ. We review the common features and then the specifics of each RCT.

The teacher trainings aim to change teaching practice through promotion of a set of best practice didactic principles and strategies. The principles are in most cases not new to the teachers but by showing how they can be applied and focusing efforts, the practice is expected to change. Succinctly, teachers should:
- motivate the students for each lesson,
- structure communication to foster comprehension,
- explain the links between concepts, and
- set high but realistic expectations.

And apply the following strategies:
- Engage students with 'Low Threshold High Ceiling' tasks that allow the students to begin at their level while providing challenge for all students in the group;
- Use the 'Think, pair, share' method to stimulate both individual thinking and group learning;
- Use visualization tools such as 'thinking blocks'; and
- Use journals as a tool to reflect on what was learned.

The classes replace 20 hours of the regular mathematics classes in the first semester and 15 hours in the second semester; total instruction time is unchanged.

For treatment and control group schools alike at both levels, other initiatives to improve performance continue independently of the RCTs described here. Such other initiatives should be uncorrelated with the treatment assignment.

RCT 1: Grade 8, lower secondary school:

The lower secondary schools are randomized into one of three groups:
1. Wave 1 treatment group
2. Wave 2 treatment group
3. Control group

The target group is defined as students scoring at the two lowest levels on the Norwegian standardized test in numeracy. Students sit the test around a month before the remediation classes begin.

The topics covered in the remediation are numeracy, mental calculation, the four operations (addition, subtraction, division and multiplication) and fractions.

Wave 1 Treatment Group

Students receive one of two treatments depending on the number of target group students in the school. The threshold number for year 1 is 24, and for years 2 and 3, 18, such as:
- If the school has 24 (18) or fewer students in the target group, only treatment A is implemented.
- If more than 24 (18) students, treatment B is also introduced. In this case, the 16 (12) lowest-performing students receive treatment A, while additional students receive treatment B.

Treatment A is remediation in a group size of 4-8 students in year 1 (4-6 students in years 2 and 3); lessons should be structured according to plans designed to facilitate the change in teaching practice.

Treatment B is remediation in groups of 15-20 students. Teachers are not provided lessons plans.

The schools receive financial resources to cover the additional cost of providing remediation in smaller groups. For schools with Treatment A only, the schools receive sufficient funding to establish the relevant number of small groups. For example, a school with 1-8 (1-6) students receives funding to establish one small group, while a school with 17-24 (13-18) receives funding for three groups.

For schools implementing Treatment A and B, the schools receive funding for establishing the two groups for the lowest-performing 16 (12) students, and only very limited extra funding for Treatment B sized groups as these are only slightly smaller than the regular classes.

Wave 2 Treatment Group

Year 1
The first year, these schools receive financial resources to implement remediation for up to 24 students in the target group, as if they were in wave 1. Remediation is provided in groups of 4-8 students, for the same period as the intervention in Wave 1 Schools. The teachers teaching these classes are not given additional training, schools are provided only financial resources sufficient to reduce the class size (similar to the schools in wave 1). Refer to this as Treatment C. This treatment arm allows us to separate the impact of financial resources from the didactic recommendations.

Years 2 and 3
The second and third year, these schools receive interventions according to the scheme for the Wave 1 Treatment Group in Years 2 and 3. Thus Treatment C is implemented only the one year.

Control group
The schools in the control group continue with the regular treatment, business-as-usual, the three years of the project.

RCT 2: Grade 11, upper secondary schools

The target group is Grade 11 students who
1. selects the academic track of the Norwegian upper secondary schools system;
2. selects the easiest of two math courses; and
3. scores at the lowest two levels on a standardized numeracy test administered around a month before the intervention starts.

There is one treatment: Teachers with training as described above teach the topics where weaker students usually have gaps and misconceptions. The remedial classes are taught in classes similar to the regular class size. The schools are free to organize the remediation as they please i.e. they choose whether to separate target and non-target group students or not. Financial resources are provided to cover the cost of sending teachers for training only.

The topics covered in the remediation are numeracy, strategies for performing mental calculations, the four operations (addition, subtraction, division and multiplication), fractions, percentages, decimal numbers and measurement.

The schools in the control group continue as usual the three years of the project.

Experimental design

For RCT 1, the 48 lower secondary schools are randomly assigned to one of three groups:
1. Wave 1 treatment group: 8 schools
2. Wave 2 treatment group: 16 schools
3. Control group: 24 schools

For RCT 2, the 17 schools are randomly assigned to one of two groups:
1. Treatment group: 9 schools
2. Control group: 8 schools.

Design details

Randomization method
Randomization was done in office by a computer. A randomization script was written and tested, before a seed for the random number generator was chosen at random and the script was run once to assign schools.
Randomization unit
School
Clusters
48 lower secondary schools. 17 upper secondary schools.
Observations
For each year, there are around 5000 Grade 8 students in Oslo. The target group is defined as students scoring at the two lowest levels on the Norwegian standardized test in numeracy. Students sit the test around a month before the remediation classes begin. Based on data from previous years, we expect this to be around 1000 students of which around 500 will be in treatment schools. Over three years, we thus expect around 1500 treated target-group students in the 24 treatment schools, and a similar number of untreated target-group students in the 24 control schools. Students receiving special needs education in mathematics are exempted, the share of such students is not known. Furthermore, we expect around 6000 non-target group students in the treatment schools, and a similar number in the control schools. The relevant population in upper secondary school is students selecting the academic track and the least advanced math subject (of who. There are around 1800 such students each year. Of these, the target group is expected to be around 900 students. Thus we expect about 450 students each year in the treatment schools, or 1350 over three years, and a similar number in the control schools.
Arms
RCT 1 (grade 8, lower secondary school): 8 schools in treatment wave 1, 16 schools in treatment wave 2, 24 schools control. RCT 2 (grade 11, upper secondary school): 9 schools treatment, 8 schools control
Primary outcomes
The primary long-term outcome is completion of upper secondary. The primary short-term outcome is numeracy as measured by standardized tests. We will also study several secondary outcomes.

Cited by

No citation data available for this registration yet.

Keywords