Breaking the Negative Spiral of Disruptive School Behavior – Experimental Evidence about how an Exogenous Shock to Primary School Students’ School Behavior Affects their Achievement

How to cite

Keller, Tamas. 2020. "Breaking the Negative Spiral of Disruptive School Behavior – Experimental Evidence about how an Exogenous Shock to Primary School Students’ School Behavior Affects their Achievement." AEA RCT Registry. AEARCTR-0005442. https://doi.org/10.1257/rct.5442-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tamas Keller*

* Primary investigator

Registry ID
AEARCTR-0005442
DOI
https://doi.org/10.1257/rct.5442-1.1
First registered
Last updated
Status
On going
Trial dates
2020-02-03 – 2021-02-28
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/5442

Abstract

The project aims to improve primary school students’ academic achievement by changing students’ troublesome behavior at school. We will carry out a pair-matched, cluster-randomized trial in which whole primary school classrooms (N=148) are randomized either to the treated or to the control condition. Both groups will receive an intervention that consists of two parts. Part one involves only information, while part two is participation in a 50-day campaign aimed at maintaining students’ awareness of the issue. Treated and control students differ in terms of the content of the intervention they will receive. Treated students will receive information about the negative consequences of troublesome school behavior. They will also participate in a 50-day campaign in which they will collect points (offline and online) if they avoid engaging in troublesome school behavior. Control students will receive information about the negative consequences of unhealthy food with the accompanying 50-day campaign. We will assess the treatment effect by comparing the change in students’ GPA and test scores (primary outcomes) across treated and control students. Our secondary outcomes are students’ self-reported and teacher-reported behavior, and students’ self-control as observed in real choice situations.

Intervention

Treated and control students both will receive an intervention implemented by the same coaches. The intervention consists of the same elements: information and a 50-day campaign.
Treated students will receive information about troublesome school behavior and in a 50-day campaign will be trained to avoid troublesome school behaviors. Control students will receive information about unhealthy food and in a 50-day campaign will be trained to avoid the consumption of unhealthy food.

Experimental design

For another field experiment, in the spring of 2017, we contacted all primary schools in seven contiguous counties of central Hungary via the heads of the local school districts to elicit information about seating practices and obtained initial participation agreements from 55 schools. Out of the original 55 schools that participated in our prior research, 13 schools agreed to join in this new research. We obtained consent from 16 additional schools by sending out letters in autumn 2019 again to all the schools in the same counties.
We contacted these schools again in autumn 2019 and asked for their consent for participation in a new project. We told schools that our recent research has two arms concerning the consequences of troublesome school behavior / unhealthy food. We communicated to schools that we will tell them about the allocation of classrooms to the research arms. We offered schools 45-minute long coaching sessions accompanied by a 50-day campaign aimed at changing maladaptive behavior. We specified for schools the type of data that we will collect from students.
Following the recommendations of Imai, King, and Nall (2009), we undertook pair-matched cluster-randomization, with classrooms as the clusters.
Treated and control students both will receive an intervention implemented by the same coaches. The intervention consists of the same elements: information and a 50-day campaign.
Treated students will receive information about troublesome school behavior and in a 50-day campaign will be trained to avoid troublesome school behaviors. Control students will receive information about unhealthy food and in a 50-day campaign will be trained to avoid the consumption of unhealthy food.
The 50-day campaign is designed to raise and maintain students' awareness. It will help students to recall the information they have received (troublesome behavior / unhealthy food) and motivate them to change their behavior.
In sum, the elements of the intervention will be the same for treated and control students. Both groups will receive information from the same coaches, and both groups will participate in a 50-day intervention aimed at changing their behavior. The only difference between the treated and the control group is the content of the information.

Design details

Randomization method
Following the recommendations of Imai, King, and Nall (2009), we undertook pair-matched cluster-randomization, with classrooms as the clusters. The following steps describe the randomization we carried out. 1. We collected baseline grades referring to the end of the last academic year (2018/19). 2. We created a data set containing the class-average grades for the following six school subjects: mathematics (1), Hungarian literature (2), Hungarian grammar (3), diligence (4), behavior (5), and class size (6). 3. In the dataset of class-averages, we calculated a principal component from the six variables. We will refer to the principal component as the blocking score. 4. In each grade level, classrooms were ranked according to the blocking score. 5. We identified the most similar classroom pairs in the ranked data set. 6. Within each classroom-pair, we allocated one classroom to the treated, and one to the control group based on a randomly generated number. To optimize balance, we have repeated this step 1000 times. We computed the p-values for balance on each baseline variables known at randomization (not only for the blocking variable) and chose the randomization with the largest minimal p-value across baseline variables.
Randomization unit
classrooms
Clusters
148 classrooms and 29 schools
Observations
2,898 students
Arms
treated classrooms: 74 control classrooms: 74
Primary outcomes
Our primary outcome variable is students’ endline GPA calculated from teacher-awarded grades from three core subjects (Hungarian grammar, Hungarian literature, and mathematics). Our second primary variable is the students’ reading score, which is a grade-specific, competency-based test from the test-bank of the National Assessment of Basic Competencies (NABC) of the Hungarian Educational Authority.
Secondary outcomes
Students’ students’ grades for behavior (1); students’ self-control (2); students' self-reported reported school behavior (3); students' teacher-reported reported school behavior (4).

Cited by

No citation data available for this registration yet.

Keywords