The Impact of Formative Assessment of Behavior-Based Socioemotional Skills on Students' Outcomes in the Short and Long Run

How to cite

Calsamiglia, Caterina; Giorgi, Giacomo De; Yagman, Ece; Navarro-Sola, Laia. 2022. "The Impact of Formative Assessment of Behavior-Based Socioemotional Skills on Students' Outcomes in the Short and Long Run." AEA RCT Registry. AEARCTR-0010447. https://doi.org/10.1257/rct.10447-5.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Caterina Calsamiglia* , Giacomo De Giorgi , Ece Yagman , Laia Navarro-Sola

* Primary investigator

Registry ID
AEARCTR-0010447
DOI
https://doi.org/10.1257/rct.10447-5.0
First registered
Last updated
Status
On going
Trial dates
2022-11-07 – 2024-03-31
Countries
Spain (Catalunya)
Registry record
http://www.socialscienceregistry.org/trials/10447

Abstract

It is widely recognized that social and personal skills (i.e., perseverance, motivation, teamwork, etc.) are highly predictive of life achievements and long-term well-being, such as lower levels of school dropout, physical and mental health issues, and conflict. It is also well established that a comprehensive integration of these non-cognitive skills in the educational curriculum is essential to make lifetime progress.

The objective of this trial is to test the causal impact of training and mentoring teachers to integrate formative assessment of socioemotional skills in the classroom with the help of digital tools on students’ academic and non-cognitive outcomes. Formative assessment by the trained teachers involves the observation, recording, and provision of feedback on a specific set of behaviors, the so-called Pentabilities, that characterize socioemotional skills in active classroom environments. The teachers are given 5-6 months to implement the intervention. The trial involves 40 Catalan secondary schools that mainly serve at-risk populations.

Intervention

The intervention consists of training and mentoring teachers to integrate formative assessment of socioemotional skills into the existing curriculum with the help of digital tools.

Experimental design

The study is a clustered randomized controlled trial, where the unit of randomization is the grade level (i.e., 1st, 2nd, 3rd, and 4th ESO). The recruited sample is based on teachers voluntarily participating in the project with the support of their schools. In total, there are 85 grade levels across 40 schools in the Catalunya region recruited for the study. We randomly assigned 41 grade levels to control and 44 grades levels to the treatment group.

Design details

Randomization method
Randomization was performed using a computer code.
Randomization unit
The treatment is assigned at the grade level.
Clusters
Overall clusters of 85 grades, in 40 schools, with a total of potential study sample of 3,648 students and 98 teachers.
Observations
Typical class size of 20 students with 1.9 classes per grade per 85 grades amounts to 3,230 pupils. We have 85 grades, 1.9 classes in each grade, and a total of 40 schools in the study sample.
Arms
It is a Treatment vs. Control, single arm study. Treated/control pupils= 1,844/1,839 treated/control grades=44/41.
Primary outcomes
1) Behavior-based observational measures of socioemotional skills 2) Measure of awareness about socioemotional skills 2) Academic performance 3) Attendance
Partners
Name: Ministerio de Inclusión, Seguridad Social y Migraciones Partner_type: government Url: https://www.inclusion.gob.es/web/guest/home Name: Fundació Bofill Partner_type: ngo Url: https://fundaciobofill.cat/

Cited by

No citation data available for this registration yet.

Keywords