OpenTeQ - Opening the black box of Teacher Quality

How to cite

Argentin, Gianluca. 2017. "OpenTeQ - Opening the black box of Teacher Quality." AEA RCT Registry. AEARCTR-0001638. https://doi.org/10.1257/rct.1638-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Gianluca Argentin*

* Primary investigator

Registry ID
AEARCTR-0001638
DOI
https://doi.org/10.1257/rct.1638-1.0
First registered
Last updated
Status
On going
Trial dates
2016-03-01 – 2018-09-22
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/1638

Abstract

The quality of the teaching force is the key factor explaining the success of educational systems. We know that teachers differ widely regarding their impact on student achievement, but previous research failed in finding the sources of this variation. Educational economists consider teacher quality as a valuable and measurable feature, but they are not able to explain what generates it. Sociologists identify teacher quality as the consequence of individual and contextual characteristics. Pedagogies interpret it as a multidimensional concept and look at teaching practices and styles in daily classroom routines. This project wants to pool together these three perspectives. We argue that educational economists fail to explain the differences in teacher effectiveness because they look at teachers characteristics that are too far from the dynamic nature of teaching/learning process and because they do not consider the role played by contextual factors.

To prove the relevance of teacher relational skills in explaining the "mysterious" teacher quality, we are building up a collection of the best available tips to improve teacher relational skills, looking for them through international and national literature review and in depth interviews. More precisely, we producing a booklet facing six issues that teachers are called to face related to their relational skills. Each issue is treated not only in the booklet, but also with a very short video. We offered these tips to teachers in a sample of 100 lower secondary schools, randomized out of 198. Teacher used our booklet in the school year 2016/17 and, in within an action-research framework, we discuss the booklet and videos with them through registries on a platform.

We enrolled 198 lower secondary schools in 11 provinces (aggregated in 8 randomization blocks). An external researcher randomized school in the branches: two treatment groups and one control group.
The two treatment branches differ in the treatment delivery: in the first 50 schools the booklet was delivered individually only to Math and Italian teachers; in the last 50 schools, the booklet was delivered in a colletive meeting to all teachers in the school. The control group schools, randomly selected, will simply receive our intervention later, in spring 2018.

The RCT is designed in order to test the impact of our booklet on:
- teachers' well-being (in the short run, at the end of the first school year - CATI interviews)
- students' well-being (in the short run, at the end of the first school year - questionnaires only for 7th graders, due to budget constraints)
- students' achievement (in the short run, at the end of the first school year, and in the long run, at the end of the following school year - administrative data).
In addition, we want to test whether individual or collective delivery changes the intervention take up rate and its effectiveness.

Intervention

The intervention is a professional development tool for teachers, enhaning their relational skills trough:
- a 30 pages booklet containing a collection of the best available tips to improve teacher relational skills, orgnanized in six issues that teachers are called to face daily (hoe to collaborate with colleagues; how to get a collaborative class climate; how to engage students; how to increase students' attention; how to handle troubling students; wow to establish positive relations with parents). The tips were collected both in scientific and grey literature and the booklet was validated through a Delphi process;
- access to a platform containing 1 introductory video and 6 contents video, treating each one a booklet issue;
- a registry were teachers interested in getting a certification were called to express their opinions about the tips and report their usage of the booklet contents.

Experimental design

We enrolled 198 lower secondary schools in 11 provinces (aggregated in 8 randomization blocks).
An external researcher randomized school in the branches whithin each block: two treatment groups (100 schools) and one control group (98 schools).
The two treatment branches differ in the treatment delivery:
- in the first 50 schools the booklet was delivered individually only to Math and Italian teachers;
- in the last 50 schools, the booklet was delivered in a colletive meeting to all teachers in the school. The control group schools, randomly selected, will simply receive our intervention later, in spring 2018.

Design details

Randomization method
Randomization done in office by a computer, by a researcher external to the project staff (Giovanni Abbiati - IRVAPP, abbiati@irvapp.it
Randomization unit
schools (whithin blocks)
Clusters
198 schools whithin 8 blocks
Observations
around 2.200 teachers teaching Math or Italian to 7th graders around 24.000 students for each grade (6th, 7th, 8th)
Arms
50 schools individual treatment 50 schools collective treatment 98 schools control
Primary outcomes
In the short term (at the end of the first school year) - teachers' well-being (measured through CATI interviews ) - students' well-being (measured through delf-administered questionnaires only for 7th graders, due to budget constraints) - students' achievement (administrative data on students' marks). In the long run (at the end of the following school years): - students' achievement (administrative data on students' marks) - students' performance in National standardized assessment (administrative data on students INVALSI test).

Cited by

No citation data available for this registration yet.

Keywords