Arcipelago Educativo

How to cite

Azzolini, Davide; Burlacu, Sergiu; Simone, Gianfranco De; Romano, Barbara; Rettore, Enrico; Bazzoli, Martina. 2022. "Arcipelago Educativo." AEA RCT Registry. AEARCTR-0009958. https://doi.org/10.1257/rct.9958-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Davide Azzolini* , Sergiu Burlacu , Gianfranco De Simone , Barbara Romano , Enrico Rettore , Martina Bazzoli

* Primary investigator

Registry ID
AEARCTR-0009958
DOI
https://doi.org/10.1257/rct.9958-1.0
First registered
Last updated
Status
On going
Trial dates
2022-05-02 – 2022-11-30
Countries
Private
Secondary IDs
I21, I24
Registry record
http://www.socialscienceregistry.org/trials/9958

Abstract

In an effort to attenuate the learning loss that likely occurs during summer vacation and to sustain the learning achievements of the most vulnerable students, summer learning programs aim to provide students with targeted learning support in-between two school years. Experimental evidence backing these programs mainly comes from studies conducted in the United States. Our study contributes to this literature by evaluating the 2022 edition of a summer learning program carried out in Italy. The program is called Arcipelago Educativo (trad. Educational Archipelago) and is run by Save the Children Italia with the support of Fondazione Agnelli. The program consists of two components – educational labs (88 hours) and small-group tutoring (12 hours), which are delivered from the second half of June through the first week of September 2022 in 11 sites located in 10 Italian cities in the North (Milano, Torino, Marghera), Center (Aprilia, Ancona) and South (Bari, Rosarno, Napoli, Palermo). Between May and June 2022, 1,035 students (of which 423 primary and 612 secondary students) were signaled by their schools as in need of learning support and agreed to participate in the study. After filling out a baseline survey, the students were randomly assigned to either the treatment or the control group. While the treatment group hase received access to the above described summer learning program, control group students receive access to a learning support program offered in fall after the beginning of the school year 2022/2023. The trial evaluates the effects of the program on student achievement, as measured through four standardized tests on text comprehension, grammar, arithmetic and geometry. The study also investigates the effects of the program on secondary outcomes, such as non-cognitive dimensions related to learning. Outcome data are collected through surveys administered at baseline and at follow-up (beginning of September 2022) in controlled environments.

Intervention

The 11 archipelagos were physically located in dedicated educational places that are known to students, in most cases the schools’ premises. The activities were arranged on a daily schedule and started on June 20 and lasted until September 9, with a break in August.

Regardless of some slightly different schedules across sites (three sites started on June 27 while one did not offer any intervention after August) all students assigned to an archipelago received two types of interventions, following a centrally defined protocol: educational labs (88 hours) and small-group tutoring (12 hours).

The educational labs, also called isole (trad. islands), were organized in groups of 10 students. The composition of the groups was established by the local educational staff, with the aim of supporting students’ learning and social development through peer education and cooperative learning. Whenever possible, the islands were built to ensure internal homogeneity in terms of age and educational level attended. The labs followed a ‘learning by playing’ methodology. Children were also able to participate in two educational trips in the area.

The small-group personalized support consisted of a tutoring activity for groups of two students and focused on the subjects or learning domains in which they reported major gaps (e.g., math skills, literacy skills, Italian L2). The study-pairs were constructed by matching children with similar specific educational needs.

Experimental design

At the beginning of May 2022, teachers from 17 schools in the ten cities referred 1,634 primary and secondary students in need of learning support to participate in the intervention. Referrals were made using a common grid including relevant students characteristics such as school grades, school absences, educational needs and a qualitative assessment of their material, relational and educational deprivation.

1,035 of these students and their parents accepted the participation in the study--including the random allocation rule to either the summer or the fall editions of the program--and signed a written informed consent document about data collection and treatment.

These students were randomly allocated to the treatment and the control group. Students assigned to the treatment group received an invitation to take part in the summer program, while control group students were automatically entitled to take part in the fall edition of the program.

To avoid having siblings assigned to different treatment conditions and the related problems of contamination of the control group, randomization was performed at the household level: hence siblings are either all in the treatment or in the control group.

Randomization was performed within strata, which were identified within each experimental site by the specific school institution and the educational level (primary or secondary) attended by students. In Italy, these two factors do not coincide because primary and secondary education are catered by the so called “Istituti Comprensivi” (trad. comprehensive schools).

Overall, the allocation ratio is .60 (cluster level: T = 579, C = 380). The randomization was performed in order to ensure that this ratio is the same in each stratum. Because of the small sample size of some strata and the need of ensuring the possibility of activating ‘islands’ of 10 students each, the actual ratio could differ across strata.

In order to mitigate the problems of refusals to participate in the summer program, a list of 'reserves' was randomly chosen from the control group (15%) taking into account the educational level (i.e., reflecting the proportions of subjects belonging to the two levels). In total, the identified reserves amounted to 61 students. This number was increased by 33 units in the very last days before the launch of the interventions to meet the demands of the local operators in some of the experimental sites, which were experiencing unexpected high rates of refusals.

Design details

Randomization method
Randomization is done using the statistical package R. To improve statistical precision, a stratified randomization design is implemented. Two variables are used in the stratified randomization procedure: the specific school institution and the educational level (primary or secondary) attended by students.
Randomization unit
The unit of randomization is the family, hence siblings are either all in the treatment or in the control group.
Clusters
Clusters (families): 961 (T = 580, C = 381)
Observations
Students: 1,035 (T = 627; C= 408)
Arms
Treatment = 580 families; Control = 381 families
Primary outcomes
By means of education level specific tests, we observe cognitive achievements in the following areas: reading (comprehension of written texts); grammar; arithmetic; geometry. The tests are administered with the supervision of the local educational staff involved in the project. In 10 experimental sites, the follow-up tests are administered in the last week of the summer program for treated students and the week after (i.e. the first week of the new school year) for control group students and treated students who dropped out. In one experimental site, the followup tests are administered jointly for all students during the first two weeks of school. In both cases, the educational spaces and the staff involved are the same, in order not to alter the environmental conditions, which may affect the way students respond to the tests. Students with ‘special needs’ (as referred by school teachers) take slightly simplified versions of the tests.
Secondary outcomes
We use a self-reported questionnaire with validated scales to observe non-cognitive dimensions related to learning: Ability self-concepts and Intrinsic values (Math, Language); Subjective task values (all subjects); Grit: Consistency of interest, Perseverance of effort; Adaptive learning: Mastery goal orientation, Performance-approach goal orientation, Performance-avoid goal orientation; Intrinsic and extrinsic motivation towards studying; Resilience. The non-cognitive tests are administered following the same schedule and protocol of the cognitive tests.

Cited by

No citation data available for this registration yet.

Keywords