Arcipelago Educativo
How to cite
Azzolini, Davide; Burlacu, Sergiu; Simone, Gianfranco De; Romano, Barbara; Rettore, Enrico; Bazzoli, Martina. 2022. "Arcipelago Educativo." AEA RCT Registry. AEARCTR-0009958. https://doi.org/10.1257/rct.9958-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In an effort to attenuate the learning loss that likely occurs during summer vacation and to sustain the learning achievements of the most vulnerable students, summer learning programs aim to provide students with targeted learning support in-between two school years. Experimental evidence backing these programs mainly comes from studies conducted in the United States. Our study contributes to this literature by evaluating the 2022 edition of a summer learning program carried out in Italy. The program is called Arcipelago Educativo (trad. Educational Archipelago) and is run by Save the Children Italia with the support of Fondazione Agnelli. The program consists of two components – educational labs (88 hours) and small-group tutoring (12 hours), which are delivered from the second half of June through the first week of September 2022 in 11 sites located in 10 Italian cities in the North (Milano, Torino, Marghera), Center (Aprilia, Ancona) and South (Bari, Rosarno, Napoli, Palermo). Between May and June 2022, 1,035 students (of which 423 primary and 612 secondary students) were signaled by their schools as in need of learning support and agreed to participate in the study. After filling out a baseline survey, the students were randomly assigned to either the treatment or the control group. While the treatment group hase received access to the above described summer learning program, control group students receive access to a learning support program offered in fall after the beginning of the school year 2022/2023. The trial evaluates the effects of the program on student achievement, as measured through four standardized tests on text comprehension, grammar, arithmetic and geometry. The study also investigates the effects of the program on secondary outcomes, such as non-cognitive dimensions related to learning. Outcome data are collected through surveys administered at baseline and at follow-up (beginning of September 2022) in controlled environments.
Intervention
The 11 archipelagos were physically located in dedicated educational places that are known to students, in most cases the schools’ premises. The activities were arranged on a daily schedule and started on June 20 and lasted until September 9, with a break in August.
Regardless of some slightly different schedules across sites (three sites started on June 27 while one did not offer any intervention after August) all students assigned to an archipelago received two types of interventions, following a centrally defined protocol: educational labs (88 hours) and small-group tutoring (12 hours).
The educational labs, also called isole (trad. islands), were organized in groups of 10 students. The composition of the groups was established by the local educational staff, with the aim of supporting students’ learning and social development through peer education and cooperative learning. Whenever possible, the islands were built to ensure internal homogeneity in terms of age and educational level attended. The labs followed a ‘learning by playing’ methodology. Children were also able to participate in two educational trips in the area.
The small-group personalized support consisted of a tutoring activity for groups of two students and focused on the subjects or learning domains in which they reported major gaps (e.g., math skills, literacy skills, Italian L2). The study-pairs were constructed by matching children with similar specific educational needs.
Experimental design
At the beginning of May 2022, teachers from 17 schools in the ten cities referred 1,634 primary and secondary students in need of learning support to participate in the intervention. Referrals were made using a common grid including relevant students characteristics such as school grades, school absences, educational needs and a qualitative assessment of their material, relational and educational deprivation.
1,035 of these students and their parents accepted the participation in the study--including the random allocation rule to either the summer or the fall editions of the program--and signed a written informed consent document about data collection and treatment.
These students were randomly allocated to the treatment and the control group. Students assigned to the treatment group received an invitation to take part in the summer program, while control group students were automatically entitled to take part in the fall edition of the program.
To avoid having siblings assigned to different treatment conditions and the related problems of contamination of the control group, randomization was performed at the household level: hence siblings are either all in the treatment or in the control group.
Randomization was performed within strata, which were identified within each experimental site by the specific school institution and the educational level (primary or secondary) attended by students. In Italy, these two factors do not coincide because primary and secondary education are catered by the so called “Istituti Comprensivi” (trad. comprehensive schools).
Overall, the allocation ratio is .60 (cluster level: T = 579, C = 380). The randomization was performed in order to ensure that this ratio is the same in each stratum. Because of the small sample size of some strata and the need of ensuring the possibility of activating ‘islands’ of 10 students each, the actual ratio could differ across strata.
In order to mitigate the problems of refusals to participate in the summer program, a list of 'reserves' was randomly chosen from the control group (15%) taking into account the educational level (i.e., reflecting the proportions of subjects belonging to the two levels). In total, the identified reserves amounted to 61 students. This number was increased by 33 units in the very last days before the launch of the interventions to meet the demands of the local operators in some of the experimental sites, which were experiencing unexpected high rates of refusals.
Design details
Cited by
No citation data available for this registration yet.