Reading Partners Evaluation
How to cite
Jacob, Robin. 2017. "Reading Partners Evaluation." AEA RCT Registry. AEARCTR-0001908. https://doi.org/10.1257/rct.1908-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
The Reading Partners program uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. Established in 1999 in East Menlo Park, California, Reading Partners' mission is to help children become lifelong readers by empowering communities to provide individualized instruction with measurable results. At each school, Reading Partners transforms a dedicated space into a "reading center," places a full-time team member on site to manage day-to-day operations, and recruits a corps of 40 to 100 community volunteers to work one-on-one with students in pull-out sessions during the school day or after school in kindergarten through grade 5.
In March 2011, Reading Partners received a three-year True North Fund investment of up to $3.5 million in grants from the Edna McConnell Clark Foundation and the Social Innovation Fund, matched by $3.5 million from True North Fund co-investors, to further expand its early-intervention literacy program to elementary schools throughout the country and evaluate its effectiveness. The evaluation was conducted by MDRC during the 2012-2013 school year in 19 schools in three states, with more than 1,100 students randomly assigned to the study's program and control groups. This evaluation included only students in grades 2 through 5.
Key Findings
-- Despite the myriad difficulties inherent in operating a program whose direct service providers are volunteers, Reading Partners was implemented in the schools with a relatively high degree of fidelity to the program model. On average, students in the study received approximately 1.5 tutoring sessions per week, and spent 28 weeks in the Reading Partners program.
-- Reading Partners had a positive and statistically significant impact on three different measures of student reading proficiency. These impacts are equivalent to approximately one and a half to two months of additional growth in reading proficiency among the program group relative to the control group and are robust across a range of student characteristic subgroups as well as across groups of students who had different levels of reading comprehension skills at the start of the study.
-- Reading Partners is a low-cost option for underresourced schools because a majority of the costs are in-kind contributions, primarily from community volunteers. On average, schools bear only about 20 percent ($710 per program group student) of the total cost of the resources required to implement the program, and over half of these costs are in-kind contributions of space and staff time from the school.
Intervention
The Reading Partners program uses community volunteers to provide one-on-one tutoring to struggling readers in underresourced elementary schools. At each school, Reading Partners transforms a dedicated space into a "reading center," places a full-time team member on site to manage day-to-day operations, and recruits a corps of 40 to 100 community volunteers to work one-on-one with students twice a week for 45 minutes each in pull-out sessions during the school day or after school in kindergarten through grade 5. (This evaluation included only students in grades 2 through 5.)
Experimental design
The impact study was designed to test the effect of the Reading Partners program on student reading proficiency -- that is, to determine whether the tutoring provided by the Reading Partners' volunteers increased the reading skills of the students who participated.
Although Reading Partners typically serves students in kindergarten through grade 5, the funding priorities of the granting institution, EMCF, typically focus on older children and adolescents. For that reason, the decision was made to include only second- through fifth-graders in this evaluation.
The sample for this study consists of 19 schools with Reading Partners reading centers that were recruited for the evaluation after Reading Partners senior staff identified them as potential participants. Only schools in which Reading Partners had been operating for at least one year before the study began were eligible, although the staff in these schools included both new and returning staff members. Schools were also eligible to participate only if Reading Partners anticipated that they would not be able to provide services to all the students who needed help with reading. This stipulation ensured that each program site was able to serve the same number of eligible students as it typically would, and did not deny services as a result of random assignment. A total of 31 schools were contacted during recruitment, and 19 of them joined the study. The 19 participating schools were spread across 12 school districts and 6 Reading Partners programmatic regions (New York City; Washington, DC; and, in California, East Bay, South Bay, Sacramento, and Los Angeles).
The study team used a systematic process to obtain and randomly assign the student sample at each school. At the start of the school year, schools and Reading Partners staff provided the study team with a list of students they wished to refer to the Reading Partners program, who had parental permission to participate in the program and the study. These lists were developed by individual schools and were based on a combination of test score review and recommendations by teachers or school staff (or both). Within two days of receiving the list, the study team randomly assigned students within schools (using a random number generator) to the program group that was eligible to participate in the Reading Partners program or to an "as is" control group that would not participate in Reading Partners but was eligible to receive any other supplemental reading services. A total of 1,265 students in the 19 participating schools were randomly assigned. Students were randomized within grade groups (grades 2 through 3 and grades 4 through 5) to ensure that equal numbers of upper and lower elementary school students were represented in the sample, since one of the research questions examines the differential impact of Reading Partners by grade level.
At the start of the school year, three assessments (SAT-10, TOWRE-2, AIMSweb) were given to all students in the study sample. The assessments measured reading comprehension, fluency, and sight word efficiency, all key components of early reading. These same three assessments were administered to students again in the spring, as close to the end of the school year as possible. In addition, in the spring of 2013, teachers were asked to complete a survey about the academic behavior and performance of each student in their classrooms who was part of the study sample (in both the program and control groups) and to report on the full range of supplemental reading services that each student had received during the school year.
Design details
Papers from this trial
- Jacob, Robin Tepper, Thomas J. Smith, Jacklyn Willard, Rachel E. Rifkin. 2014. Reading Partners: The Implementation and Effectiveness of a One-on-One Tutoring Program Delivered by Community Volunteers. New York: MDRC. http://www.mdrc.org/publication/reading-partners
- Jacob, Robin Tepper, Catherine Armstrong, and Jacklyn Altuna Willard, with A. Brooks Bowden and Yilin Pan. 2015. Mobilizing Volunteer Tutors to Improve Student Literacy: Implementation, Impacts, and Costs of the Reading Partners Program. New York: MDRC. http://www.mdrc.org/publication/mobilizing-volunteer-tutors-improve-student-literacy
Cited by
No citation data available for this registration yet.