The effects of high-dosage tutoring at-scale on student outcomes.
How to cite
Kraft, Matthew. 2021. "The effects of high-dosage tutoring at-scale on student outcomes.." AEA RCT Registry. AEARCTR-0008233. https://doi.org/10.1257/rct.8233-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Although evaluations of tutoring programs find large effects on student achievement, few programs have been successfully implemented at-scale. We examine the effectiveness of a district-wide high-dosage tutoring initiative in a large urban school district that will serve 7,000 students by the end of the 2021-22 school year. Students participating in the program during the Fall 2021 semester will be paired with a teacher, paraprofessional, college student, or community volunteer and attend tutoring sessions 3 times per week for 30-45 minutes per session and on a recurring basis for 10 weeks. To determine the effectiveness of this tutoring program, we randomize 68 schools to either begin participation in the tutoring program in Fall 2021 or Spring 2022. We estimate the impacts of participating in this program in Fall 2021 on Fall semester achievement, attendance, and behavior outcomes.
Intervention
68 schools were chosen to either begin participation in a tutoring program in Fall 2021 or Spring 2022 at random. Schools assigned to treatment will begin participation in Fall 2021, between September 13th and September 24th. Control group schools will participate in the tutoring program in Spring 2022.
1st, 2nd, and 3rd grade students in the trial schools are eligible to participate in the trial if they score in the 15th-60th percentiles of the Spring 2021 reading assessment. 8th and 9th grade students in the trial schools are eligible to participate in the trial if they score in the 15th-60th percentiles of the Spring 2021 math assessment. 1st, 2nd, and 3rd grade students in the treatment schools will receive tutoring in reading while 8th and 9th grade students in the treatment schools will be tutored in math during the Fall 2021 semester.
Due to a rolling tutor recruitment approach as well as a limited supply of tutors, the school district will be entering eligible students into the student-tutor matching pool in batches from lowest to highest Spring 2021 test score percentile within each school until there are no more tutors. Specifically, we will start with students with the lowest test scores (at or above the 15th percentile) within each school and release blocks of students going up the test score distribution at each school until there are no more tutors left in the pool. In practice, this may mean that eligible students with higher Spring 2021 test scores will not be offered a tutor. Tutor recruitment will be ongoing until September 24th.
Students participating for tutoring will be assigned one of the following tutors: a district teacher, a district paraprofessional, or a volunteer that is background checked and trained. The volunteer tutor sources include: college undergraduates, graduate students, and business volunteers. Teacher/student ratios will be no more than 4:1, paraprofessional/student ratios will be no more than 2:1, and volunteer/student ratios will be 1:1. Tutoring will take place online during the student’s daily personalized learning time and the teacher/paraprofessional’s planning period.
All tutor/student pairs will meet for three sessions a week for 30-45 minutes per session and on a recurring basis for 10 weeks in each semester the school is participating in the program. Tutors will utilize a curriculum that contains daily lesson plans and practice problems that will drive the content of the tutoring sessions.
Experimental design
90 schools (13 high schools, 25 middle schools, and 52 elementary schools) were selected to participate in the 2021-22 high-dosage tutoring program. Target schools were identified by developing a model to rank each school based on need (as defined by Spring 2020 achievement scores and capacity to offer tutoring). Using the ranking as a prioritized list, the 90 schools with the highest need were selected for participation in the trial.
45 schools will start the tutoring program in Fall 2021 and 45 schools will start in Spring 2022. 16 schools with the highest need were selected to start in Fall 2021. 6 schools participating in another tutoring program were assigned to begin the program in Spring 2022. The other 68 schools that were randomly assigned to start the tutoring program in Fall 2021, the treatment, or beginning participation in Spring 2022, the control, using a blocked randomization design. We randomly assigned schools within school type, elementary, middle, or high school. In accordance with district goals, we used an unbalanced probability of assignment to treatment. 29 (43%) of schools were selected for treatment. 39 schools were selected for the control group (57%).
Design details
Cited by
No citation data available for this registration yet.