The effects of high-dosage online tutoring on student outcomes.

How to cite

Kraft, Matthew. 2021. "The effects of high-dosage online tutoring on student outcomes.." AEA RCT Registry. AEARCTR-0008156. https://doi.org/10.1257/rct.8156-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Matthew Kraft*

* Primary investigator

Registry ID
AEARCTR-0008156
DOI
https://doi.org/10.1257/rct.8156-2.0
First registered
Last updated
Status
On going
Trial dates
2021-03-05 – 2022-03-31
Countries
Private
JEL codes
I20, I24
Registry record
http://www.socialscienceregistry.org/trials/8156

Abstract

While a large body of research finds that in-person tutoring increases student achievement, little evidence exists concerning the effectiveness of online tutoring. This experiment assesses the effectiveness of a pilot high-dosage online tutoring program in Metro Nashville Public Schools on student achievement and attendance. Students assigned to treatment were paired with a volunteer college student or community volunteer and attended online tutoring sessions 3 times per week lasting 45 minutes during the school day for 5 to 6 weeks with their tutor. Tutors worked with students on relationship building and provided personalized academic tutoring. We will examine the impacts of this program on student achievement, grades, attendance, and behavior outcomes. Additionally, we will determine whether high-dosage online tutoring was more effective when delivered while kids are attending school in person or while they are attending school remotely.

Intervention

Students assigned to Treatment were paired with a trained volunteer college student (108 tutors) or community volunteer (20 tutors). Students attended online tutoring sessions 3 times per week lasting 45 minutes during the school day for 5 to 6 weeks with their tutor. Tutors worked with students on relationship building and provided personalized academic tutoring. Tutoring sessions occurred during the student’s Personalized Learning Time (PLT) which is 50 minutes during each school day where students are individually assigned to a learning intervention determined by their academic and social development. Students assigned to Control attended PLT as usual.

Three schools participated in the trial, one elementary school, one middle school, and one high school. In the elementary school, students in grades 3, 4, and 5 participated in the trial. Students in grades 6 and 7 attending the middle school and students in 9th grade at the high school participated in the study. In the middle and high schools, math was the subject that was the focus of tutoring. In the elementary school, literacy was the focus of tutoring.

Experimental design

Students were randomly assigned to Treatment or Control using a blocked randomization design. We randomly assigned students within school-grade cells, stratifying by students self-reported intention of finishing the school year either in-person or remotely. 139 (50%) students were assigned to treatment and 139 (50%) students were assigned to Control.

Design details

Randomization method
Randomization done in office by a computer using Stata.
Randomization unit
Students
Clusters
278 students. 148 (53%) students attended school virtually, 111 (40%) students attended school in person, and 19 (7%) students did not state their modality.
Observations
278 students. 148 (53%) students attended school virtually, 111 (40%) students attended school in person, and 19 (7%) students did not state their modality.
Arms
139 (50%) students were assigned to treatment and 139 (50%) students were assigned to Control. Treatment compliance was not perfect. 7 students opted out of the program, 1 student left the program because of a move, and 2 students never showed up.
Primary outcomes
The primary outcomes are standardized test scores in the tutored subject (ELA or Math) measured using administrative data and course grades in tutored subjects. We believe the assessments will be the internal tests administered by the schools (e.g., MAP ELA and Math). We will also examine the state standardized test (e.g., Tennessee Comprehensive Assessment Program (TCAP/TNReady).
Secondary outcomes
• School attendance between the beginning of the intervention period and the end of the school year. • Number of behavior incidents between the beginning of the intervention period and the end of the school year.

Cited by

No citation data available for this registration yet.

Keywords