Teachers, Tutors, and Technology: A New Recipe for Facilitating Personalized Learning

How to cite

Oreopoulos, Philip. 2023. "Teachers, Tutors, and Technology: A New Recipe for Facilitating Personalized Learning." AEA RCT Registry. AEARCTR-0011639. https://doi.org/10.1257/rct.11639-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Philip Oreopoulos*

* Primary investigator

Registry ID
AEARCTR-0011639
DOI
https://doi.org/10.1257/rct.11639-1.0
First registered
Last updated
Status
In development
Trial dates
2023-09-04 – 2024-09-30
Countries
Private
JEL codes
I2
Registry record
http://www.socialscienceregistry.org/trials/11639

Abstract

Tutoring is one of the most effective policies for improving education but is often impractical because of scalability and cost constraints. One solution is to teach teachers to utilize more effectively Computer Assisted Learning (CAL) for simulating the tutoring experience at low cost. A recent evaluation of this approach (called Khoaching with Khan Academy) showed that elementary students with teachers randomly selected to receive this assistance did significantly better on standardized math test scores compared to students with teachers that did not receive the help. While successful in raising average performance, the study also revealed wide variance in CAL practice time within and across treated classrooms. A free after-school virtual tutoring program is proposed to further help this smaller subset of low-practicing students. Teachers will randomly invite parents of these children to receive weekly supervised CAL practice at home (through Khan Academy’s sister organization, Schoolhouse.World). It is expected that integrating CAL time during school, supervised by teachers, with CAL time after school, supervised by tutors, will substantially increase personalized learning and performance among students most in need of individualized help.

Intervention

With support form superintendents of the Toronto District School Board, invitations will be sent to Grades 5-9 math teachers to participate in the experiment. All teachers will be assigned a khoach and participate in the regular KWiK program. The randomized tutoring component will happen concurrently from the third of week of school onwards. Among the lowest ~10 practicing students, approximately five students from each class will be randomly selected for the treatment group, offering them free virtual tutoring sessions once a week as an extra effort to improve their performance. Teachers will email parents of selected students to consider participating in the tutoring component of the program, with the student meeting once a week throughout the school year. The email will contain a special link to the program, housed at Schoohouse World. Schoolhouse is Khan Academy’s sister organization that offers free online volunteer tutoring using volunteers from around the world. Selected students will either be assigned a group tutoring session or a one-on-one tutoring session.

The primary objective of the tutoring sessions is to create a supportive learning environment where students can receive assistance in completing their current assignments. Typically, when students come to the sessions, they have already completed one or two out of their three current assignments, as they are given dedicated time to work on Khan Academy during class. However, some students may progress at a slower pace or require guidance, particularly if they have weaker foundations in math. Tutors are trained to prioritize the use of Khan Academy resources, such as hints, videos, and articles, instead of directly teaching or providing answers. If a student requires additional guidance, the tutor encourages them to start over in order to demonstrate their understanding and gain more practice. If a student has already completed all their current assignments before the tutoring session, tutors will assist the student in completing past exercises.

At the end of each session, the tutor will encourage the student to choose a past assignment to complete independently before the start of their next session. This practice is intended to promote accountability and foster independent learning in math. The overall goal of the tutoring program is to help students become confident, independent math learners, leading to positive long-term learning progress.

Experimental design

With support form superintendents of the Toronto District School Board, invitations will be sent to Grades 5-9 math teachers to participate in the experiment. All teachers will be assigned a khoach and participate in the regular KWiK program. The randomized tutoring component will happen concurrently from the third of week of school onwards. Among the lowest ~10 practicing students, approximately five students from each class will be randomly selected for the treatment group, offering them free virtual tutoring sessions once a week as an extra effort to improve their performance. Teachers will email parents of selected students to consider participating in the tutoring component of the program, with the student meeting once a week throughout the school year. The email will contain a special link to the program, housed at Schoohouse World. Schoolhouse is Khan Academy’s sister organization that offers free online volunteer tutoring using volunteers from around the world. Selected students will either be assigned a group tutoring session or a one-on-one tutoring session.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
student
Clusters
no clusters
Observations
Target is 1500 students
Arms
750 control, 325 one on one tutoirng, 325 group tutoring
Primary outcomes
Academic assessments (math grades in particular), and if possible survey data on attitudes towards school and mathematics subjects.

Cited by

No citation data available for this registration yet.

Keywords