After-School Khan Academy Program in Cape Town

How to cite

Crowley, Lucas; Burns, Justine; Bohmer, Bianca. 2013. "After-School Khan Academy Program in Cape Town." AEA RCT Registry. AEARCTR-0000104. https://doi.org/10.1257/rct.104-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lucas Crowley* , Justine Burns , Bianca Bohmer

* Primary investigator

Registry ID
AEARCTR-0000104
DOI
https://doi.org/10.1257/rct.104-2.0
First registered
Last updated
Status
On going
Trial dates
2013-01-19 – 2014-03-01
Countries
Private
JEL codes
C93, I21, I24
Registry record
http://www.socialscienceregistry.org/trials/104

Abstract

This is an evaluation of the Numeric after-school maths program for Grade 8 students from low-income areas around Cape Town, South Africa. The program, which takes place in school computer labs, uses the free online learning platform called Khan Academy. Globally, Khan Academy is a high-profile education tool, having delivered over 260 million video lessons as of August 2013. Numeric’s added value is the creation of an offline video browser which allows the organization to stream high quality video in a low (or no) bandwidth environment.

The evaluation is designed to test the ability of a computer-based intervention that uses large amounts of refined content (in the form of video lessons) and data-driven feedback to improve students’ maths performance. The evaluation takes place in a country that performs at or near the bottom of 8th grade math performance in the Trends in International Mathematics and Science Study (TIMSS) despite a relatively high level of public sector expenditure on education. If successful, the intention is for Numeric to increase the scale of its after-school programs.

The evaluation will use creative maths testing procedures to overcome the oft-cited problem in education research of low-stakes assessment tests actually measuring motivation rather than ability. The evaluation will also seek to identify the channels through which the program improves maths performance, thereby equipping education policymakers with valuable information on how to structure similar interventions. Finally, the evaluation will measure impacts on non-math outcomes, including a measure of nonverbal cognitive ability and computer literacy.

The evaluation team aims to register this trial prior to endline data collection, cleaning, and analysis.

Intervention

Numeric sessions run twice a week for 1.5 hours at a time during the course of the school year. The sessions are attended by Grade 8 students. The sessions are overseen by "coaches", most of whom are working towards a higher education degree. The sessions run immediately after school, in school computer labs. Students normally sit one to a computer. The sessions are not aligned with the South African curriculum. The focus is on improving numeracy. The sessions use online and offline versions of the Khan Academy program.

Experimental design

The study employs a student-level randomization, stratifying on school as well as above/below median baseline total math score. We also checked for balance on the math subsections listed above, gender, home computer access, and travel time to school. We re-randomized if the random assignment created unbalance in these measures.

Design details

Randomization method
Stata command
Randomization unit
Student
Clusters
Not applicable
Observations
472 students
Arms
236 treatment, 236 control
Primary outcomes
Use of Khan Academy, math test scores, other subject marks, general cognitive skills, computer skills, English language skills

Cited by

No citation data available for this registration yet.

Keywords