The Impact of Khan Academy on proficiency and attitudes towards math: Experimental Evidence from Brazil

How to cite

Ferman, Bruno; LIMA, LYCIA SILVA E; Finamor, Lucas. 2017. "The Impact of Khan Academy on proficiency and attitudes towards math: Experimental Evidence from Brazil." AEA RCT Registry. AEARCTR-0002456. https://doi.org/10.1257/rct.2456-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Bruno Ferman* , LYCIA SILVA E LIMA , Lucas Finamor

* Primary investigator

Registry ID
AEARCTR-0002456
DOI
https://doi.org/10.1257/rct.2456-1.0
First registered
Last updated
Status
On going
Trial dates
2017-03-13 – 2018-12-21
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/2456

Abstract

Researchers will carry out a randomized evaluation in partnership with the Lemann Foundation to measure the impacts of the implementation and use of a math platform (Khan Academy) in a sample of Brazilian public schools on students' proficiency in math and attitudes towards math.

Intervention

The intervention is characterized by promoting the use of Khan Academy, an online platform which offers mathematics instructional videos and exercises in a personalized environment, during math classes, following the teachers' instructions. Math teachers of the grades allocated to treatment receive a one-day training to get familiar with the platform and explore their functionalities. All students allocated to treatment grades are assigned a username and password to access the platform. Schools that have less than 0.5 computer per student (irrespectively of treatment status) are granted new ones from the Lemann Foundation.

Experimental design

The study is composed by 166 primary education schools in the cities of Pelotas (30 schools), Manaus (64 schools), Barueri (25 schools), Mogi das Cruzes (30 schools) and Sao Bernando do Campo (17 schools), all of which have voluntarily applied to participate in the program.The randomization was undertaken in the beginning of the school year at grade level and was stratified in the schools' previous math scores at the national standard test (Prova Brasil). 3rd, 5th, 6th and 9th grades were eligible for receiving the treatment. Schools may receive one or two treated grades, depending on whether they offer only one or two cycles of primary education. Every school in the sample receives at least one treatment and one control grade. The evaluation will be focused on students in the 5th and 9th grades only, since for these students we will have a national exam based on which we will measure proficiency (Prova Brasil 2017). Follow-up data collection will ask about knowledge of the intervention to allow the analysis to potentially focus on subgroups with less contamination if necessary.

Design details

Randomization method
Randomization done in office by computer, carried out by team of researchers.
Randomization unit
School grade level
Clusters
166 schools with 229 school grades in the evaluation
Observations
14 000 students
Arms
There is only one treatment arm. All 166 schools have at least one treatment and one control grade, but only 5th and 9th grades are part of this evaluation. There is a total of 229 school grades in the evaluation. The 166 schools are divided into 88 schools of cycle 1(1st to 5th grades), 63 of cycles 1 and 2 (all grades) and 15 of cycle 2 (5th-9th grades). Among these, we have: Schools of cycle 1: 44 schools with treatment in 5th grade and 44 schools with control in 5th grade. Schools of cycle 1 and 2: 32 schools with treatment in 5th grade and control in 9th grade, 31 schools with control in 5th grade and treatment in 9th grade. Schools of cycle 2: 8 schools with treatment in 5th grade and 7 schools with control in 5th grade.
Primary outcomes
Students' proficiency in math (measured through the national standardized exam grades) and attitudes towards math

Cited by

No citation data available for this registration yet.

Keywords