Ed versus EdTech

How to cite

Loyalka, Prashant; Fairlie, Robert; Rozelle, Scott; Ma, Yue. 2018. "Ed versus EdTech." AEA RCT Registry. AEARCTR-0003086. https://doi.org/10.1257/rct.3086-2.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Prashant Loyalka* , Robert Fairlie , Scott Rozelle , Yue Ma

* Primary investigator

Registry ID
AEARCTR-0003086
DOI
https://doi.org/10.1257/rct.3086-2.2
First registered
Last updated
Status
On going
Trial dates
2017-10-11 – 2022-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/3086

Abstract

Computer assisted learning (CAL), online courses, MOOCs, and other forms of educational technology have been touted as revolutionizing the way in which students are educated. Of particular importance is the question of whether technology-based interventions can improve education for disadvantaged populations. Although EdTech is being rapidly deployed throughout the developed and developing world there is limited evidence on whether and how it affects academic outcomes. Ultimately, it is important to determine if EdTech has net effects relative to other, more traditional forms of instruction and learning. The purpose of our study is to examine whether and why CAL has a positive impact on student achievement in general but also relative to more traditional forms of supplemental learning (such as pencil and paper workbooks). To fulfill this purpose, we conduct an RCT involving more than 4,000 fourth to sixth grade schoolchildren that are boarding in 130 schools in rural China. The RCT includes three treatment arms: a supplemental CAL arm, a traditional supplemental learning (pencil and paper workbooks) arm, and a control arm. The supplemental learning offered by the first two treatment arms is the same in terms of time and content. The traditional supplemental learning arm serves as an additional comparison group (in addition to the control arm) to the supplemental CAL arm. With this design, we can estimate the effect of supplemental learning (CAL or workbook) in addition to the net effect of CAL (versus traditional learning) on student outcomes. Thus, we can test whether it is the “Ed” or the “Tech” in “EdTech” that makes a difference.

Experimental design

We designated each of 27 country-grades (9 counties and primary school grades 4-6) in our sample as strata or blocks. We then randomly allocated classes (one class per school-grade) within these strata to one of three different treatment conditions (T1 = Supplemental CAL, T2 = Supplemental Workbook, or C = Control):
A. Supplemental CAL (T1) 116 classes (in 88 schools)
B. Supplemental Workbook (T2) 118 classes (in 86 schools)
C. Control (C) 118 classes (in 85 schools)

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Class
Clusters
352 classes
Observations
Approximately 4,000 students
Arms
A. Supplemental CAL (T1) 116 classes (in 88 schools) B. Supplemental Workbook (T2) 118 classes (in 86 schools) C. Control (C) 118 classes (in 85 schools)
Primary outcomes
Student math achievement on 35 minute exam during endline survey
Secondary outcomes
Please see the pre-analysis plan document

Cited by

No citation data available for this registration yet.

Keywords