Delivering Remote Learning in Developing Countries using a Low-tech Solution – Bangladesh

How to cite

Islam, Asad; Glewwe, Paul; Sabarwal, Shwetlena; Rahman, Khandker Wahedur; Xia, Xing. 2022. "Delivering Remote Learning in Developing Countries using a Low-tech Solution – Bangladesh." AEA RCT Registry. AEARCTR-0010647. https://doi.org/10.1257/rct.10647-4.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Asad Islam* , Paul Glewwe , Shwetlena Sabarwal , Khandker Wahedur Rahman , Xing Xia

* Primary investigator

Registry ID
AEARCTR-0010647
DOI
https://doi.org/10.1257/rct.10647-4.2
First registered
Last updated
Status
On going
Trial dates
2022-07-03 – 2023-12-15
Countries
Private
JEL codes
I21, I24, I25, O15
Registry record
http://www.socialscienceregistry.org/trials/10647

Abstract

Learning losses resulting from school closures are among the most severe global challenges
to medium and long-term recovery from COVID-19. School closures in the first two years of
the pandemic lasted roughly twice as long in developing countries compared with advanced
economies. With the existing structural fault lines in its educational system, Bangladesh is staring at this catastrophe today after keeping their schools
closed continuously for a long period of time. This challenge is more acute among
candidates taking the end-of-secondary school exams. We have developed and adapted a
set of audio lessons (podcasts) to be delivered via the Interactive Voice Response (IVR)
system. IVR is an automated phone system technology that allows incoming callers to
access information via a voice response system of pre-recorded messages without having to
speak to an attendant (tutor), as well as to utilize menu options via keypad selection. The
intervention will set up an IVR-based toll-free line to deliver English and Mathematics
lessons to students who will take the SSC in 2024, (who will be in ninth grade during
the intervention). There will be weekly lesson plans for both subjects (Mathematics and
English) that will be accessible during the intervention period. The intervention will also
address issues related to students’ educational aspirations and hope. In a separate treatment
arm, students will also receive over-the-phone support from a tutor in addition to IVR-based
intervention. In this study, we examine whether providing remote learning opportunities through IVR improves children's learning, time spent on educational activities, hopes and aspirations.

Intervention

The intervention will test whether IVR will improve the grade-level learning of participating
students in Bangladesh. By offering content of different proficiency levels to the
secondary school students, the intervention will in effect offer a menu of choices so that
students can continue to learn more if they have current grade level proficiency or catch up
with the learning gap if they are behind their grade level. The study will conduct a
randomized control trial (RCT). RCT allows to avoid endogeneity issues and identify the
causal impact of the intervention. We will randomly assign 208 secondary schools into three
groups of equal size:
T1: Self-help group – At the beginning of the program, participants will be briefed by field
staff on how to access IVR-based lessons. Also, the field staff will explain how this program
could lead to better educational outcomes.
T2: Assisted group – Students in this group will get the same treatment as T1. In addition,
they will get a bi-weekly call from a tutor. These tutors will be hired from those within the local
community who have the required teaching skills. Students of T1 may face two constraints.
The first is lack of willpower: students may lack the motivation to use the lessons regularly.
The second is incomprehension: students may fail to understand some of the contents of the
one-way audio lessons. To counteract these two possible shortcomings, this additional bi-
weekly phone calls should increase participants’ motivation and resolve problems of not
understanding the lessons. These discussions will cover the content to be covered in our
modules.
T3: Control – No intervention will be provided.

Experimental design

This study uses an RCT to assess whether there is a causal link between the program and changes in outcomes. The evaluation of this employs a three-arm clustered RCT design (two treatment groups and one control group).
Randomization is done in 2 stages: We first pick 208 schools from a pre-existing list provided by our partner organizations. We then randomly distribute these 208 schools into the three study arms: T1 (self-help), T2 (assisted), and C (control).
T1 (self-help) and T2 (assisted) will have 69 schools each and Control will have 70 schools. From each school, we will randomly select 15 students on average to participate in the program. We will ensure that about half of the students are female when we randomly select the students to be treated from each treatment school.
The intervention contains three study arms:
a) T1: Self-help group (69 schools, 1058 students selected to receive treatment) –will only be provided with information on how to access IVR-based lessons and how this program could result in improved educational outcomes (such as higher marks on the SSC exams). Participants will receive regular text messages from the IVR system.
b) T2: Assisted group (69 schools, 1022 students selected to receive treatment) – Will receive the same information as students in T1. Additional treatment will be provided in the form of biweekly phone calls from a tutor. Participants will also receive regular text messages from the IVR system.
c) T3: Control (70 schools, 3201 students) - This group of students will not be receiving any intervention.

Design details

Randomization method
Randomization done in office by a computer using Stata/BE 17.0
Randomization unit
A two-stage randomization procedure will be employed. In particular, we first randomly assign 208 schools to two treatment groups and one control group, and then within each school we randomly select 15 students on average (in a way that ensures almost equal numbers of boys and girls) from each of the 208 schools (for treatment in the treatment schools, and for data collection in the control schools).
Clusters
208 Schools
Observations
9352 Students (which includes untreated students in treated schools)
Arms
T1: Self-help group: 69 schools (units of randomization), 1058 students selected for treatment (units of observation), 2260 students not selected for treatment (but data will be collected from these students) T2: Assisted group: 69 schools (units of randomization), 1022 students selected for treatment (units of observation), 1811 students not selected for treatment (but data will be collected from these students) Control: 70 schools (units of randomization), 3201 students (units of observation)
Primary outcomes
(1) Student Learning (2) Student’s Aspirations (3) Student’s Hopes (4) Student time spent on exam preparation

Cited by

No citation data available for this registration yet.

Keywords