Layering Technology to Boost Impact: Can Phone Calls Boost the Effectiveness of TV-based instruction?
How to cite
Biswas, Kumar; Sabarwal, Shwetlena; Evans, David; Fehrler, Sebastian. 2020. "Layering Technology to Boost Impact: Can Phone Calls Boost the Effectiveness of TV-based instruction?." AEA RCT Registry. AEARCTR-0006008. https://doi.org/10.1257/rct.6008-1.2
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Schools at all levels have been closed across much of the world due to Covid-19. This situation poses a significant threat to student learning, attachment to schools, and their mental health. To minimize the loss of school days, many governments are implementing distance learning programs through radio or TV in the developing countries. The Government of Bangladesh (GoB) has started broadcasting pre-recorded classes through a designated TV channel (Sangsad TV) from 29 March 2020 for secondary students (grades 6-10) . The program titled ‘My school at home’ will run each day from 9:00 am to 12:00 pm broadcasting classes on different subjects for each grade.
While it is possible for TV/radio-based distance learning to be effective, many of the challenges of in-person education (such as student engagement and reaching students at their level) are exacerbated with distance learning. We therefore propose to test an intervention with SMS and phone call-based reminder of TV broadcast, and another intervention with incentives based on weekly quizzes along with SMS and phone call-based reminder, to improve student’s engagement and learning from the TV-based distance learning in Bangladesh. The impact evaluation will focus on assessing whether in the treatment groups students’ engagement with the TV-based learning and performance are on average better than the students in the control group using baseline and endline data.
Intervention
To minimize the loss of school days, the Government of Bangladesh (GoB) has started broadcasting pre-recorded classes through a designated TV channel (Sangsad TV) from 29 March 2020 for secondary students (grades 6-10). The program titled ‘My school at home’ will run each day from 9:00 am to 12:00 pm broadcasting classes on different subjects for each grade. We plan to assess impact of two treatment groups where Treatment 1 involves nudging of parents and students via weekly SMS message and phones call to watch TV lessons. Treatment 2 also engages students directly through quizzes and incentives beside nudging.
Treatment group 1: Parents receive weekly text message and phone call as reminder for their children to participate in the TV broadcasts. Students receive weekly phone calls as reminder of the weekly TV broadcasts.
Treatment group 2: Beside text messages and phone calls to parents and only phone calls to students as reminder, students will also participate in weekly quizzes covering some of the broadcast content. Based on the student’s performance, student's parent will receive a phone top-up of BDT 100 and student will receive a certificate from the Secondary Education Development Program. When school reopens, Secondary Education Development Program will also produce a documentary where best performing students will be invited to participate.
Because surveying households at baseline to assess engagement is itself a form of nudge treatment, we propose two control groups. One, the “basic control group,” will receive a baseline call (where we will gather basic covariates) and participate in the endline assessment. The other, a “pure control group,” will not participate in the baseline, but will only be assessed at the endline, relying on random assignment for comparability.
Experimental design
At first, we will administer a pre-baseline of randomly selected 10,000-15,000 grade 9 students from Dhaka and Mymensingh division, from the list of stipend recipient from the government to identify students who have access to the broadcasting channel "Sangshad TV". From them, we will randomly select 1,500 students for the intervention dividing the students equally into 3 groups: 1 control and 2 treatment groups. We will also administer a baseline survey of randomly selected 500 students from the students who do not have access to "Sangshad TV".
For "pure control group", we will randomly select 500 grade 9 students from Dhaka and Mymensingh division, from the remaining stipend recipients from the government (excluding only the students who have already participated in the pre-baseline).
Design details
Cited by
No citation data available for this registration yet.