Testing Digital Literacy Interventions for Improving the Ability to Spot Misinformation Online: Evidence from a Large-Scale, Multi-Arm RCT in India

How to cite

Loyalka, Prashant. 2022. "Testing Digital Literacy Interventions for Improving the Ability to Spot Misinformation Online: Evidence from a Large-Scale, Multi-Arm RCT in India." AEA RCT Registry. AEARCTR-0010652. https://doi.org/10.1257/rct.10652-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Prashant Loyalka*

* Primary investigator

Registry ID
AEARCTR-0010652
DOI
https://doi.org/10.1257/rct.10652-1.0
First registered
Last updated
Status
On going
Trial dates
2022-11-07 – 2024-12-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/10652

Abstract

While the digital revolution has greatly enhanced access to information for millions, it has simultaneously allowed unscrupulous state and non-state actors to spread misinformation online. Youth are particularly vulnerable to misinformation online or ‘fake news’. Even though they are digital natives, recent research shows that a majority of them cannot distinguish between “sponsored content” and real news. A lack of ability to evaluate information and news online (digital literacy skills) among youth puts them at risk of being misled—this can have adverse impacts on societies worldwide. Previous digital literacy interventions have mostly made students skeptical of all news, rather than discerning news consumers. Considering this global threat—and previous efforts to address digital literacy—we explore strategies that improve digital literacy skills. Specifically, we test the effectiveness of various programs designed to improve digital literacy skills by conducting a large-scale randomized controlled trial with approximately 5,000 low and middle-income youth in 400 classrooms in India. The study thus hopes to shed light on means to help youth navigate information in the digital age and, in the process, strengthen society by ensuring that future citizens can identify trustworthy information about social and political issues.

Experimental design

For the purposes of this study, we focus on approximately 5,000 students in 400 classrooms. The classrooms of students will be randomly assigned to one of four treatment conditions in a 2X2 experimental design in which a skills-based training program intervention is cross-cut with a values-based intervention.

The experiment takes place in four stages. First, students fill out a baseline survey. Students also take a digital literacy test with scenario-based items that assess skills in assessing the veracity of online information. Second, after the baseline survey, the 400 classrooms are randomized with equal probability to one of four conditions: (a) a control group; (b) the skills-based program intervention; (c) the values-based program intervention; (d) both the skills-based and values-based program interventions. Third, approximately 10 days after the interventions are completed, students will take an endline survey. Similar to the baseline, students will also complete a digital literacy test with scenario-based items.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
classrooms
Clusters
400
Observations
5000
Arms
100 per arm
Primary outcomes
Data on the primary outcome measure (digital literacy score, z-scored using the mean and standard deviation of the control group at endline) will be collected at endline.

Cited by

No citation data available for this registration yet.

Keywords