Using Phone-Based Assessments (PBA) to Provide Actionable Learning Outcomes Data to Policymakers

How to cite

Gupta, Saloni. 2023. "Using Phone-Based Assessments (PBA) to Provide Actionable Learning Outcomes Data to Policymakers." AEA RCT Registry. AEARCTR-0011368. https://doi.org/10.1257/rct.11368-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Saloni Gupta*

* Primary investigator

Registry ID
AEARCTR-0011368
DOI
https://doi.org/10.1257/rct.11368-1.0
First registered
Last updated
Status
In development
Trial dates
2023-05-01 – 2023-06-01
Countries
India (Uttar Pradesh)
JEL codes
I210 I250 I280 O350
Registry record
http://www.socialscienceregistry.org/trials/11368

Abstract

This research project aims to conduct a subsequent pilot of phone-based assessments (PBA) in one district of Uttar Pradesh. These PBA will be conducted with a sample of 500 students in the district of Rae Bareli.

Intervention

The main focus of building foundational literacy and numeracy is during the early grades of primary schooling, i.e., up to Grade 3. These grades build the “foundational” skills for later grades. Research suggests that after Grade 3, the gaps in learning outcomes start widening, making even remediation difficult later as these gaps lead to multi-level classrooms in subsequent grades. Therefore, the state government of Uttar Pradesh wants to use phone-based assessments to achieve universal foundational literacy and numeracy by ensuring that students meet grade-level requirements by Grade 3.

The state government of Uttar Pradesh will provide a sufficiently large sample of the phone number of students, without any other personal identification information. The call center agency hired by Central Square Foundation will call 3000 phone numbers out of that sample to collect some basic demographic information and gather consent from parents for phone assessments. Finally, 500 students who make a representative sample with respect to state census data will be assessed on phone-based assessments.

These Grade 3 students will be surveyed on the phone where they will be answering questions related to literacy (in their mother tongue, Hindi) and numeracy

Experimental design

A representative sample of students selected randomly from the state student population will be assessed on phone and in-person assessments. They will also be compared to outcomes reported by assessments conducted at the local district and block levels.

Design details

Randomization method
Randomization is done using Stata Statistical Software
Randomization unit
Student (individual randomization)
Clusters
227 strata established using DISE data on school infrastructure so that students from all kinds of schools (for example - one with electricity and no electricity or pucca wall or no pucca wall) are well-represented. This is to ensure that the outcomes reported are representative at the state-level.
Observations
500
Arms
500 students, 2 students per strata
Primary outcomes
Literacy and Numeracy Scores of Phone-Based Assessments (in comparison to in-person assessments) across three modes (WhatsApp, SMS, Textbook) Representativeness of student population and attrition
Partners
Name: Central Square Foundation Partner_type: private_company Url: https://www.centralsquarefoundation.org/ Name: Uttar Pradesh Department of Education Partner_type: government Url: https://basiceducation.up.gov.in/en

Cited by

No citation data available for this registration yet.

Keywords