Improving School Governance at Scale: A Randomized Evaluation of the Madhya Pradesh School Quality Assessment Program

How to cite

Muralidharan, Karthik; Singh, Abhijeet. 2016. "Improving School Governance at Scale: A Randomized Evaluation of the Madhya Pradesh School Quality Assessment Program." AEA RCT Registry. AEARCTR-0000851. https://doi.org/10.1257/rct.851-1.4000000000000001

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Karthik Muralidharan* , Abhijeet Singh

* Primary investigator

Registry ID
AEARCTR-0000851
DOI
https://doi.org/10.1257/rct.851-1.4000000000000001
First registered
Last updated
Status
Completed
Trial dates
2014-08-01 – 2016-07-31
Countries
India ()
Registry record
http://www.socialscienceregistry.org/trials/851

Abstract

Weak governance is a critical constraint in delivering quality education in developing countries. A recent review of a decade of education research in India concluded that “business as usual expansion in education spending is unlikely to yield improved outcomes without significant improvements in pedagogy and governance of the education system” (Muralidharan 2013). A striking indicator of weak governance in education in India is the high rate of teacher absence, estimated as 26.2% in 2003 and 23.6% in 2010, leading to an estimated fiscal cost of $1.5 billion annually (Muralidharan et. al. 2014).

We propose to conduct a randomized evaluation of one of the most ambitious recent attempts by a developing country government to improve education governance at scale. The Madhya Pradesh (MP) School Quality Assessment Program (MPSQA) – officially called the MP Shaala Gunwatta program – is a comprehensive attempt to improve school governance in the Indian state of MP and has been designed in a partnership between the Government of MP (GoMP), DFID, and Absolute Return for Kids (ARK). The program targets school governance directly through a combination of (a) regular monitoring of schools, (b) creation of school report cards, and a customized school improvement plan, (c) quarterly follow-ups on progress against this plan, and (d) the leveraging of ICT tools to collect and report real-time records of all assessment results, school improvement plans, and follow-ups to a dedicated online system. MPSQA was piloted and refined in a sample of 100 schools in 2013-14 (phase 1), and has been rolled out across 2,000 schools in the school year (2014-15) (phase 2). The Principal Investigators (PI’s) have worked with the project implementation team from ARK and GoMP and have successfully randomized the rollout of the program across ~2,000 schools in August 2014, to enable a credible evaluation of the MPSQA program on both school process outcomes and student learning outcomes.

The evaluation, with a sample of 534 schools (primary and secondary), will assess the effects of the program on key governance metrics (e.g. teacher absence) as well as student academic outcomes over a period of 18 months.

Intervention

The Madhya Pradesh (MP) School Quality Assessment (MPSQA) intervention is a comprehensive program that aims to improve school governance and outcomes through a combination of (a) regular monitoring of schools, (b) creation of school report cards, and a customized school improvement plan, (c) quarterly follow-ups on progress against this plan, and (d) leveraging of ICT tools to collect and report real-time records of all assessment results, school improvement plans, and follow-ups to a dedicated online system.

Experimental design

The randomization was conducted not at the level of an individual school, but at the level of an education “cluster” of around 40 schools (these clusters are referred to as a Jan Shiksha Kendra or a JSK).

Based on this design, we first drew a representative sample of 153 JSK’s out of a total of 308 JSK’s, across 29 blocks in 5 districts. We then randomized 51 of the 153 JSK’s into treatment status and 102 into control. Randomization was stratified within-block based on average school characteristics including previous year’s school-level assessment scores based on GoMP’s annual low-stakes measurement of learning. Treatment and control groups are balanced on key observables not just for means but also for distributions (tables available on request). A sample of 2 schools from each cluster was drawn, making it a total of 534 schools.

Design details

Randomization method
Randomization done in office by a computer.
Randomization unit
The first unit of randomization is the JSK (school cluster administrative unit) and the second level of randomization is school.
Clusters
153 JSKs and 534 Schools
Observations
534 schools, 2 classrooms observed and assessed per school (class size not pre-determined)
Arms
153 JSK treatment and 102 JSK control. 216 Treatment and 318 control schools
Primary outcomes
There are two kinds of outcome variables: a) Intermediate process variables at the school level, teacher level, and student level: Teacher absence and effort; the pedagogical practices adopted by teachers School infrastructure School management structures like monitoring mechanisms, feedback mechanisms between school headmaster and teachers. b)Student-level academic outcomes: These would be measured by test scores on customized tests designed by the evaluation team.

Cited by

No citation data available for this registration yet.

Keywords