Kenya Patient Safety Impact Evaluation

How to cite

Das, Jishnu; Bedoya, Guadalupe. 2018. "Kenya Patient Safety Impact Evaluation." AEA RCT Registry. AEARCTR-0001001. https://doi.org/10.1257/rct.1001-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jishnu Das* , Guadalupe Bedoya

* Primary investigator

Registry ID
AEARCTR-0001001
DOI
https://doi.org/10.1257/rct.1001-1.0
First registered
Last updated
Status
On going
Trial dates
2015-04-01 – 2019-03-29
Countries
Private
JEL codes
Regulation, Analysis of Health Care Markets
Registry record
http://www.socialscienceregistry.org/trials/1001

Abstract

This study evaluates the impact of accountability mechanisms–through different models of health inspections–on quality of care and patient safety, quantity, and prices of health services in Kenya. Using health markets as the unit of intervention (clusters of health facilities where no facility is more than 4 KM from the center of the market), we experimentally allocate all private and public health facilities in three Kenyan counties to one of three arms: (1) high-intensity inspections with enforcement of warnings and sanctions for non-compliant facilities; (2) high-intensity inspections with enforcement of warnings and sanctions for non-compliant facilities and public disclosure of inspection results, and (3) “business-as-usual” low-probability inspections (the control group). The results from this study will contribute to understanding the extent to which governance and accountability mechanisms can help improve service delivery in low-income countries, particularly in this case related to improving patient safety and quality of care in the public and private sectors, and if so, how these systems may operate when they are implemented “at scale.” Another important contribution of this project is the development of a set of tools and instruments that can be broadly deployed both in surveys of quality and in the design of inspection systems across diverse low-income settings.

Intervention

1272 health facilities in three Kenyan counties–Kakamega, Kilifi and Meru–are experimentally allocated to three arms: (1) high-intensity inspections with enforcement of warnings and sanctions for non-compliant facilities; (2) high-intensity inspections with enforcement of warnings and sanctions for non-compliant facilities and public disclosure of inspection results; and (3) “business-as-usual” low-probability inspections (the control group).

The new regulatory framework used for this experiment was developed previous to the implementation of these pilots including: (A) a refined Joint Health Inspections Checklist (henceforth Checklist) that is easy to deploy and is focused on the fundamentals of patient safety; (B) a scoring system that allows facilities to be categorized according to the level of risk presented to patients; (C) scores that trigger warnings and sanctions to be enforced according to a facility’s level of risk.

Treatment 1 - High-intensity inspections: Every facility in this treatment group will be inspected using a checklist of safety standards that was developed in consensus and refined over 3 years. The health facilities will receive a copy of the Checklist and will be warned or sanctioned according to their risk performance.

Treatment 2 - High-intensity inspections and public disclosure of patient safety performance: Every facility in this treatment group will be inspected as in treatment 1. Following the inspection, facilities will be assigned a letter-grade to be prominently posted outside the health facility. The health facilities will receive a copy of the Checklist results with details on their assessment and grade. A campaign introducing patients to the grading system will be included as part of the accountability system.

Control - “Business-as-usual” health inspections: Health facilities in this group will operate under the current regime for health inspections, which results in inspections less than 4% of the time. These facilities did not receive routine inspections during the implementation period.

Experimental design

We use an stratified cluster randomized experimental design to estimate the causal impact of the interventions at the facility level, where the clusters are markets of health facilities (where facilities are within 4 km from the market center) and stratification happens at the market size and county level. We experimentally allocate around 273 markets and all facilities (around 1,272) in each market in the three evaluation counties to one of the three accountability systems (treatment 1, 2 and control). We will also present results at the market level. For this analysis, this is an stratified random experimental design where the unit of analysis is the same as the unit of randomization.

Design details

Randomization method
Randomization done in office by a computer.
Randomization unit
Market of health facilities
Clusters
273 markets of health facilities
Observations
273 markets of health facilities, 1,272 health facilities
Arms
Treatment 1: 90 markets, 388 health facilities Treatment 2: 96 markets, 473 health facilities Control: 87 markets, 411 health facilities
Primary outcomes
We examine the impact of the intervention on a triad of outcome groups that are important in settings with public and private providers: Quality of care and Patient Safety, Quantity and Prices. Quality and Patient Safety will be measured through three main indicators that gauge diverse dimensions of quality and patient safety at different points in the continuum of the health care chain: (1) Adherence to a Checklist developed by the regulators and that includes indicators of quality and patient safety related to protocols, infrastructure, and equipment at the health facility level; (2) Adherence to patient safety practices related to infection prevention and control; (3) Adherence to case-specific checklists of essential and recommended care for four medical cases (subject to budget availability). Quantity (demand) of care services will be measured through patient flow records from health facilities and administrative data, and prices will be measured through patient exit surveys.

Cited by

No citation data available for this registration yet.

Keywords