Evaluation of the Electronic Health Records Demonstration

How to cite

Moreno, Lorenzo. 2014. "Evaluation of the Electronic Health Records Demonstration." AEA RCT Registry. AEARCTR-0000241. https://doi.org/10.1257/rct.241-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Lorenzo Moreno*

* Primary investigator

Registry ID
AEARCTR-0000241
DOI
https://doi.org/10.1257/rct.241-2.0
First registered
Last updated
Status
Abandoned
Trial dates
2008-06-01 – 2011-08-01
Countries
Private
JEL codes
I110, J44, O33, O380
Registry record
http://www.socialscienceregistry.org/trials/241

Abstract

The Electronic Health Records Demonstration (EHRD), implemented by the Centers for Medicare & Medicaid Services (CMS), provided financial incentives to physician practices to use a certified EHR. Practices that met minimum EHR use requirements received payments on a graduated scale, increasing for more use of EHR functions.

The demonstration was implemented in four sites, targeting practices with 20 or fewer providers supplying primary care to at least 50 fee-for-service Medicare beneficiaries. The demonstration was expected to operate for five years (June 1, 2009–May 31, 2014), but was cancelled in August 2011 because 43% of the practices did not meet program requirements. The evaluation used a stratified, experimental design—412 treatment and 413 control practices—to estimate the impacts of the payments on adoption and use of EHR functionalities.

In June 2011, treatment group practices were, on average, 9 to 18 percentage points more likely than control group practices to report using 13 EHR functionalities queried at baseline (2008). The payments increased a summary score of EHR use, which ranged from 1 to 100, by more than 11 points on average relative to the control group (54 versus 43).

Moderate incentive payments did not lead to universal EHR adoption and use in a two-year time frame. However, the demonstration showed that incentives can influence physician use of EHRs. These results are encouraging regarding the potential effectiveness of the EHR Medicare Incentive Program but also suggest that meaningful use of EHRs on a national scale may take longer than anticipated.

Intervention

The demonstration targeted practices serving at least 50 traditional Fee-For-Service Medicare beneficiaries with certain chronic conditions for whom the practices provided primary care. Under the original design, primary care providers (physicians, and nurse practitioners and physician assistants that provide primary care) in practices with 20 or fewer providers were eligible to earn incentive payments for (1) using at least the minimum functions of a certified electronic health records systems (a systems payment, with increasing rewards for increasing use); (2) reporting 26 quality measures for congestive heart failure, coronary artery disease, diabetes, and preventive health services (a reporting payment); and (3) achieving specified standards on clinical performance measures during the demonstration period (a performance payment, with increasing rewards for better adherence to recommended care guidelines). All incentive payments under the demonstration were to be made in addition to the FFS Medicare payments practices receive for submitted claims. Physicians could have received up to $13,000 and practices up to $65,000 over the first two years of the demonstration. Due to the termination of the demonstration, the reporting and performance payments were never made; Centers for Medicare & Medicaid Services made only the systems payment for the first two years of the demonstration in fall 2010 and fall 2011, which totaled $4.5 million.

Experimental design

The EHRD evaluation used a stratified, experimental design to allocate 825 eligible practices that volunteered for the EHRD to treatment and control groups. This design was used to achieve balance on practice characteristics that are important predictors of adoption and use of electronic health records systems. In February 2009, practices from the four sites (Louisiana, Maryland/DC, Pennsylvania, and South Dakota) were randomized in equal proportions into treatment and control practices within strata, defined by site, number of primary care physicians, and whether the practice was in a medically underserved area.

Design details

Randomization method
Randomization was done in office by a computer with the use of the routine ralloc for STATA, written by Phillip Ryan. The code is available at: http://econpapers.repec.org/software/bocbocode/s319901.htm
Randomization unit
Physician practices
Clusters
825 practices
Observations
52,287 Medicare beneficiaries in the first year of the demonstraiton (for the analysis of the impact of the intervention on Medicare service use and expenditures))
Arms
412 practices receive financial incentives, 413 practices control
Primary outcomes
Key measures for the evaluation were practices’ adoption and use of EHRs and other health IT, and a summary (composite) score that quantifies EHR use for the calculation of the incentive payment, which were drawn from a web-based Office Systems Survey (OSS). Specific outcomes were: - Any EHR/Health IT Use - Electronic Patient Problem Lists - Automated Patient-Specific Alterts and Reminders - Electronic Disease-Specific Patient Registries - Patients' Email - Patient-Specific Educational Materials - Online Referrals to Other Providers - Laboratory Tests: * Online order entry * Online results viewing - Radiology Tests: * Online order entry * Online results viewing (reports and/or digintal films) - E-Prescribing: * Printing and/or faxing Rx * Online Rx transmission to pharmacy - Overall OSS score - OSS Score Domains: * Completeness of information in the EHR * Communication of care outside the practice * Clinical decision support * Increasing patient engagement * Medication safety

Papers from this trial

  1. Do Financial Incentives Increase the Use of Electronic Health Records? Findings from an Experiment http://www.mathematica-mpr.com/publications/PDFs/Health/EHR_Working_Paper.pdf

Cited by

No citation data available for this registration yet.

Keywords