Evaluating the Rollout of Estonia's Enhanced Care Management System

How to cite

Daniels, Benjamin; Croke, Kevin; Rogger, Daniel. 2019. "Evaluating the Rollout of Estonia's Enhanced Care Management System." AEA RCT Registry. AEARCTR-0003661. https://doi.org/10.1257/rct.3661-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Benjamin Daniels* , Kevin Croke , Daniel Rogger

* Primary investigator

Registry ID
AEARCTR-0003661
DOI
https://doi.org/10.1257/rct.3661-2.0
First registered
Last updated
Status
Completed
Trial dates
2018-12-03 – 2023-12-31
Countries
Estonia ()
JEL codes
H510, I130, I180
Registry record
http://www.socialscienceregistry.org/trials/3661

Abstract

The Enhanced Care Management intervention consists of training and coaching doctors to develop care plans and undertake targeted outreach to the subset of patients who are at high risk of experiencing deteriorating health so to increase their utilization of health services. The goal is to extend the use of preventive care, which improves patient health and reduces the need for curative medical services. ECM includes heightened tracking of tests and referrals, follow up after hospital discharges, tracking medication adherence, monitoring between clinic visits, and a focus on achieving clinical quality. It includes four elements: identification of high risk patients through risk stratification, development of care management plans by the primary care physician, proactively linking care providers together, and developing a team approach with patients and their caregivers. ECM is reflective of global primary care reforms that aim to focus the attention of doctors on high-risk groups and improve continuity of care (see Peikes et al, Health Affairs, 2018).

In a pilot of ECM conducted in 2017 with 10 doctors, take up of the intervention was high – pilot providers made 40% more calls to patients with cardiovascular disease (CVD) or one of the “triad” of hypertension, diabetes, and elevated blood lipids; were 11% more likely to have patients on appropriate statin prescriptions; had patients 25% less likely to be hospitalized for CVD-related conditions; and were 11% more likely to follow up within 30 days in the event of an acute CVD incident. However, this pilot was conducted with a purposively selected group of 10 doctors who were expected to be highly motivated early adopters. Even this motivated group expressed that ECM, while generally seen as clinically worthwhile, brought with it additional work in the form of additional time spent on electronic medical records.

Our Estonian counterparts in EHIF and Ministry of Social Affairs (MoSA) expect that take up will be significantly lower when the program is expanded to the general population of primary care physicians. One hypothesis to explain low take-up is that many Estonian doctors are confident in the efficacy of their pre-existing practices. Doctors may be reluctant to adopt ECM because they do not realize that ECM patients, although comprising roughly 6.5% of the patient register, represent a substantially larger share of the burden of disease among their patients – for example, they make up 11.3% of acute admissions. By shifting efforts towards these patients (via the ECM system), they are more closely aligning their efforts to the burden of disease that they face. We will implement 3 treatment arms designed to maximize uptake of ECM by primary care doctors through communicating distinct features of the above ECM rationale. Each aims to shift the appreciation of ECM by doctors along a specific dimension of their work practice.

%%% PARAGRAPH ARCHIVED DECEMBER 2025 (please see published pre-analysis plan for details of final research plan) %%%
In the first arm, providers will receive a “big push”-style mentorship introduction to the ECM program over the course of one week from one of the champion providers who participated in the pilot. In the second, providers will have an ongoing, weekly call with the same type of ECM coach which will have a similar overall budget for the implementer per provider. The third arm will receive both treatments. All groups, as well a comparison group, will receive weekly reports on their own performance relative to ECM expectations for patient management.

Intervention

The Enhanced Care Management intervention consists of training and coaching doctors to develop care plans and undertake targeted outreach to the subset of patients who are at high risk of experiencing deteriorating health so to increase their utilization of health services. The goal is to extend the use of preventive care, which improves patient health and reduces the need for curative medical services. ECM includes heightened tracking of tests and referrals, follow up after hospital discharges, tracking medication adherence, monitoring between clinic visits, and a focus on achieving clinical quality. It includes four elements: identification of high risk patients through risk stratification, development of care management plans by the primary care physician, proactively linking care providers together, and developing a team approach with patients and their caregivers. ECM is reflective of global primary care reforms that aim to focus the attention of doctors on high-risk groups and improve continuity of care (see Peikes et al, Health Affairs, 2018).

In a pilot of ECM conducted in 2017 with 10 doctors, take up of the intervention was high – pilot providers made 40% more calls to patients with cardiovascular disease (CVD) or one of the “triad” of hypertension, diabetes, and elevated blood lipids; were 11% more likely to have patients on appropriate statin prescriptions; had patients 25% less likely to be hospitalized for CVD-related conditions; and were 11% more likely to follow up within 30 days in the event of an acute CVD incident. However, this pilot was conducted with a purposively selected group of 10 doctors who were expected to be highly motivated early adopters. Even this motivated group expressed that ECM, while generally seen as clinically worthwhile, brought with it additional work in the form of additional time spent on electronic medical records.

Our Estonian counterparts in EHIF and Ministry of Social Affairs (MoSA) expect that take up will be significantly lower when the program is expanded to the general population of primary care physicians. One hypothesis to explain low take-up is that many Estonian doctors are confident in the efficacy of their pre-existing practices. Doctors may be reluctant to adopt ECM because they do not realize that ECM patients, although comprising roughly 6.5% of the patient register, represent a substantially larger share of the burden of disease among their patients – for example, they make up 11.3% of acute admissions. By shifting efforts towards these patients (via the ECM system), they are more closely aligning their efforts to the burden of disease that they face. We will implement 3 treatment arms designed to maximize uptake of ECM by primary care doctors through communicating distinct features of the above ECM rationale. Each aims to shift the appreciation of ECM by doctors along a specific dimension of their work practice.

%%% PARAGRAPH ARCHIVED DECEMBER 2025 (please see published pre-analysis plan for details of final research plan) %%%
In the first arm, providers will receive a “big push”-style mentorship introduction to the ECM program over the course of one week from one of the champion providers who participated in the pilot. In the second, providers will have an ongoing, weekly call with the same type of ECM coach which will have a similar overall budget for the implementer per provider. The third arm will receive both treatments. All groups, as well a comparison group, will receive weekly reports on their own performance relative to ECM expectations for patient management.

Experimental design

Treatment group 1 (Big-push mentoring) Providers in the first treatment group will be given an intense week of mentoring on ECM practices by a peer-doctor who has already successfully adopted the reform during the pilot phase. The peer will spend a week at the treatment provider's practice, working collaboratively to explain and work through each stage of adoption of ECM practices. Throughout that week, a structured curriculum will guide the mentoring sessions and cover all aspects of the reform for the new provider to adopt. Mentors have already been identified and screened as both knowledgeable regarding the ECM reform, personable, and engaging. They were chosen as early adopters with the aim that they would provide technical assistance to the rollout documented here.

Doctors in this treatment group (and all others) will then receive, on a weekly basis, an automatically-generated ECM Performance Report with data visualizations (graphs and charts) showing their adherence to ECM practice standards, and how their adherence has evolved over time. This report will be drawn from comprehensive EHIF medical records, meaning that providers will receive up-to-date information on their management of all ECM patients, as well as specific updates on individual ECM patients as appropriate. This report will be delivered to all three treatment arms as well as to the comparison arm.

Treatment group 2 (Persistent mentoring) Providers in this treatment group will receive ongoing support in ECM implementation, delivered in weekly one-hour sessions by an "ECM Coach" whose total budgetary cost to the Government is equivalent to that of the training for Treatment Group 1, and time investment approximately the same. This person will, on a weekly basis, respond to any questions about the ECM program, assist with specific case management, and discuss the treatment provider's performance and its evolution over time. They will support ongoing discussion about approaches to improve performance based on the information that is fed back from the ECM Performance Report.

Treatment group 3 (Big-push and persistent mentoring) Providers in this treatment group will receive the same ECM Performance Report, the intensive mentoring week, and the ongoing phone-based coaching (from a distinct mentor doctor).

The first comparison group will consist of the remaining 40 physicians in the rollout sample, who will receive, on a weekly basis, the automatically-generated ECM Performance Report with data visualizations (graphs and charts) showing their adherence to ECM practice standards, and how their adherence has evolved over time. This ensures that access to information on performance is equivalent across the three study groups and the comparison group.

We will also be able to construct a distinct control group at the patient level. We expect to have sufficiently rich data at the patient-interaction level over time to compare ECM providers' management of ECM practices before, during, and after their transition into the program; as well as against ECM-eligible patients served by providers who are not selected into the rollout sample.

Design details

Randomization method
randomization done in office by a computer
Randomization unit
Health clinic
Clusters
160 Health Clinics
Observations
267,200 patients
Arms
40 clinics – Big-push mentoring 40 clinics - Persistent mentoring 40 clinics - Big-push and persistent mentoring 40 clinics - Information only
Primary outcomes
Outcome #1 – Provider participation (constructed) Outcome #2 Take-up: Number of CVD or metabolic triad patient follow-up calls Unit of observation Patient Data source EHIF medical records Sampling method Observed universe of records Number of rounds of measurement N/A, ongoing Dates of measurement N/A, ongoing Data access confirmed? Expected date of confirmation Confirmed Outcome #3 Patient likelihood of statin prescriptions, conditional on CVD or lipid condition Unit of observation Patient Data source EHIF medical records Sampling method Observed universe of records Number of rounds of measurement N/A, ongoing Dates of measurement N/A, ongoing Data access confirmed? Expected date of confirmation Confirmed Outcome #4 Patient likelihood of CVD-related hospital admission Unit of observation Patient Data source EHIF medical records Sampling method Observed universe of records Number of rounds of measurement N/A, ongoing Dates of measurement N/A, ongoing Data access confirmed? Expected date of confirmation Confirmed Outcome #5 Proportion of acute CVD care episodes receiving 30 day follow up Unit of observation Patient-episode Data source EHIF medical records Sampling method Observed universe of records Number of rounds of measurement N/A, ongoing Dates of measurement N/A, ongoing Data access confirmed? Expected date of confirmation Confirmed

Cited by

No citation data available for this registration yet.

Keywords