Effectiveness of Evidence-Based Medicine on Knowledge, Attitudes, and Practices of Family Planning Providers: A Randomized Experiment in Jordan
How to cite
El-Khoury, Marianne; Choi, Soonie; Chatterji, Minki; Thornton, Rebecca. 2014. "Effectiveness of Evidence-Based Medicine on Knowledge, Attitudes, and Practices of Family Planning Providers: A Randomized Experiment in Jordan." AEA RCT Registry. AEARCTR-0000539. https://doi.org/10.1257/rct.539-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Objective: To evaluate the effectiveness of an Evidence-Based Medicine (EBM) program conducted in Jordan on private providers' knowledge, attitudes, and practices toward an injectable contraceptive, Depot Medroxy Progesterone Acetate (DMPA).
Design: A stratified randomized controlled study by region and gender. Computer generated random assignments allocated treatment and control groups.
Setting: Provider misconceptions and biases about contraceptive methods are major barriers to family planning access for women in low- and middle-income countries, including Jordan. Evidence-Based Medicine programs aim to reduce biases and misconceptions by providing doctors with the most up-to-date scientific evidence on contraceptive methods. Study was conducted December 2011 to January 2013.
Participants: 267 private doctors providing family planning services in Amman and Zarqa regions in Jordan.
Intervention: The treatment group was invited to attend a roundtable seminar on the injectable contraceptive DMPA, and to receive two 15 minute one-on-one educational visits that reinforce the messages from the seminar. The control group received two educational visits on the previous year's material on Combined Oral Contraception pills and no information on DMPA.
Main outcome measures: Providers' knowledge of DMPA, attitudes towards DMPA, self-perceived confidence level, and reported clinical practice.
Results: 267 providers randomized (treatment group n= 135; control group n= 132). 38 providers excluded because they did not complete an endline survey leaving 229 doctors (treatment group n = 117 ; control group n = 112) for intention to treat analysis. No significant impact of the EBM program on knowledge of DMPA's side effects (point estimates -0.02) or on reported clinical practices (point estimates -0.01). Attitude and Confidence Scores of providers in the treatment group are 0.14 and 0.21 standard deviations higher (respectively) compared to the control group, but not statistically significant. Evidence shows positive selection into program participation.
Conclusions: EBM may not be effective as a stand-alone program targeting a family planning method with a high level of provider and consumer bias. Evidence of positive selection into program participation underscores the importance of randomization to avoid overestimating the true effects of interventions.
Intervention
The intervention is a Depot Medroxy Progesterone Acetate (DMPA) evidence-based medicine program consisting of a two-hour roundtable seminar and two educational visits that would reinforce messages from the seminar. Programmers invited treatment group providers to the DMPA roundtable seminar led by trained private peer providers who presented clinical research findings related to DMPA. The roundtable format of the seminar allowed providers to discuss these findings within the local context, with the overall goal of correcting misconceptions and biases and improving providers' knowledge of evidence-based health benefits of method use. The seminar covered findings on fertility return, anemia, amenorrhea, and other real or perceived side effects of DMPA. The two educational visits, to be scheduled ahead of time with individual doctors, were conducted by a trained health worker. These 15-minute one-on-one sessions, held in individual providers' clinics, were intended to review specific information that was discussed during the seminar. These sessions had three objectives: to enhance the availability of evidence to support providers in counseling about DMPA; to address concerns about its side effects and perceived harm (such as delays in returns to fertility); and to convey information about its potential benefits (such as protective effects against cancer). The seminar and educational visits were implemented between January and June 2012.
The control group providers were not invited to a DMPA seminar and were not offered educational visits related to DMPA. However, in order to continue to engage the control group providers during the period of the study (the first six months of 2012), they were offered two repeat educational visits during this same time period; these visits were related to Combined Oral Contraception (COC) pills and a repeat of the previous year's materials. Thus, the treatment and control groups differed in the content as well as the extent of program offerings: the treatment group was offered participation in the DMPA seminar and two DMPA educational visits, and the control group was offered two repeat educational visits on COCs. No information about DMPA was discussed during the COC visits; thus, any detectable differences on knowledge, attitudes, or practice related to DMPA can be attributed to the influence of the DMPA program.
Experimental design
1. Determining the sample
From 2005 to 2010, the USAID-funded predecessor project, Private Sector Project for Women's Health-Jordan, worked with private obstetricians/gynecologists and general practitioners who provide family planning services in Jordan. The project compiled a list of providers that the study team used as the sampling frame for this evaluation. The sample of eligible providers consisted of 267 private health providers in two regions, Amman and Zarqa. The sample did not include doctors practicing in the North and South regions of Jordan because it was logistically difficult to randomize those doctors and provide a widely dispersed treatment group with EBM seminars. About 16 percent of the doctors in the sample are specialists; the rest are general practitioners.
2. Randomization
Using STATA v.12, the sample of 267 providers was randomly assigned to treatment and control groups, stratifying by geographic area, gender, and on whether the providers belonged to the project's network of providers. In total, there were 135 providers in the treatment group and 132 in the control group. Random assignment was done prior to data collection and the results were not communicated to anyone outside of the research study team.
3. Baseline Data Collection
A baseline survey was conducted in December 2011. Survey questionnaires were mailed to all 267 providers and follow-up phone calls were made to providers who did not respond to the mailed questionnaire. The questions asked for specific information on the provider’s knowledge of DMPA's side effects, attitudes towards the method, and clinical practices such as discussing DMPA with clients or prescribing it.
4. DMPA EBM Intervention
Treatment group providers were invited to a two-hour roundtable seminar and received two 15 minute educational visits that would reinforce messages from the seminar.
5. Endline Data Collection
The endline survey conducted in December 2012 collected information similar to the baseline: provider knowledge of DMPA's side effects, attitudes towards the method, and practices. It also collected information such as years of experience, number of patients seen, whether the provider has a dual practice, and the types of family planning methods that the provider has prescribed. Enumerators conducted in-office surveys. Primarily due to the change in the data collection method, the endline response rate was higher than the baseline rate- 87 percent (229 providers).
Design details
Cited by
No citation data available for this registration yet.