Effects of Pre-Populating Study Design Details to Encourage Registration of Studies - An RCT

How to cite

Anderson, Dustin; Spybrook, Jessaca. 2018. "Effects of Pre-Populating Study Design Details to Encourage Registration of Studies - An RCT." AEA RCT Registry. AEARCTR-0002588. https://doi.org/10.1257/rct.2588-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Dustin Anderson* , Jessaca Spybrook

* Primary investigator

Registry ID
AEARCTR-0002588
DOI
https://doi.org/10.1257/rct.2588-1.0
First registered
Last updated
Status
In development
Trial dates
2018-01-17 – 2018-05-14
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/2588

Abstract

This study would experimentally test a strategy for boosting registration rates and for promoting accuracy and completeness of registrations in a new registry for causal inference studies in education and the broader social sciences. The ultimate goal is to establish efficient registration processes for study leads (also referred to as study directors) and to boost the registration enterprise as a whole. With funding from the Institute of Education Sciences (IES), SREE is in the final stages of developing a registry of causal inference studies in education and the broader social sciences, hereafter referred to as the Registry of Efficacy and Effectiveness Studies (REES). The proposed project entails conducting a randomized control trial to learn about benefits to pre-populating a registration with data for completed studies, as well as to gain valuable feedback from a sizable number of early study registrants that will help us improve the design and launch of REES. This information will be especially valuable for guiding refinements to improve the potential for REES to serve as a reliable source for identifying all causal inference studies in education. The project also will contribute to the overall evidence base on how to increase integrity, rigor, and access to causal inference research in education.

Intervention

Pre-populating a registry entry entails integrating basic study information and study design details from a given source into the registry. It is hypothesized that pre-populating study design details with increase the likelihood of a researcher updating the registry entry and increase the quality of the registration entry. For two randomly assigned groups, we have the complete record of their WWC Registry record and will have used this to pre-populated a REES registration record. One group (randomly selected) will be sent a link to a registry entry with study design prepopulated and asked to update it; the other group will be sent a link to a registry entry with only basic study design information integrated and asked to complete it.

Experimental design

The study leads for all studies previously registered with the WWC will receive an e-mail inviting them to register their study with REES. One group (randomly selected) will be sent a link to a registry entry with study design prepopulated and asked to update it; the other group will be sent a link to a registry entry with only basic study design information integrated and asked to complete it. For both groups, we have the complete record of their WWC Registry record and will have used this to pre-populated a REES registration record. In addition, for purposes of the study, we will ask the individual completing the REES registration to respond to a brief survey to collect five types of information: (1) basic demographics and degree attainment, (2) current employer, and (3) number of years of experience doing educational research; (4) estimated time to complete the REES registration and how that compared with their expectations before they began the task; and (5) their suggestions for improving the request registration process.

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
Study leads of those impact studies in WWC registry
Clusters
206 study leads
Observations
255 registration entries
Arms
103
Primary outcomes
Percent of studies with complete registration entries.
Secondary outcomes
Accuracy of pre-population records and completeness of final registration records. Characteristics of studies that predict registration rates within and between treatment conditions. Impacts of pre-population on data-quality (error rates, types of errors, incidence and nature of missing fields).

Cited by

No citation data available for this registration yet.

Keywords