An experiment to promote the uptake of 3ie’s TREE review framework

How to cite

Jain, Chandan; Martinez, Sebastian; Pereira, Dale; Shah, Rohan. 2023. "An experiment to promote the uptake of 3ie’s TREE review framework." AEA RCT Registry. AEARCTR-0012580. https://doi.org/10.1257/rct.12580-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Chandan Jain* , Sebastian Martinez , Dale Pereira , Rohan Shah

* Primary investigator

Registry ID
AEARCTR-0012580
DOI
https://doi.org/10.1257/rct.12580-1.0
First registered
Last updated
Status
In development
Trial dates
2023-12-10 – 2024-12-09
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/12580

Abstract

Globally, there is now greater emphasis on integrating evidence into policy making. Government policies and programs affect society at large, research generating evidence therefore needs to be credible and implemented in a transparent and ethical manner. Concerns, however, exist around the credibility, rigor, and reproducibility of existing evidence. Experts have pointed out various issues, such as selective reporting, p-hacking, lack of reproducibility, and ethical concerns plaguing social sciences research. Also, awareness and use of best practices in evidence generation remains low. Promoting adoption and integration of best practices (such as, pre-analysis plan, computational reproducibility) into research workflow becomes important to produce credible and ethical evidence. This study is an experiment to test the effectiveness of an information campaign on the uptake of the best practices to produce credible research.

Experimental design

The study is based on a cluster-randomized control trial, wherein we will randomly allocate on-going research studies to either the treatment group or control group. The researchers on these studies will comprise the participants in this experiment. If a study is assigned to the treatment group, then all associated researchers on that study will be assigned to the treatment group as a cluster. The treatment group consisting of researchers on studies assigned to the treatment will be exposed to an information campaign

Design details

Randomization method
Randomization done in office by a computer
Randomization unit
RCT study
Clusters
453 studies
Observations
1244 primary investigators
Arms
The proposed sample includes 1244 primary investigators across 453 studies. The sample is split equally between the treatment and control arms.
Primary outcomes
1. Awareness about the Review Framework, 2. Use of the Review Framework in upcoming or ongoing impact evaluations, 3. Use of TREE best practices in upcoming or ongoing impact evaluations.

Cited by

No citation data available for this registration yet.

Keywords