Evaluating an AI-Powered Research Development Tool for Academic Productivity and Well-being
How to cite
Polanco-Jimenez, Jaime; Sevilla, Almudena. 2026. "Evaluating an AI-Powered Research Development Tool for Academic Productivity and Well-being." AEA RCT Registry. AEARCTR-0017749. https://doi.org/10.1257/rct.17749-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This randomized controlled trial (RCT) evaluates the causal impact of an AI-powered Research Development Tool on the academic productivity and well-being of early-career researchers. Participants — PhD students and junior economists within five years of their doctorate — will be randomly assigned, within career-stage strata, to either a control group with access to a general-purpose AI or a treatment group with access to a comprehensive AI-driven Research Development Suite offering structured, expert-level feedback on research papers. The control group will receive access 12 months after the experiment's start date. Over a 24-month intervention period, we measure changes in externally evaluated research quality, paper submission rates, job satisfaction, and work-life balance.
Our central question is whether the productivity effects of AI access vary systematically with the researcher's level of accumulated tacit knowledge and structural advantage — specifically evaluating heterogeneity by career stage and controlling for baseline institutional prestige. We test whether AI acts as a substitute for elite networks (compressing inequality) or a complement to existing advantages (amplifying inequality).
Intervention
This is a two-arm, parallel-group, single-blind randomized controlled trial (RCT). Participants — PhD students and junior economists within five years of their doctorate — will be randomly allocated to either a control group or a treatment group in a 1:1 ratio, using stratified randomization by career stage. The intervention will last for 24 months. Data will be collected through baseline and endline surveys and continuous behavioral logging from the AI platform. The study aims to evaluate whether the productivity effects of AI access vary systematically with the researcher's level of accumulated tacit knowledge.
Experimental design
This is a two-arm, parallel-group, single-blind randomized controlled trial (RCT) evaluated over a 24-month period. The study investigates the causal impact of a structured, AI-powered Research Development Tool on the academic productivity of early-career researchers. Participants will be stratified by career stage (PhD students vs. junior economists within five years of their doctorate) and randomized in a 1:1 ratio into either a treatment group or a waitlist control group.
The treatment group will receive immediate access to the AI tool, which provides expert-level feedback on working papers. The waitlist control group will conduct their research as usual (which may include ad-hoc use of general-purpose LLMs) and will receive access to the treatment tool only after the 12-month intervention concludes. Our primary objective is to measure changes in real-world publication milestones (e.g., desk rejection rates, Revise & Resubmit invitations, and working paper circulation). Secondarily, we will test whether the treatment effect varies systematically by the researcher's level of accumulated tacit knowledge (career stage), identifying whether AI access compresses or amplifies existing inequalities in research output.
Design details
Cited by
No citation data available for this registration yet.