A Randomized Controlled Trial of an AI-Based Guidance Tool for Post-Secondary Planning
How to cite
Polanco-Jimenez, Jaime; Witte, Kristof De. 2025. "A Randomized Controlled Trial of an AI-Based Guidance Tool for Post-Secondary Planning." AEA RCT Registry. AEARCTR-0017212. https://doi.org/10.1257/rct.17212-1.2
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Persistent gaps in higher education attainment for students from migrant backgrounds may be driven by deficits in non-cognitive skills and information asymmetries. This study outlines a multi-armed randomized controlled trial (RCT) to test whether an AI chatbot can increase these students' intention to enroll in higher education. We randomly assign secondary school clusters to a control group or one of three treatment arms that incrementally add engaging information, self-efficacy and patience-building modules, and relatable role-model stories.
Intervention
The intervention consists of a structured interaction with an AI-driven educational chatbot designed to assist secondary school students with migrant backgrounds. Participants are randomly assigned to one of four AI personas to test specific psychological levers regarding higher education enrollment:
1. Control (Neutral): A purely factual, reactive information assistant (testing rational persuasion).
2. Treatment 1 (Friendly): An engaging, enthusiastic guide focusing on information and simulated experiences (testing emotional engagement).
3. Treatment 2 (Mentor): Adds self-efficacy building and future-orientation exercises to the Friendly persona (testing self-efficacy).
4. Treatment 3 (Storyteller): Adds simulated peer testimonials and relatable role-modeling to the Mentor persona (testing social identification).
Experimental design
This is a multi-armed Randomized Controlled Trial (RCT) with a stratified design. Participating individuals from schools/NGOs are randomly assigned to one of four experimental groups to minimize contamination. Students within each cluster interact with a specific version of an AI chatbot:
1. Control (Neutral): A purely factual, reactive information assistant (testing rational persuasion).
2. Treatment 1 (Friendly): An engaging, enthusiastic guide focusing on information and simulated experiences (testing emotional engagement).
3. Treatment 2 (Mentor): Adds self-confidence building and future-orientation exercises to the Friendly persona (testing self-efficacy).
4. Treatment 3 (Storyteller): Adds simulated peer testimonials and role-modeling to the Mentor persona (testing social identification).
Data is collected via pre- and post-interaction surveys embedded directly in the chat application.
Design details
Cited by
No citation data available for this registration yet.