AI Policy in Education - A Randomized Controlled Trial

How to cite

JIA, Jinghao; WAN, Yanlin; ZHANG, Xu. 2025. "AI Policy in Education - A Randomized Controlled Trial." AEA RCT Registry. AEARCTR-0015594. https://doi.org/10.1257/rct.15594-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Jinghao JIA* , Yanlin WAN , Xu ZHANG

* Primary investigator

Registry ID
AEARCTR-0015594
DOI
https://doi.org/10.1257/rct.15594-1.0
First registered
Last updated
Status
In development
Trial dates
2025-04-01 – 2025-09-01
Countries
China ()
Registry record
http://www.socialscienceregistry.org/trials/15594

Abstract

The integration of artificial intelligence (AI) into education is transforming traditional learning and teaching methods. While AI-powered tools offer opportunities for enhanced learning efficiency and personalized education, they also raise concerns about students' independent learning abilities and the evolving role of teachers. This study explores the impact of AI usage policies in secondary education through a randomized controlled trial (RCT). By examining different approaches to AI integration, the research aims to understand its effects on student learning, academic performance, and classroom dynamics. The findings will provide valuable insights for educators and policymakers, helping to develop informed strategies for the effective and responsible use of AI in education.

Intervention

This study evaluates the impact of different AI usage policies on secondary school students' academic performance and learning behaviors through a randomized controlled trial (RCT). The aim is to provide insights into how various AI policies can optimize student learning outcomes.

Experimental design

This study employs a randomized controlled trial (RCT) to evaluate the impact of different AI usage policies in secondary education. Participating classes are randomly assigned to varying AI policy conditions, allowing for a systematic comparison of their effects on student learning and teaching practices. The experiment examines how different approaches to AI integration influence academic performance, learning behaviors, and instructional methods. By analyzing these outcomes, the study aims to provide evidence-based insights for policymakers and educators on the responsible and effective use of AI in education.

Design details

Randomization method
Randomization will be conducted using a computer-generated algorithm to ensure an unbiased assignment of participants. Classes will be randomly allocated to different AI policy conditions through stratified randomization, considering factors such as grade level and baseline academic performance. This approach helps balance key characteristics across groups, enhancing the reliability of the study’s findings.
Randomization unit
Class level
Clusters
30 classes
Observations
1200 students
Arms
8 classes for control, 22 classes for treatment
Primary outcomes
The study focuses on key outcome variables related to the impact of AI usage policies in secondary education. These include: Academic Performance – Changes in student learning outcomes and assessment results. Learning Behavior – Variations in study habits, engagement, and reliance on AI tools. Independent Learning Ability – The extent to which students develop critical thinking and problem-solving skills. Teacher Instructional Approaches – Adjustments in teaching strategies and classroom dynamics in response to AI integration.

Cited by

No citation data available for this registration yet.

Keywords