Compatibility Between AI Mediation and Learner Proximity: Testing Question (Q) vs Answer (A) Orientations in AI-Driven Learning

How to cite

Malik, Tariq. 2025. "Compatibility Between AI Mediation and Learner Proximity: Testing Question (Q) vs Answer (A) Orientations in AI-Driven Learning." AEA RCT Registry. AEARCTR-0017007. https://doi.org/10.1257/rct.17007-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tariq Malik*

* Primary investigator

Registry ID
AEARCTR-0017007
DOI
https://doi.org/10.1257/rct.17007-1.0
First registered
Last updated
Status
In development
Trial dates
2025-11-01 – 2026-06-30
Countries
China (Liaoning)
JEL codes
I21 — Analysis of Education O33 — Technological Change: Choices and Consequences; Diffusion Processes D83 — Search; Learning; Information and Knowledge; Communication; Belief; Unawareness
Registry record
http://www.socialscienceregistry.org/trials/17007

Abstract

Trial Overview / Abstract
This study investigates how artificial intelligence (AI) interacts with human learning proximity—specifically, whether AI-driven instruction is more compatible with *Question (Q)* or *Answer (A)* proximity orientations of learners. Building on proximity theory and cognitive load frameworks, the experiment examines whether AI aligns more naturally with the learner’s tendency to construct knowledge through questions (Q-proximity) or to consolidate understanding through answers (A-proximity). The study employs a randomized 2×2 factorial design manipulating (1) proximity orientation (Q vs A) and (2) AI compatibility level (High vs Low). Participants complete microlearning tasks within an AI-assisted learning environment where AI either mirrors or mismatches their proximity orientation. The primary outcomes include engagement, arousal, uncertainty reduction, and learning performance. The results will clarify the cognitive–affective mechanisms by which AI complements or conflicts with human learning orientations, offering empirical guidance for the design of adaptive and personalized AI learning systems.
Primary Research Question
Is AI-driven instruction more compatible with Question-oriented (Q-proximity) or Answer-oriented (A-proximity) learners, and how does this compatibility influence engagement, arousal, and performance?
Hypotheses
H1: AI–learner compatibility (matching AI mode with learner proximity type) leads to higher engagement and performance than incompatibility.
H2: AI’s answer-generative nature makes it more compatible with A-proximity learners, improving near-term learning outcomes.
H3: Q-proximity learners benefit more when AI adopts a Socratic or exploratory questioning mode, supporting curiosity and transfer.
H4: The effects of compatibility on performance are mediated by arousal and uncertainty reduction.
Intervention Description
Participants are randomly assigned to one of four experimental conditions that vary in the match between their learning orientation (Q or A) and the AI’s instructional mode (Socratic questioning vs direct answer delivery). Each participant completes a 45–60 minute microlearning session via an AI-powered learning interface. The AI’s dialogue structure and feedback are scripted to either mirror or mismatch the learner’s proximity orientation. After completing the module, participants take an immediate post-test and a delayed test one week later.
Experimental Design
A between-subjects randomized controlled trial with a 2×2 factorial design:
Factor 1: Learner Proximity Orientation (Q vs A)
Factor 2: AI Compatibility (High vs Low)

Treatment Arms:
1. Q-Compatible AI (Socratic questioning matched to Q orientation)
2. Q-Incompatible AI (Direct answers given to Q orientation)
3. A-Compatible AI (Direct answers matched to A orientation)
4. A-Incompatible AI (Socratic prompts mismatched to A orientation)
Experimental Unit
Individual learner (between-subject randomization).
Sample Size
Target N = 300 participants (approximately 75 per treatment cell).
Randomization Procedure
Participants will be randomly assigned to one of the four conditions using computer-generated block randomization in the online experimental platform. Randomization will be stratified by gender, learner type (student vs professional), and prior AI familiarity.
Sampling Method and Recruitment
Voluntary participants will be recruited from university students and adult learners through email invitations and online learning platforms. Inclusion criteria: age 18+, English proficiency, basic computer literacy. Exclusion criteria: prior exposure to the experimental module or incomplete responses.
Intervention Period
Each participant engages in one 45–60 minute session (Day 1) and a 10-minute follow-up test (Day 8).

Experimental design

Experimental Unit
Individual learner (between-subject randomization).
Sample Size
Target N = 300 participants (approximately 75 per treatment cell).
Randomization Procedure
Participants will be randomly assigned to one of the four conditions using computer-generated block randomization in the online experimental platform. Randomization will be stratified by gender, learner type (student vs professional), and prior AI familiarity.
Sampling Method and Recruitment
Voluntary participants will be recruited from university students and adult learners through email invitations and online learning platforms. Inclusion criteria: age 18+, English proficiency, basic computer literacy. Exclusion criteria: prior exposure to the experimental module or incomplete responses.
Intervention Period
Each participant engages in one 45–60 minute session (Day 1) and a 10-minute follow-up test (Day 8).

Design details

Randomization method
Experimental Unit Individual learner (between-subject randomization). Sample Size Target N = 300 participants (approximately 75 per treatment cell). Randomization Procedure Participants will be randomly assigned to one of the four conditions using computer-generated block randomization in the online experimental platform. Randomization will be stratified by gender, learner type (student vs professional), and prior AI familiarity. Sampling Method and Recruitment Voluntary participants will be recruited from university students and adult learners through email invitations and online learning platforms. Inclusion criteria: age 18+, English proficiency, basic computer literacy. Exclusion criteria: prior exposure to the experimental module or incomplete responses. Intervention Period Each participant engages in one 45–60 minute session (Day 1) and a 10-minute follow-up test (Day 8).
Randomization unit
Experimental Unit Individual learner (between-subject randomization).
Clusters
300 to 500 participants (university students)
Observations
Planned Number of Observations Between 300 and 500 individual learner participants will be observed, depending on final recruitment and attrition rates. Each participant represents one independent observation. Participants will be randomly assigned in approximately equal numbers (75–125 per condition) across four experimental groups in a 2×2 factorial design: Q-Compatible AI Q-Incompatible AI A-Compatible AI A-Incompatible AI The final sample size will ensure statistical power (0.80, α = 0.05) to detect small-to-moderate effects (Cohen’s f = 0.20) on primary outcomes of learning engagement and performance. Planned Number of Clusters None (individual-level randomization). Each participant serves as an independent observational unit. Cluster Definition Not applicable. Randomization occurs at the individual level rather than by group, institution, or class. Each learner interacts independently with the AI learning environment, ensuring no within-group dependence.
Arms
300 to 500 participants
Primary outcomes
Primary Outcomes 1. Learning engagement (behavioral: interaction frequency; affective: interest and arousal; cognitive: inquiry depth). 2. Learning performance (immediate quiz and one-week retention test). 3. AI–learner compatibility effect (difference between matched and mismatched AI responses).
Secondary outcomes
Secondary Outcomes 1. Arousal (6-point self-report scale). 2. Uncertainty reduction. 3. Far-transfer problem-solving score. 4. Time-on-task and AI interaction count.

Cited by

No citation data available for this registration yet.

Keywords