Experimental Study on the Impact of Generative Artificial Intelligence on Individual Career Preferences
How to cite
wang, xinyue. 2026. "Experimental Study on the Impact of Generative Artificial Intelligence on Individual Career Preferences." AEA RCT Registry. AEARCTR-0017719. https://doi.org/10.1257/rct.17719-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study investigates whether and how generative artificial intelligence (AI) influences individuals’ career choice preferences. Using a 2 (AI intervention: with vs. without) × 3 (decision context: subjective ideal, expert guess, peer guess) mixed factorial experimental design, we randomly assigned 93 university students to either a control group or an AI intervention group. Participants role-played as job seekers and rated six jobs across three decision contexts. Outcomes include skill-matched job ratings, rankings, and top-1 choice probabilities. We hypothesize that generative AI increases preference for skill-matched jobs across all three contexts and that job familiarity moderates this effect. Primary analyses include independent t-tests, linear mixed models, logistic regression, and moderation analysis with simple slopes.
Intervention
The intervention consists of providing static, pre-generated Artificial Intelligence (AI) advice during a simulated career decision-making task. Participants role-play as anonymous job seekers and are randomly assigned to one of two conditions:
1. Control Group (Independent Evaluation): Participants review the personal statements of anonymous job seekers—including education, internships, skills, and hobbies—and independently rate the person-job fit for six distinct job offers on a 1-to-10 scale. No external assistance or reference information is provided.
2. Treatment Group (AI-Assisted Evaluation): Participants complete the same evaluation task but receive an exogenous information shock: static AI-generated advice is displayed alongside each job offer. The advice, pre-generated by a large language model acting as a “senior career development consultant,” offers tailored analyses of the matching degree, highlighting professional alignments and identifying potential mismatches (e.g., distinguishing core competencies from hobby-based interests).
The AI advice is presented statically to eliminate confounding factors related to participants’ prompt-engineering skills or variation in human–AI interaction frequency, ensuring uniform treatment administration across all participants in the treatment group.
Experimental design
This study employs a 2 × 3 mixed factorial experimental design. The between-subjects factor is AI intervention (control vs. treatment), and the within-subjects factor is decision context (subjective ideal, expert guess, peer guess).
Participants are randomly assigned to either the control group (no AI advice) or the treatment group (AI advice provided). All participants complete three decision-making phases in a fixed order: (1) subjective ideal context, (2) expert guess context, and (3) peer guess context. In each phase, participants evaluate six job offers on a 1-to-10 scale and rank them by preference.
The primary outcomes are: (a) average rating for skill-matched jobs, (b) rank of skill-matched jobs, and (c) an indicator for whether a skill-matched job is selected as the top choice. Data are collected via an online platform. The study is pre-registered prior to data analysis.
Design details
Cited by
No citation data available for this registration yet.