Pre-Registration: Understanding the impact of AI on the appeal of factory jobs
How to cite
Molak, Ekaterina; Hesler, Nikolaus von; Sadun, Raffaella; Englmaier, Florian; Tamayo, Jorge. 2025. "Pre-Registration: Understanding the impact of AI on the appeal of factory jobs." AEA RCT Registry. AEARCTR-0016757. https://doi.org/10.1257/rct.16757-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study examines how referencing artificial intelligence (AI) in job postings affects job seeker behavior in industrial labor markets. In a randomized field experiment, Siemens will post job advertisements for factory roles either with or without mentions of AI, rotating the treatment condition weekly at the job-post level. The ads will appear on the Siemens Career Portal and be syndicated across major recruitment platforms (e.g., LinkedIn, Indeed). The sample includes both blue-collar (e.g., shopfloor operators) and white-collar (e.g., industrial engineers) positions across multiple Siemens factories in countries such as the United States and China. The study will assess differences in application volume and applicant characteristics across conditions. Data will be collected during the summer-autumn period of 2025. The findings will shed light on how AI-related messaging influences job seekers' interest and selection into jobs, informing both economic understanding of labor market perceptions and practical recruitment strategies amid growing AI adoption.
Intervention
1. Mentions of AI in Job Postings
The intervention involves systematically varying whether artificial intelligence (AI) is referenced in job advertisements for factory roles. Each job posting will be alternately published in one of two formats:
1.1.AI Condition: The job description includes references to AI in both the title and the main body
- Title: XYZ in the factory with AI-powered machines
- Body: Here you will work in a modern, dynamic factory environment, where we increasingly rely on artificial intelligence (AI) to optimize production processes and drive innovation
1.2.Non-AI Condition: The job description omits any mention of AI in both the title and the main body
- Title: XYZ
- Body: Here you will work in a modern, dynamic factory environment.
2. Randomization and Rotation Schedule
The assignment of AI mentions is randomized at the job-post level. For each role, the job advertisement will be published in one condition (AI-framed or non-AI) for a period of one week after which the alternative version will be posted. This within-job, cross-time randomization strategy ensures that candidates are exposed to only one version of the job ad at any given time, minimizing cross-condition contamination. The rotation schedule is designed to allow within-role comparisons over time while maintaining ecological validity in a live recruitment environment.
Labor split: Siemens is responsible for designing the experiment and will handle the randomization, scheduling, and execution. The research team (Jorge Tamayo, Raffaella Sadun, Florian Englmaier) provided input on the experimental design (e.g., rotation logic), but they will not oversee the experiment's design or implementation. The research team will analyze the resulting data to evaluate the intervention's impact.
Experimental design
A field experiment will be conducted to measure the impact of referencing artificial intelligence (AI) in job postings on candidate behavior. The intervention will be implemented across multiple Siemens factories in different countries (e.g., the U.S. and China), using live recruitment postings for both blue-collar (e.g., machine operators) and white-collar (e.g., industrial engineers) factory roles.
Each eligible job posting will be randomly assigned to start in either the AI or non-AI condition, and will alternate weekly between the two formats. Each post is expected to undergo at least one full rotation cycle—i.e., it will be live for one week in the AI condition and one week in the non-AI condition—with some postings possibly undergoing multiple cycles depending on the length of the recruitment period.
Design details
Cited by
No citation data available for this registration yet.