Inference Effects in Discrimination Measurement

How to cite

Yu, Tinghua. 2026. "Inference Effects in Discrimination Measurement." AEA RCT Registry. AEARCTR-0019110. https://doi.org/10.1257/rct.19110-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Tinghua Yu*

* Primary investigator

Registry ID
AEARCTR-0019110
DOI
https://doi.org/10.1257/rct.19110-1.1
First registered
Last updated
Status
Completed
Trial dates
2026-07-09 – 2026-07-28
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/19110

Abstract

This study examines how people assess job candidates in a recruitment-style decision-making task. Participants will review a candidate’s response to a logical reasoning problem and evaluate the candidate’s performance and underlying ability. The study varies selected features of the recruitment context and the background information shown to participants before they make their evaluations. The findings will provide evidence on how information about the prior evaluation process affects judgments of candidate quality.

Intervention

Participants take part in an online recruitment-style evaluation task. They are asked to assess a candidate who has completed a logical reasoning problem. Before making their assessment, participants are randomly assigned to receive one of several versions of the evaluation context. These versions vary the background information provided about the recruitment process and selected features of the candidate-evaluation scenario. Participants then provide ratings of the candidate’s performance based on the information shown to them.

Experimental design

This study is an online survey experiment in which participants complete a recruitment-style evaluation task. Participants are asked to review information about a job candidate who has completed a logical reasoning problem. They are randomly assigned to different versions of the evaluation context and candidate-evaluation scenario.

Participants first read background information about the recruitment setting. They then see a candidate profile and the candidate’s answer to a logical reasoning problem, and provide an initial assessment of the candidate’s performance. Participants subsequently receive additional information about the candidate’s reasoning and provide a second assessment. The study is designed to examine how information about the evaluation process affects judgments of candidate quality when participants observe different amounts of performance information.

Design details

Randomization method
Randomization is implemented in Qualtrics using the platform’s built-in randomizer. Participants are individually randomized to one of the experimental conditions with equal assignment probabilities across conditions.
Randomization unit
The unit of randomization is the individual participant. All experimental conditions are assigned at the individual level, and there is no cluster-level randomization.
Clusters
1,280 individual participants
Observations
1,280 individual participants
Arms
The study has eight experimental arms, with approximately 160 individual participants assigned to each arm: 160 participants: Control information × human investment-banking evaluator × female-sounding candidate name 160 participants: Control information × human investment-banking evaluator × male-sounding candidate name 160 participants: Control information × algorithmic evaluator × female-sounding candidate name 160 participants: Control information × algorithmic evaluator × male-sounding candidate name 160 participants: Information treatment × human investment-banking evaluator × female-sounding candidate name 160 participants: Information treatment × human investment-banking evaluator × male-sounding candidate name 160 participants: Information treatment × algorithmic evaluator × female-sounding candidate name 160 participants: Information treatment × algorithmic evaluator × male-sounding candidate name
Primary outcomes
The first primary outcome is the participant’s estimate of the probability that the candidate’s answer to the logical reasoning problem is correct, after observing the candidate’s answer but before observing the candidate’s reasoning.
Secondary outcomes
The second primary outcome is the participant’s estimate of the probability that the candidate’s answer is correct after observing both the candidate’s answer and the candidate’s reasoning.

Cited by

No citation data available for this registration yet.

Keywords