Performance in the New Era of Work: A Study of Employers' Perceptions of Employee Performance in Remote and In-Person Environments

How to cite

Lao, Josephine. 2025. "Performance in the New Era of Work: A Study of Employers' Perceptions of Employee Performance in Remote and In-Person Environments." AEA RCT Registry. AEARCTR-0015547. https://doi.org/10.1257/rct.15547-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Josephine Lao*

* Primary investigator

Registry ID
AEARCTR-0015547
DOI
https://doi.org/10.1257/rct.15547-1.0
First registered
Last updated
Status
Completed
Trial dates
2025-03-13 – 2025-03-19
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/15547

Abstract

This study investigates whether employers exhibit a preference for in-person work when evaluating employees’ work products in a commercial real estate context. Participants take on the role of an "employer" and assess work completed by "employees" who were assigned to generate innovative and actionable ideas for two real-world site selection challenges, either remotely or in person. Employers evaluate eight separate work products created by actual study participants, allowing for an analysis of potential biases or differences in perceived quality based on work mode. The findings aim to provide insights into employer preferences regarding remote versus in-person work and their implications for workplace policies and decision-making.

Intervention

In this study, participants act as employers tasked with evaluating work products completed by employees under either remote or in-person conditions. Each participant reviews eight work samples, all of which are of similar quality, ensuring that differences in evaluation stem from perceptions rather than actual performance disparities. Importantly, participants are informed of the work mode in which each product was completed. By analyzing their evaluations, this study aims to determine whether employers exhibit a preference for in-person work, despite the consistency in work quality.

Experimental design

Experimental Design
This study employs a between-subjects experimental design to investigate whether employers exhibit a preference for in-person work over remote work when evaluating employee-generated work products. Participants, acting as "employers," will assess eight work products created by real participants ("employees") who completed site selection tasks either remotely or in person.

Key Design Features:

Participant Recruitment: The study will recruit 40 participants from Connect Research and 10 participants from a commercial real estate company, ensuring a diverse sample with both general and industry-specific perspectives.
Controlled Work Quality: The work products presented to participants will be of similar quality, ensuring that differences in evaluations arise from perceived biases rather than actual disparities in performance.
Work Mode Disclosure: Employers will be explicitly informed whether each work product was completed in-person or remotely before making their assessments.
Evaluation Metrics: Employers will evaluate work products based on predefined criteria, including the number of unique ideas, variability, consistency in quality, specificity, feasibility, novelty, demand, and business value. Ratings will be collected using a combination of text entry and slider scales.
Randomized Work Product Order: The order in which participants receive work products will be randomized to control for order effects.

Design details

Randomization method
This study employs a randomized work product order design to control for order effects and minimize biases in employer evaluations. The randomization method is implemented as follows: Work Product Order Randomization: Each participant will evaluate eight work products (four completed in-person and four completed remotely). The order of presentation of these work products will be randomized for each participant to prevent any systematic biases based on sequence effects. Work Mode Distribution: Participants will review an equal number of remote and in-person work products (4 remote, 4 in-person). The randomization process ensures that no participant sees all remote or all in-person work products consecutively, reducing potential anchoring or contrast effects.
Randomization unit
The unit of randomization in this study is at the individual participant level (i.e., each employer evaluating work products)
Clusters
0
Observations
50 employers
Arms
200 evaluations of remote work products (50 participants × 4 remote work products each) 200 evaluations of in-person work products (50 participants × 4 in-person work products each)
Primary outcomes
Employer Evaluations (A score) of Work Product: Ratings of the overall quality of each work product, including clarity, feasibility, and relevance to the site selection challenge.

Cited by

No citation data available for this registration yet.

Keywords