Crowdsourcing Job Improvements from Employees

How to cite

Stanton, Christopher; Seegert, Nathan; Saouma, Richard; Sandvik, Jason. 2022. "Crowdsourcing Job Improvements from Employees." AEA RCT Registry. AEARCTR-0009888. https://doi.org/10.1257/rct.9888-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Christopher Stanton* , Nathan Seegert , Richard Saouma , Jason Sandvik

* Primary investigator

Registry ID
AEARCTR-0009888
DOI
https://doi.org/10.1257/rct.9888-2.0
First registered
Last updated
Status
In development
Trial dates
2022-05-19 – 2023-12-07
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/9888

Abstract

Firms often solicit ideas from their employees through suggestion boxes, focus groups, surveys, and staff meetings. Famously, Toyota’s production system pulls ideas from their employees that are then implemented to improve quality. Despite the wide adoption of these programs and publicized successes, fundamental questions remain about why firms adopt these programs and through what channels they improve production. One leading explanation is that soliciting ideas is a form of crowdsourcing that leverages the knowledge held by employees within a firm. Certainly, there are many anecdotes of simple improvements that were easily seen from the assembly line that were unobservable from higher levels in the organization. Another leading explanation is that soliciting ideas increases engagement and morale. There are recent examples in other contexts showing that engagement and productivity increase when firms give employees a voice. For these programs to be successfully implemented, it is important to know through which channels they work.

We are working with the management team of a pediatric allied health services business, where speech, physical, and occupational therapists go to patients' homes to deliver care. This project is designed to understand if there are practice changes that can make their jobs better. The project consists of crowdsourcing ideas to improve health providers’ jobs from the providers themselves and the management team, via an initial survey. In a second survey, we will have providers and managers rank ideas that might be implemented, with the goal of comparing rankings of ideas from therapists versus those from management. We will test whether employee generated ideas are more likely to be the top ranked ones, whether the ability to submit ideas changes engagement and job satisfaction, and whether prompts to some employees that management is considering employee-generated ideas improves engagement and job satisfaction.

Intervention

The intervention has two steps. In a first survey, all respondents at the beginning of the survey were asked about sentiment towards the firm, willingness to refer friends, and job satisfaction. Half of the respondents were then asked to provide an idea that will improve their jobs. We then collected these ideas, grouped them, and have prepared a second survey to elicit feedback on the ideas. In this second survey, we will ask both frontline employees and managers to rank the quality of ideas. The second survey will randomize whether a respondent will observe any labels for the origin of ideas as coming from frontline-employees. The subset of labeled ideas will change across respondents who are treated, allowing us to separate the effect of labels from differences in idea quality. This design will allow us to test whether labeling of ideas as employee-generated causes employees to feel valued, appreciated, or heard, which may alter sentiment toward the firm or perceptions of job or employer quality. We can also test whether the idea labels change the perception of idea quality, which may be captured by a change in the ranking of labeled ideas. Finally, for the unlabeled data, we can test whether employee-generated ideas (or the best employee generated ideas) are perceived as superior to ideas that come from managers.

Experimental design

The experiment consists of two surveys with randomization into different treatments. In the first survey, treatment provides the ability to submit ideas for job improvement. In the second survey respondents are asked to rank order ideas for job improvement and to anticipate what ideas others in their job will rank highly, and to project which changes management will consider implementing. Treatment in the second survey consists of having the origin of ideas labeled as employee-generated, allowing us to test how this changes perception of the firm and of idea quality.

Design details

Randomization method
Done by computer in the survey, with sequential respondents allocated to treatment and control.
Randomization unit
Individuals.
Clusters
There are around 300 therapists at the firm. We expect about 180 to participate in the second survey.
Observations
Around 180 survey respondents. We will have secondary data linked to non-participants.
Arms
About 90 participants per arm.
Primary outcomes
Sentiment towards the firm; change in sentiment towards the firm; perceptions of being heard; idea quality; and productivity metrics.
Secondary outcomes
Willingness to supply ideas in survey 1; retention.

Cited by

No citation data available for this registration yet.

Keywords