Pitch Attributes on Employer's Hiring Decisions

How to cite

Gao, Qiang. 2021. "Pitch Attributes on Employer's Hiring Decisions." AEA RCT Registry. AEARCTR-0007847. https://doi.org/10.1257/rct.7847-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Qiang Gao*

* Primary investigator

Registry ID
AEARCTR-0007847
DOI
https://doi.org/10.1257/rct.7847-3.0
First registered
Last updated
Status
In development
Trial dates
2021-11-18 – 2021-11-25
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/7847

Abstract

Online labor market (e.g., Freelancer.com, Upworker.com, Fivre.com) provides opportunities for service-seeking buyers (i.e., employers) to find service-providers (i.e., workers) to work on jobs and for workers to find jobs. In this experiment, we examine how communication qualities (the proportion of certainty- and rapport building-words) in competing workers’ pitches (i.e., texts) influenced employer’ hiring decisions in online labor marketplaces. We already have findings about these questions using real-world data from one of largest online labor market places. We found online service-pitchers’ proportion of certainty-words to be positively associated with their getting selected by service-seeking buyers up to a threshold after which words of certainty harmed sellers’ contract-acquisitions; and this inverted U-shaped relationship, which matches the “too much of a good thing (TMGT) effect,” was stronger when sellers’ pitches had fewer (rather than more) rapport-building words. This experiment is used to verify our findings. We additionally examine effects of geographical (dis)similarity on above relationships.

Intervention

In online labor marketplaces (e.g., Freelancer.com and Upwork.com), after an employee (i.e., buyer) post a job, workers (i.e., service providers or pitchers) who are interested in the job will bid by specifying the amount and time they need to complete the job. These workers normally send sale pitches (texts) to this employee.

The purpose of this research is to explore how certainty words and rapport-building words in worker's job-seeking pitches affect employer's hiring decisions.

I test the following 2 hypotheses:
Hypothesis 1: The relationship between online service-pitchers' words of certainty and their attractiveness to buyers is in the form of an inverted U-shaped curve, such that online service-pitchers' likelihood of being selected over competing sellers by buyers is greatest when their pitch-certainty is moderate rather than when it is low or high—hereafter referred to as the "TMGT-effect of pitch-certainty."
Hypothesis 2: The TMGT-effect of pitch-certainty is stronger for online service-pitchers whose pitches contain a lower (rather than higher)proportion of rapport-building words.

I have access to secondary dataset from one of largest online labor platform in the US. The initial results support our hypotheses. I will use an experiment to verify my findings and a boundary condition (i.e., job complexity).

This pre-registered study has a 3 (high certainty word ratio (rapport-building words: Absent VS. present), medium certainty word ratio (rapport-building words: Absent VS. present), and low certainty word ratio (rapport-building words: Absent VS. Present)) by 2 (project complexity: Absent VS. Present) between-subject design.

a. Definitions

• Certainty words are words that show assertiveness of language used by authors, words such as always, absolutely, and assure (Fast & Funder, 2008).

• Rapport-building words are words that build bonds between communicators (Gremler & Gwinner, 2008). We measure rapport-building in two dimensions (Tickle-Degnen & Rosenthal, 1990):
1) Mutual attentiveness. This dimension shows the expression of mutual attention and involvement with the other, including greeting words (e.g., “hello” and “how are you”) and mentioning communication recipients' names.
2) Positivity, feelings of mutual friendliness and warmth. This dimension includes politeness words (e.g., “thanks” and “regards”) and small talk components (e.g., emoji and exclamation marks).

• Project complexity
We use the presence or absence of the following note to create project complexity:
Website design-jobs often experience delays due to complexities associated with the programmer, client’s clarity about needs, and communications between them.

Thus, the treatments are the different levels of certainty words, different levels of rapport-building words, and different level of job complexity.

References
Fast, L. A., & Funder, D. C. (2008). Personality as manifest in word use: correlations with self-report, acquaintance report, and behavior. Journal of Personality and Social Psychology, 94(2), 334.
Gremler, D. D., Gwinner, K. P. (2008). Rapport-building behaviors used by retail employees. Journal of Retailing, 84(3), 308-324
Tickle-Degnen, L., & Rosenthal, R. (1990). The nature of rapport and its nonverbal correlates. Psychological inquiry, 1(4), 285-293

Experimental design

This pre-registered study has a 3 (high certainty word ratio (rapport-building words: Absent VS. present), medium certainty word ratio (rapport-building words: Absent VS. present), and low certainty word ratio (rapport-building words: Absent VS. Present)) by 2 (project complexity: Absent VS. Present) between-subject design.

The detailed explanations about certainty words, rapport-building words, and job complexity are provided in Intervention section.

The experiment will be conducted through Amazon Mechanical Turk platform.

Design details

Randomization method
After a worker from Amazon Mechanical Turk platform wants to participate. This worker can click the provided link and go to Qualtrics to do the survey. Each participant will be randomly assigned one set of pitches (two different pitches from two different service providers) and answer some questions. Each participant can only participate once.
Randomization unit
There are 6 different sets of sale pitches (each set has two different pitches). Each set is a randomization unit.
Clusters
1000 participants.
Observations
1000 participants.
Arms
1000 participants.
Primary outcomes
The likelihood of hiring is measured using Likert Scale 1-5. The hiring tendency increases from 1 to 5. 1 is Not at all and 5 means Extremely much.
Secondary outcomes
No secondary outcomes

Cited by

No citation data available for this registration yet.

Keywords