Addressing Hassle Costs: Man versus Machine

How to cite

Yassin, Kareman; Rivers, Nicholas; Papineau, Maya; Houde, Sebastien. 2023. "Addressing Hassle Costs: Man versus Machine." AEA RCT Registry. AEARCTR-0011873. https://doi.org/10.1257/rct.11873-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kareman Yassin* , Nicholas Rivers , Maya Papineau , Sebastien Houde

* Primary investigator

Registry ID
AEARCTR-0011873
DOI
https://doi.org/10.1257/rct.11873-1.0
First registered
Last updated
Status
In development
Trial dates
2023-08-01 – 2024-12-31
Countries
Private
JEL codes
H31, D12, Q40
Registry record
http://www.socialscienceregistry.org/trials/11873

Abstract

In this study, we develop a framework to formalize the concept of hassle costs in a utility maximization framework. We relate hassle costs to the shadow cost of leisure. Second, we propose an experimental procedure to elicit the distribution of marginal hassle cost in sample population. Third, we implement and validate our approach in a large-scale field experiment promoting the adoption of heat pump technology.

One important set of goals of this study is to increase home energy retrofit adoption and identify barriers in this context. The retrofits we will focus on are heat pumps. We intend to carry a household mailer campaign in which the mailers would include the value of available rebates and benefits of heat pumps and also make use of a survey to quantify hassle costs that may impede heat pump uptake. The main contribution of this research is providing a quantification of the marginal hassle cost associated with the increase in the adoption of low-carbon technologies.

Intervention

Our intervention consists of providing an Energy Coach program to reduce the hassle costs associated with heat pump adoption. The program has two versions: one consists of a human-assisted program, and the other consists of a digital assistant.

Experimental design

Our experimental procedure has two main components. First, we designed a randomized mailer campaign with several treatment arms and a control arm. The mailer campaign is used to recruit households in the second stage of the experiment. The mailer provides a link to an online survey. The online survey is a way to invite households to participate in an Energy Coach program. The nature of the Energy Coach program is randomized, and we use an incentive-compatible procedure to elicit the willingness to accept (WTA) for the program. The online survey also asks additional questions that we plan on using to validate our approach and explore heterogeneity.

Design details

Randomization method
There are three randomization procedures. First, we randomize the mailer campaign. Using the database of addresses, we use an Excel number generator number to assign a value of 1, 2, or 3 to each address. These numbers correspond to the three arms of the mailer campaign. For households that decide to participate in the online survey using the QR code provided on the mailer, Qualtrics randomizes survey participants between the two versions of the Energy Coach program. We use a 50/50 split. Finally, we use a lottery to determine whether and how much participants will be compensated for participating in either version of the Energy Coach program. For participants randomized into the human arm, we ask them to state the minimum amount that will convince them to spend 1 hour with the Energy Coach. After they have completed the survey, Qualtrics generates a random number between $0 and $100 at random (just like a lottery). If this random number is higher than the amount they entered, they will be entered into a pool of people eligible to work with an energy coordinator. Then, we will randomly select 30 people from this group who will be contacted by email to schedule a 1-hour session with the energy coordinator. After the session, they will receive the dollar amount chosen by the computer, plus the $10 gift card reward. If the random number is less than the amount they entered, they will only get the base $10 gift card for completing this survey. For participants randomized into the machine arm, we also ask them to state the minimum amount that will convince them to spend 1 on the Energy Coach digital tool. After they have completed the survey, Qualtrics generates a number between $0 and $100 at random (just like a lottery). If this random number is higher than the amount they entered, they all will be rewarded the dollar amount chosen by the computer after completing the energy online training tool. If the random number is lower than the amount they entered, they will only be rewarded with the base $10 gift card.
Randomization unit
The randomization of the intervention is at the individual level. We also perform a randomization for each recipient selected to receive the intervention to determine the compensation amount.
Clusters
Our target population is up to 25000 households. We are not clustering to conduct the randomization.
Observations
Our target population is 25000 households, and we are expecting a response rate ranging from 2.5% to 20% to the mailer invitation. Our planned number of observations is thus approximately between 500 and 4000 survey respondents.
Arms
For the mailer campaign, our sample size was determined to max out our budget for this item. For the online survey, we have a 50/50 split between the treatment arms to maximize our power. Given that our planned number of observations is between 500 and 4000 survey respondents, each version of the energy coach program will receive 50% of this expected number.
Primary outcomes
The primary outcome is the compensation amount households require to be paid or are willing to pay, respectively the WTA or WTP for the Energy Coach program. We elicit those values with an auction procedure in the survey.
Secondary outcomes
As part of the analysis, we are also planning to compute the Value of Information associated with the Energy Coach program.

Cited by

No citation data available for this registration yet.

Keywords