The Impact of Price Comparison Tools for Consumer Credit on Financial Decision-Making

How to cite

Higgins, Sean; Berwart, Erik; Kulkarni, Sheisha; Truffa, Santiago. 2021. "The Impact of Price Comparison Tools for Consumer Credit on Financial Decision-Making." AEA RCT Registry. AEARCTR-0008553. https://doi.org/10.1257/rct.8553-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Sean Higgins* , Erik Berwart , Sheisha Kulkarni , Santiago Truffa

* Primary investigator

Registry ID
AEARCTR-0008553
DOI
https://doi.org/10.1257/rct.8553-2.0
First registered
Last updated
Status
In development
Trial dates
2021-11-11 – 2023-12-01
Countries
Private
JEL codes
G51 (Household Saving, Borrowing, Debt and Wealth), G53 (Financial Literacy), O16 (Economic Development, Financial Markets), D14 (Household Saving/Personal Finance), D83 (Search/Learning/Information and Knowledge/Communication/Belief/Unawareness)
Registry record
http://www.socialscienceregistry.org/trials/8553

Abstract

Consumer credit markets feature large amounts of price dispersion, and different banks can offer the same consumer substantially different interest rates. Nevertheless, consumers do not search much across banks: in Chile, only 3% of consumers searched at another bank after receiving a loan offer. Consumers may not search because they have inaccurate expectations about price dispersion or the benefits of search. We built an interactive loan price comparison tool using administrative data on the universe of consumer loans from Chile's financial regulator (CMF). The tool provides just-in-time, personalized information by showing potential consumers the distribution of interest rates that similar consumers received for similar loans in the past six months. We will conduct a randomized controlled trial (RCT) among Chilean consumers searching for a loan to measure the impact of the loan price comparison tool on beliefs about prices and price dispersion, planned and actual search behavior, loan characteristics, and financial health and well-being.

Intervention

The purpose of this study is to measure the impact of access to just-in-time, personalized information about the price dispersion of loan costs across banks on beliefs about price dispersion, consumer search, financial decision-making, and downstream financial health and well-being.

This RCT has three treatment arms:
1) Full price comparison tool: it shows potential borrowers the distribution of loans granted APRs, conditional on consumer and loan characteristics.
2) Simplified price comparison tool: it shows consumers how much they would save by searching at more banks, conditional on consumer and loan characteristics.
3) Control video: this video explains basic financial concepts about credits and does not provide information about the search and comparison of loans across banks.

The target population is adults searching for a consumer or mortgage loan on Google. To recruit participants, we have identified a set of Google search keywords related to consumer/mortgage loans and have designed a Google ads campaign that will target Chilean residents searching for consumer/mortgage loans online.

Experimental design

To measure the impact of access to personalized, just-in-time information from a credit price comparison tool on consumer beliefs, search, and loan characteristics, we are conducting a randomized control trial (RCT) with the CMF (Chilean financial regulator).

The target sample group is adults searching for a consumer loan or mortgage in Google. To recruit participants, we have identified a set of Google search keywords related to consumer loans and have designed a Google ads campaign that will target Chilean residents searching for consumer loans online. We expect 147,000 people to click our ads, which translates to 28,673 participants (19.5%) being assigned to a treatment arm, based on our pilot data. When loan searchers click our ads, this leads them to our online survey questionnaire. If they provide informed consent, they enter into the initial part of the survey, which asks about sociodemographic characteristics, loan characteristics, and beliefs about the credit market. After completing this initial part, participants are randomized into one of the six treatment arms. After treatment, we ask again about the beliefs about the credit market to measure whether they change subsequently. The total survey duration is of 9 minutes on average.

We have three treatment arms in our RCT, which are described below:

1) Full price comparison tool: it allows users to enter information about their income and the loan type (consumer or mortgage), maturity, amount, and municipality they would like to search. Using CMF's administrative data on the universe of consumer and mortgage loans over the last six months, the interactive tool shows the distribution of APRs that other consumers with similar characteristics received from banks for similar loans. User characteristics are based on the income and municipality tool inputs, and loan characteristics are based on the loan type, amount, and maturity tool inputs.
2) Simplified price comparison tool: the inputs are the same as in the full version of the tool. This simplified version shows users the benefits of search by returning users a statement of how much they would save in terms of monthly and total costs by searching at more banks, conditional on loan and consumer inputs.
3) Control group video: it explains basic financial concepts about credits and does not provide information about the search and comparison of loans across banks.

We will also test whether asking people about search induces more search by randomly not asking these questions to a fraction (25%) of our respondents—more on this in the power calculations section.

Design details

Randomization method
Each individual that clicks on the ad and completes the initial part of the survey will be assigned randomly to one of the three arms previously described. We do this in our online survey using Qualtrics.
Randomization unit
Randomization is at the individual level.
Clusters
Does not apply.
Observations
We need 147,043 people clicking on our ads to detect an effect on our main outcomes with 80% power. This translates to 28,673 respondents (19.5%) getting assigned to a treatment arm, based on our pilot data.
Arms
As we have three treatment arms, the sample size by treatment arm would be the number of respondents getting assigned to a treatment arm (28,673) divided by 3, which is 9,558.
Primary outcomes
Expectations about prices and search intensity: These measures are reported directly in the online survey that participants in the RCT will fill out. Both before and after viewing the tool, we ask them to report their beliefs about (i) the APR they expect to get, (ii) the lowest APR that a bank would offer them; (iii) the average APR banks would offer them; (iv) the highest APR a bank would offer them; (v) how many banks they expect to obtain price quotes from; and (vi) how long they expect to search. These questions will allow us to estimate their priors about the distribution of prices, how much they will search, and whether the intervention affects them. Consumer search: we will measure consumer search in two ways. First, measuring the number of applications for participants in our experiment using CMF administrative data. Second, we will conduct a follow-up survey six months after the intervention and ask respondents to self-report how many banks they sought price quotes from. Other relevant measures related to consumer search are (i) number of loans taken (CMF data), (ii) actual search length (follow-up data), and (iii) whether they report having bargained (follow-up data). Loan characteristics: we will measure whether the tool impacts the loan rate, total amount, and maturity, and in which banks and municipalities they end up taking loans. Financial health and well-being: we will measure whether the better loan characteristics potentially obtained by consumers lead to other downstream outcomes, such as missed loan payments and total consumer debt across financial institutions using CMF data. In addition, we will include various measures of financial health and well-being in our follow-up survey, such as total savings, ability to cope with shocks, and the standardized metrics on financial health developed by Innovations for Poverty Action. We will winsorize at the 95th percentile our survey outcomes to avoid outliers guiding the results.
Secondary outcomes
As a secondary outcome, we will study whether people would refer other people to the price comparison tool in the follow-up survey.
Sponsors
Name: Think Forward Initiative Location: Netherlands Url: https://www.thinkforwardinitiative.com/ Name: Guthrie Center for Real Estate Research (Northwestern University) Location: United States Url: https://www.kellogg.northwestern.edu/departments/real-estate/faculty-research/guthrie-center.aspx Name: McIntire School of Commerce (University of Virginia) Location: United States Url: https://www.commerce.virginia.edu/ Name: Fondo Nacional de Desarrollo Científico (Fondecyt) Location: Chile Url: https://www.conicyt.cl/fondecyt/ Name: Sparkassenstiftung für Internationale Kooperation Location: Germany Url: https://www.sparkassenstiftung.de/
Partners
Name: Comisión para el Mercado Financiero (CMF) Partner_type: government Url: https://www.cmfchile.cl/

Cited by

No citation data available for this registration yet.

Keywords