Banking prompts trial

How to cite

Registration, BETA Team. 2024. "Banking prompts trial." AEA RCT Registry. AEARCTR-0015045. https://doi.org/10.1257/rct.15045-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

BETA Team Registration*

* Primary investigator

Registry ID
AEARCTR-0015045
DOI
https://doi.org/10.1257/rct.15045-1.0
First registered
Last updated
Status
On going
Trial dates
2024-12-03 – 2025-08-29
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/15045

Abstract

The Treasury is advising the government on its responses to the ACCC’s Retail Deposits Inquiry and Home Loan Price Inquiry. Despite the financial benefits that can result from switching products, the reports found a lack of consumer engagement in these markets. For both markets the ACCC recommended that prompts be considered encouraging consumers to see if they could benefit from switching to alternative products that might better suit their needs.

BETA is working with the Treasury to: (1) identify the relevant behavioural factors in consumer financial decision-making; (2) understand the utility of prompts; (3) determine the optimal design for the prompts proposed in the ACCC reports; and (4) understand the barriers and enablers consumers experience when switching or repricing to identify additional interventions which may complement, or be an alternative to, the use of prompts.

BETA is conducting a suite of research activities to support this work, including a field trial (‘trial’) in partnership with a large retail bank. This trial will specifically test a single prompt designed to encourage disengaged customers to engage with their bank to negotiate a better deal on their home loan. This will provide evidence informing the effectiveness of prompts to encourage engagement in a relatively disengaged cohort.

Trial Aims
The aim of the trial is to test the effectiveness of a prompt to encourage disengaged customers to call the bank to see if they are eligible to receive a lower interest rate on their loan.

Intervention

Participants in the trial will see a prompt surfaced in their banking app if they are in the intervention arm. Control participants will not see the prompt. We will use bank administrative data to measure the primary and secondary outcomes.
The text of the prompt reads “Interested in reducing your mortgage repayments? Check whether you can get a lower interest rate on your home loan”. Customers can call the bank directly from the prompt or through their usual channels.

Experimental design

This project will be a 2-arm cluster randomised controlled field trial. Clusters will be defined in the administrative data as people who share loans, defined through inter-related person-loan pairs. This is because the intervention will be delivered to individuals, and the outcomes will relate to both people (e.g. calling the bank) and loans (e.g. rate reductions).
Clusters will be randomly assigned to either the treatment group or control group with approximately equal number in each arm. The randomisation is performed at the cluster level to ensure that all members of a cluster receive the same treatment condition.
After initial randomisation, stakeholders will remove 10% of individuals from the treatment group as part of their automated system.
The primary analysis will be conducted at the cluster level; i.e., whether at least one individual in a cluster takes action in response to the intervention. Analysis at the individual level represents an upper bound.
Outcomes will be measured at three time points. Timepoint 1 (T1) will be 7 days after the close of the prompt on 10 December 2024 in the mobile application (17 December 2024). Timepoint 2 (T2) will be 3 months post T1. Timepoint 3 (T3) will be 3 months post T2. T3 outcomes will explore longer-term effects of the intervention on financial wellbeing of participants. T2 outcomes will be exploratory.

Design details

Randomization method
Randomisation will be at the cluster level. Clusters of connected customers will be randomly assigned to treatment and control groups in a 1:1 ratio. The clusters are flexible structures able to manage a multitude of individual arrangements and the many-to-many relationship between people and loans. After initial treatment assignment, 10% of customers from the treatment group will be randomly selected to not receive the intervention as part of the stakeholder’s automatic program implementation. The random selection will occur at the individual customer level, not the cluster level. For single-customer clusters, the entire network will not receive the intervention if selected. For multi-customer clusters, only the selected customers will not receive the intervention. All people and clusters will be analysed as initially allocated to maintain the integrity of clusters post-randomisation.
Randomization unit
Randomisation will be at the cluster level.
Clusters
The planned number of clusters for this trial is 11,922 (defined as unique groups of individuals and their shared loans).
Observations
18,769 person-loan pairs, representing the total number of unique observations in the dataset
Arms
Treatment group: 5,961 clusters Control group: 5,961 clusters
Primary outcomes
Customer contact: Measured at both the cluster and individual level. The cluster-level analysis will examine whether any customer within each cluster contacted the bank, while the individual-level analysis examines whether each individual customer contacted the bank.
Secondary outcomes
Interest rate, repricing, financial stress, financial wellbeing

Cited by

No citation data available for this registration yet.

Keywords