The Semblance of Success in Nudging Consumers to Pay Down Credit Card Debt

How to cite

Guttman-Kenney, Benedict; Adams, Paul; Hunt, Stefan; Laibson, David; Stewart, Neil. 2022. "The Semblance of Success in Nudging Consumers to Pay Down Credit Card Debt." AEA RCT Registry. AEARCTR-0009326. https://doi.org/10.1257/rct.9326-1.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Benedict Guttman-Kenney* , Paul Adams , Stefan Hunt , David Laibson , Neil Stewart

* Primary investigator

Registry ID
AEARCTR-0009326
DOI
https://doi.org/10.1257/rct.9326-1.2
First registered
Last updated
Status
Completed
Trial dates
2016-11-01 – 2018-07-26
Countries
United Kingdom of Great Britain and Northern Ireland ()
JEL codes
D04, D90, D18, G28, G51, L51
Registry record
http://www.socialscienceregistry.org/trials/9326

Abstract

We conduct an RCT testing how a credit card nudge -- shrouding the Autopay option to automatically pay only the minimum due and increasing the salience of an alternative Autopay option to automatically amortize debt faster -- affects cardholders. Despite the nudge causing large (21 percentage points) proximate effects changing Autopay enrollment, it has no distal effects on debt. This is explained by offsetting consumer responses including choosing `low' Autopay amounts that bind at or near the minimum and lower Autopay enrollment which increases missed payments.

Intervention

The trial applied to consumers who are in the process of applying for a new credit card with that lender.

When a consumer is applying for a credit card online and had been provisionally accepted they reach a screen providing them with the option to setup a direct debit. At this point the individual is randomly allocated to either treatment or control group via a random number generator. This trial remained live until the target sample size had been reached.

The control group were presented with the standard automatic payment (Autopay / Direct Debit) options: automatic full payment, automatic fixed payment, automatic minimum payment).

The treatment group were not presented with an explicit automatic minimum payment option. They only saw automatic full payment and automatic fixed payment as options.

Once allocated to control or treatment they would view these same choices if they returned to the pages to set-up or change their automatic payment choices within 30 days of applying for the card. One reason for doing so may be that they have wanted to sign-up for automatic payments but did not have bank details to hand so returned later on. If a consumer phoned the lender’s call centre they had the normal automatic payment options available to them.

Experimental design

We measure outcomes using microdata collected from lenders and credit file data collected from a credit reference agency.

Our experiment is an RCT. We use 0.5% as the threshold for statistical significance. 5% where results are suggestively significant and also highlight where results are significant at the 1% level. In addition, for the primary outcomes, we will distinguish between statistically insignificant results where we confident in there being no effect (i.e. precisely estimated null results) from results where we cannot rule out there being a treatment effect with confidence (i.e. low powered). This will be done through reporting the minimum detectable effect size (MDE) which shows the effect that would have been detectable with 80% power at the 5%, 1% and 0.5% statistical significance level.

We will construct an unbalanced panel with one observation per credit card, per month observed. The panel is unbalanced as some cards will have been part of a trial for a longer period of time than other cards. We expect to observe each individual to only have one of their credit cards subject to the trial.

We plan to estimate an OLS regression with standard errors clustered at the individual card-level. We expect to observe multiple credit card statement cycles from the start of the trial. Dummy variables for these will be included to allow for the treatment effect to be measured for each cycle from the start of the trial. We hypothesise that treatment effects will vary over time (for example due to consumer learning to optimise their payments as their balances change) but we do not impose a functional form on these as it is unclear what the appropriate functional form would be. The target card is the credit card subject to the trial.

We plan to estimate an OLS regression with standard errors clustered at the individual card-level. We expect to observe multiple credit card statement cycles from the start of the trial. Dummy variables for these will be included to allow for the treatment effect to be measured for each cycle from the start of the trial. We hypothesise that treatment effects will vary over time (for example due to consumer learning to optimise their payments as their balances change) but we do not impose a functional form on these as it is unclear what the appropriate functional form would be. The target card is the credit card subject to the trial.

We plan to include a constant, a series of time-invariant control (CONTROLS) variables (constructed using information on the target credit card and card-holder from before the start of the trial and dummies for the month and year (MONTH) the outcome is observed, dummies for statement cycle number (CYCLE), and an interaction between TREATMENT and CYCLE. The controls are designed to soak up variation not attributable to the trial in order to make our estimates of treatment effects more precise. We are not examining the coefficients on these in the primary analysis. This is because with the lags of the outcome included as controls, the coefficients on other control variables do not measure the effects of these, they measure the effect of controls on the change in outcome.
In this specification the coefficients on the interaction between CYCLE and TREATMENT shows the treatment effect cycles since the start of a trial.

CONTROLS were Gender, Age, Age squared, Log Estimated Income, Credit Score, Unsecured Debt-to-Income (DTI) Ratio, Any Mortgage Debt, Log Credit Card Credit Limit, Credit Card Purchases Rate, Subprime Credit Card, Any Credit Card Promotional Rate, Any Credit Card Balance Transfer, Credit Card Open Date, Credit Card Statement Day, Any Credit Card Secondary Cardholder.

These were all from the time of card origination (or month preceding card origination where consumer rather than Credit Card specific variables). For outcomes constructed from credit reference agency (CRA) data up to eleven dummies for lags of outcomes were included for months preceding the start of the trial.

CYCLE and MONTH are both included because statement cycles do not perfectly align with calendar months and trials went into the field at different points-in-time.

Design details

Randomization method
As the consumers are not known in advance, the randomisation process is carried out ‘live’ without exclusion restrictions. Randomization was carried out through a random number generator JAVA script created by the lenders.
Randomization unit
Randomized at the consumer level.
Clusters
At least 40,000 consumers for lender 1. At least 10,000 consumers for lender 2.
Observations
At least 40,000 consumers for lender 1. At least 10,000 consumers for lender 2.
Arms
At least 20,000 consumers for each of control and treatment for lender 1. At least 5,000 consumers for each of control and treatment for lender 2.
Primary outcomes
The 10 primary outcome variables we will focus on are as follows. Outcomes 1-6 are measured on target credit card from lender data, outcomes 7-10 on credit card portfolio from credit file data: 1. Minimum payment: Credit card repayment of only contractual minimum amount (binary). 2. Full payment: Credit card repayment of full balance. 3. Insufficient payment: Credit card repayment below contractual minimum amount or no payment made when due (binary) 4. Outstanding debt: (Credit card statement balance – repayments) / (Credit card statement balance) 5. Cost: (Credit card interest + credit card fees) / (Credit card statement balance) 6. Consumption: (Value of credit card transactions) / (Credit card statement balance) 7. Portfolio minimum payment: Proportion of credit cards where repayment of only contractual minimum amount 8. Portfolio full payment: Proportion of credit cards where repayment of full balance 9. Portfolio insufficient payment: Proportion of credit cards where repayment below contractual minimum amount or no repayment made when due 10. Portfolio outstanding debt: (Sum of credit card statement balances – repayments) / (Sum of credit card statement balance)
Sponsors
Name: Financial Conduct Authority (FCA) Location: UK Url: https://www.fca.org.uk/
Partners
Name: Two anonymous UK credit card lenders Partner_type: private_company Name: Financial Conduct Authority (FCA) Partner_type: government Url: https://www.fca.org.uk/

Materials

Papers from this trial

  1. Guttman-Kenney, Benedict, Paul Adams, Stefan Hunt, David Laibson, Neil Stewart, and Jesse Leary. 2025. "The Semblance of Success in Nudging Consumers to Pay Down Credit Card Debt." American Economic Journal: Economic Policy 17 (4): 72–105. https://doi.org/10.1257/pol.20230568
  2. The Semblance of Success in Nudging Consumers to Pay Down Credit Card Debt (2023) Guttman-Kenney, Benedict & Adams, Paul & Hunt, Stefan & Laibson, David & Stewart, Neil & Leary, Jesse. NBER Working Paper No. 31926. https://www.nber.org/papers/w31926

Cited by

No citation data available for this registration yet.

Keywords