Can AI help people assess the trustworthiness of promises?

How to cite

Schmacker, Renke; Huang, Lidingrong. 2024. "Can AI help people assess the trustworthiness of promises?." AEA RCT Registry. AEARCTR-0013158. https://doi.org/10.1257/rct.13158-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Renke Schmacker* , Lidingrong Huang

* Primary investigator

Registry ID
AEARCTR-0013158
DOI
https://doi.org/10.1257/rct.13158-1.0
First registered
Last updated
Status
In development
Trial dates
2023-12-06 – 2024-10-06
Countries
Private
JEL codes
C93, D83
Registry record
http://www.socialscienceregistry.org/trials/13158

Abstract

We study the ability of AI to improve the assessment of trustworthiness using a natural field experiment. We collaborate with a nationally leading debt collection agency in the Philippines for this field experiment. After being contacted by collection agents, some debtors may offer their verbal promises to start repaying over the phone. Agents have to assess the trustworthiness of the promise and---if the promise is at risk of being broken---renegotiate the settlement. We test the effect of an AI-powered prediction model on the performance of debt collectors.

Intervention

Debt collectors are randomised into three experimental groups. One control group, one generic reminder treatment group that receives generic messages suggesting that not all repayment promises are trustworthy. One AI-generated feedback group that receives AI predictions on the trustworthiness of repayment promises. The only difference between the two treatment groups is in the message content.

Experimental design

Subjects are existing debt collectors working for our industry partner in the Philippines. Subjects are randomized either into a control group, a generic reminder group, and an AI-powered reminder group.

For the control group: No manipulation.

For the generic-reminder group: Subjects receive written reminders online through the internal communication channel that many repayment promises are reneged upon.

For the AI-powered reminder group: Subjects receive written reminders online through the same internal communication channel that a specific promise they received has a high probability to be reneged upon based on the AI prediction model.

Design details

Randomization method
Randomisation by a computer
Randomization unit
Individual
Clusters
900-1000 debt collectors.
Observations
900-1000 debt collectors.
Arms
900-1000 debt collectors.
Primary outcomes
Performance measures: • The percentage of PTPs that are honoured/fulfilled • Average number of days for agents to receive repayment on their accounts • Overall repayment amount Effort measures • Number of renegotiations done by agents • Number of PTPs agents receive • Agent-assessed trustworthiness of PTPs Note that PTPs refer to debtors' promises to pay.

Cited by

No citation data available for this registration yet.

Keywords