AI Saliency and Robo Advisor Adoption

How to cite

Ding, Wenzhi; Wang, Xincheng; An, Jiafu. 2023. "AI Saliency and Robo Advisor Adoption." AEA RCT Registry. AEARCTR-0011885. https://doi.org/10.1257/rct.11885-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Wenzhi Ding* , Xincheng Wang , Jiafu An

* Primary investigator

Registry ID
AEARCTR-0011885
DOI
https://doi.org/10.1257/rct.11885-1.0
First registered
Last updated
Status
In development
Trial dates
2023-08-07 – 2023-08-21
Countries
China ()
JEL codes
D14, C93, G23
Registry record
http://www.socialscienceregistry.org/trials/11885

Abstract

As people recognize the capabilities of AI, it raises the question of whether this positive attitude will extend to products that utilize AI technology. Specifically, in household finance, financial companies have introduced AI-assisted investment robo-advisors to optimize investment outcomes for investors. To investigate further, we plan to collaborate with a Chinese household investment mobile application. We aim to provide users with information about AI and then observe whether these users demonstrate a heightened preference for robo-advisor investment products when making choices among various financial products.

We are outlining an experiment where we aim to replace the splash screen of the mobile software for the experimental group with slogans associated with AI hot topics, carefully linking these slogans to various fields and professionals. On the other hand, the control group will be presented with a splash screen featuring sayings that are unrelated to AI. By comparing the responses of the experimental and control groups, we can gauge whether AI hot topics have a positive impact on users' inclination toward adopting AI-assisted investment portfolios. Furthermore, by examining the influence of individuals from different professions and levels of prominence, we intend to analyze whether authoritative figures influence users' perspectives on AI investment capabilities.

Intervention

We show the treatment in the splash screen when the user opens the mobile application.

The treatment consists of three parts: (1) Slogan; (2) Name of quoted person; (3) Title of quoted person. Since our treated users are Chinese, we will describe the treatment in Chinese and English.

We have three types of slogans:
S1. No slogan
S2. "The age of AI has begun" (人工智能时代已经开始)
S3. "AI will replace X% human jobs" (人工智能将取代X%的人类工作)

We have these combinations of quoted persons and their titles:
Q1. Fick Parson, ChatGPT Creator (菲克帕森,ChatGPT缔造者)
Q2. Sam Altman, ChatGPT Creator (山姆阿尔特曼,ChatGPT缔造者)
Q3. Bill Gates, ChatGPT Creator (比尔盖茨,ChatGPT缔造者)
Q4. Sam Altman, Tech Tycoon (山姆阿尔特曼,科技大亨)
Q5. Bill Gates, Tech Tycoon (比尔盖茨,科技大亨)
Q6. Elon Musk, Tech Tycoon (马斯克,科技大亨)
Q7. Warren Buffet, Finance Tycoon (巴菲特,科技大亨)
Q8. Rupert Murdoch, Media Tycoon (默多克,科技大亨)

We will not test all combinations due to the sample size limitation. The treatment combinations to be tested are:

- S1 (1 group)
- S2+Q1-8 (8 groups)
- S3+Q3 (where X=20, 50, 80, 3 groups)

Therefore, there will be 12 groups in total.

Experimental design

We plan to show the users the intervented splash screen throughout the 14-day experimental period. We will randomly draw 5,000 users who logged into the mobile application within four weeks to one week before the experiment. Then we will randomize them into 12 groups. We repeat the randomization for several rounds to ensure the users are balanced regarding several pre-trial traits, such as age, gender, and asset amount, register date.

The treatments are described in the "Intervention" part.

Design details

Randomization method
Pre-treatment trait balanced sampling. The randomization is done in the office by a computer, and the group of users is pre-determined based on the randomization outcome.
Randomization unit
Individual user-level.
Clusters
5000 active users.
Observations
5000 active users.
Arms
400 active users for each treatment arm.
Primary outcomes
The net inflow investment amount into the robo-advisor portfolios.

Cited by

No citation data available for this registration yet.

Keywords