How Different Information Nudges Influence Users to Disable Douyin’s Personalized Recommendation Algorithm
How to cite
Lyu, Yang; Meng, Juanjuan; Gao, Yu. 2025. "How Different Information Nudges Influence Users to Disable Douyin’s Personalized Recommendation Algorithm." AEA RCT Registry. AEARCTR-0015992. https://doi.org/10.1257/rct.15992-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Douyin utilizes personalized recommendation algorithms to provide users with more relevant content and services tailored to their preferences. However, this feature may also lead to negative effects such as overuse and the creation of "information cocoons." The Douyin app offers a "One-Click Disable Personalized Recommendation Algorithm" function, after which users no longer receive content recommendations based on personalized factors.
This project aims to explore how providing information can, and what kind of information can, more effectively improve users’ willingness to disable personalized recommendations. It also investigates changes in users' algorithm settings, usage patterns, and experiences after receiving such information. The findings will provide insights into helping digital platform users prevent overuse and avoid "information cocoons" while contributing to a deeper understanding of user psychology and behavior.
Intervention
Our intervention is to provide information to Douyin users about the potential positive effects if they disable the personalized recommendation algorithm on Douyin, and then we observe whether they actually disable it and how their usage time changes. There are two kinds of information as treatment in our experiment: (1) Disabling the personalized recommendation algorithm can help mitigate overuse (based on Gao et al., 2024); (2) Disabling the personalized recommendation algorithm can broaden information channels (based on Levy, 2021). In control group, we provide irrelevant information with comparable text length in Chinese, as active control.
Experimental design
The core experimental module will randomly assign participants to three groups: Control, Treatment 1, and Treatment 2. Each group will receive two rounds of information, spaced one week apart. Participants will upload screenshots of their Douyin app homepage and the "Disable Personalized Recommendation Algorithm" interface to verify algorithm settings. Additionally, there will be questions for other relevant data.
Process Overview:
1. Control: Receives two rounds of unrelated information of comparable length to the experimental groups.
2. Treatment 1: In the first round, informed about the anti-addiction effects of disabling the algorithm; in the second round, informed about its effect on broadening information channels.
3. Treatment 2: In the first round, informed about the effects of broadening information channels; in the second round, informed about its anti-addiction effects.
This crossover experimental design will help identify the upper and lower bounds of the impacts of the two types of information.
Additionally, some participants may disable the personalized recommendation algorithm after receiving the experimental information but later re-enable it. Potential reasons for this behavior include present bias, expectation bias, and projection bias related to their utility functions. Therefore, we include questions related to these mechanism in our surveys to tease out the channels.
As for the timeline, there will be firstly a recruitment survey. One week later, baseline survey + wave 1 information treatment. Another week later, wave 2 information treatment. Another week later, endline survey. And there will be also a long-run tracking survey 4 weeks after the endline survey.
Design details
Cited by
No citation data available for this registration yet.