Guiding Consumer Search and Seller Competition with Ranking Algorithms
How to cite
Cai, Gaoyang. 2024. "Guiding Consumer Search and Seller Competition with Ranking Algorithms." AEA RCT Registry. AEARCTR-0013988. https://doi.org/10.1257/rct.13988-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This research studies the impact of platform ranking algorithms on consumer beliefs, and behaviors in product discovery, search, and purchase, as seller price competition. I conduct a field experiment focusing on the demand side to disentangle the impacts on consumer beliefs from consumer search costs. The experiment divides participants into four groups, varying in the belief elicitation process and product ranking algorithm. The experiment data will be used to estimate a structural model that incorporates two-sided markets and platform design in ranking algorithms.
Intervention
This field experiment has three types of interventions. The first is different belief elicitation processes. The second is the different product ranking algorithms facing consumers who intend to search for and purchase products. The third is different information disclosures.
The first intervention involves two types of belief elicitation processes: the first is to incentivize participants to fill out a prior belief survey and install data collection apps to collect their search and purchase data in the Amazon mobile app. After consumers discover, search for, or purchase products on Amazon, they will be finally incentivized to complete a posterior belief survey, while the second is to sequentially alternate between showing them products according to different ranking algorithms and eliciting beliefs.
The second intervention involves two types of product ranking algorithms: the first is Amazon's algorithm (with no additional change); the second is the random ranking algorithm, specifically, randomizing the order of products shown on the first result page under search terms consumers intended to search on Amazon.
The third intervention involves different information disclosed to consumers: consumers in the control group will face Amazon's ranking algorithm with full information (one control group uses the first belief elicitation process; the other control group uses the second); consumers in one treatment group will face the random ranking algorithm with no information, while consumers in the other treatment group will face the random ranking algorithm with full information.
Experimental design
I randomly divide participants into 4 groups, each has 1/4 of the total participants.
1/4 of the subjects will be randomly selected into the control group C1. Subjects in this group will not have any interventions; they will be directly incentivized to fill out a prior belief survey and install data collection apps to collect their search and purchase data in the Amazon mobile app. After consumers discover, search for, or purchase products on Amazon, they will be finally incentivized to complete a posterior belief survey.
Another 1/4 of the subjects will be randomly selected into the control group C2, they will not be incentivized to install data collection apps. Instead, we will sequentially ask them to report their prior beliefs on the benefits they can obtain from discovering products on Amazon, and show them products under the search term they intend to search according to Amazon’s product rankings. And then ask participants to report their posterior beliefs on the benefits they can obtain from discovering products at subsequent search ranks.
The remaining 1/2 subjects will be assigned to the treatment groups, among them 1/2 (1/4 out of the total number of participants) will be randomly assigned to treatment group 1. They will be asked to complete a prior belief survey before being incentivized to install the data collection apps. However, we will randomize the product orders displayed on the first page of Amazon mobile apps under the corresponding search term consumers intend to search. Participants in this group will not be informed of the random ranking algorithm. After consumers discover, search for, or purchase products on Amazon, they will be finally incentivized to complete a posterior belief survey.
The other 1/2 (1/4 out of the total number of participants) will be randomly assigned to treatment group 2. The only difference between this group and treatment group 1 is that participants in this group will be informed of the random ranking algorithm.
Design details
Cited by
No citation data available for this registration yet.