Price Information and Competitive Spillovers in an Online Platform in Pakistan
How to cite
Nakamura, Shotaro; Hasanain, Syed Ali; Tariq, Adeel. 2021. "Price Information and Competitive Spillovers in an Online Platform in Pakistan." AEA RCT Registry. AEARCTR-0007537. https://doi.org/10.1257/rct.7537-2.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
In developing markets facing information and search frictions, how do agents access price information, update their beliefs about market conditions, and make pricing and other strategic choices? Also in such environments, what are the extent to which individual agents' access to information and their choices generate spillovers to other market participants? We explore these questions via a randomized control trial on a major online listing platform for used vehicles in Pakistan, where, along with other developing economies, increasing shares of transactions are shifting to online and mobile platforms. In our intervention we will provide estimates of transaction prices to sellers on a listing platform for used vehicles in Pakistan from February to April, 2022. We vary treatment saturation at the market-segment level by a two-stage randomization design so as to capture both direct and spillover effects. We measure the effect of providing private price information to sellers on their choices and outcomes, and capture spillover effects on competing sellers. In our primary analysis, we will detect direct and spillover effects on a) changes to the listing price, b) occurrence of transaction, c) transaction price, d) usage of advertising tools, and e) index of buyer attention. In our secondary analysis, we will identify ways in which the intervention interacts with, or in turn affects, market efficiency and structure.
Intervention
In our intervention, we will privately provide sellers price information on a listing platform for used vehicles in Pakistan, called PakWheels. The price information, which PakWheels calls “the Price Calculator”, is an estimate of transaction prices, based on a machine-learning model designed predict the self-reported transaction price of previous listings from the firm’s database. The estimate is conditional on a) the occurrence of transaction and b) observable characteristics of the vehicle, but not of sellers’ characteristics. Our hypothesis is that this information will help sellers identify realistic transaction prices, and set listing prices accordingly.
We will conduct the intervention to a subset of the flow of new posts on PakWheels, as part of the post-making process. On PakWheels’ web platform and mobile apps, sellers can create a new post by clicking on “Post an Ad.” They are first asked to log in, so that we can identify the user-ID associated with each post. Users would neither know their user-ID (it is internal to PakWheels) nor for which last digits we are providing the Price Calculator. Once logged in, users are asked to provide information on the vehicle they intend to sell, and then to set the listing price. If the seller is assigned to treatment, they will then be shown the Price Calculator estimate, i.e. the machine-learning based transaction price forecast, as well as the 10th and 90th percentiles of reported transaction prices for the make-model-model year (or the make-model-model year-version level for popular model-versions). Treated sellers will then be given a chance to update their listing price.
Experimental design
We have designed a two-step randomization procedure to identify both direct treatment and spillover effects of the price-information intervention. This intervention will be carried out by the firm over 8 weeks.
The platform receives approximately up to 100,000 valid listings per month. Our sample is every seller that creates a post on the platform during the intervention period, except if we do not have sufficient data to provide a Price Calculator estimate for a given make-models/make-model-model-year. We define these exclusion criteria to based on sufficient availability of self-reported transaction prices. These criteria restrict our sample to approximately 90% of total posts, consisting of approximately 70 distinct make-models.
Our two-step randomization process is as follows. In step 1, we will block-randomize the “cluster” of vehicles, defined as the make-model (e.g. Toyota Corolla), into 3 treatment groups: control, medium saturation (50%) and high saturation (90%). In step 2, we randomize posts into treatment based on the last digit of the user ID on PakWheels. In order to ensure that treatment and control groups are comparable over the primary outcome variables, we test for balance using listings data from a pre-treatment period with the same sample inclusion criteria as the experiment. We iterate the randomization procedure over 500 seeds, and randomly choose one seeds among the subgroup of assignments that failed to reject statistically significant differences in all primary outcome variables, adjusted for the false discover rate.
In step 1, we block the make-model clusters over standardized cluster-level means of primary outcome variables. Blocking is done with R’s blockTools package (Moore, 2012), which uses the optimal-greedy algorithm over the Mahalambois distance. We weight the five main outcome variables (log of price difference, occurrence of transaction, transaction price, advertising use, and demand index) twice as heavily as the cluster size. Our choice of weights is admittedly arbitrary, but we rationalize this as our objective is to balance over main outcome variables. Using these groupings, we will identify the first-stage assignment. In treatment clusters, we will randomly select 50% or 90% of new listings to receive the Price Calculator estimates, depending the saturation level the cluster was assigned to. None of the new listings in the “Control” clusters will receive the Price Calculator estimates. On the 9th week, all new listings will receive the Price Calculator.
In step 2, listing-level randomization is done based on the last digit of their user-ID on PakWheels. The choice of 5 or 9 digits is fixed across cluster and time, so as to limit the extent of potential interference and for logistical simplicity. The second-stage treatment digits are chosen based on a random number generator in R.
The intervention is designed in a way that limits the extent of treatment non-compliance as much as possible; for those randomly assigned treatment, the Price Calculator estimate is given automatically on the user interface during the post-making process. One exception is
that the sellers that use PakWheels’ mobile app can only receive Price Calculator estimates once they update their mobile app after the start of the intervention period. On the other hand, there is no need for an update if the user accesses PakWheels.com via the web (including internet browsers on mobile phones), so anyone assigned to treatment would receive it automatically. This may generate selection into treatment conditional on assignment, based on a) users’ preference for PakWheels’ app and b) their propensity to update the app. To this end, we will plan on identifying both intend-to-treat as well as treatment-on-treated effects. We will use the assignment variable as an instrument for treatment.
Design details
Cited by
No citation data available for this registration yet.