Field experimental evidence supporting the sunk cost effect is scarce and suffers from identification issues. We illuminate this topic by designing an experiment that exogenously varies the temporal cost of watching a YouTube video, to see how it affects user engagement. We randomize whether the time until a pre-video ad becomes skippable is shortened, normal, or extended. This allows us to test not only for the existence of the sunk cost effect, but also its asymmetry in the gain/loss region.
Experimental design
The experimental design is hidden until the end of the trial.
Design details
Randomization method
Randomization is conducted through the browser extension. For each video, the extension (using JavaScript) generates a random number between 0 and 1. If the number exceeds 2/3, we assign the long treatment (10 seconds wait time). If the number is between 1/3 and 2/3, then we assign the default treatment (5 seconds wait time). Lastly, if the number is below 1/3, we assign the short treatment (0 seconds wait time). Note that the treatment status remains unchanged when the user refreshes or accesses another video within 8 seconds of the ad starting.
Randomization unit
A YouTube video
Clusters
N/A
Observations
We recruit our sample for 4 weeks. We expect at least 30,000 observations depending on the frequency with which the participants watch YouTube videos with skippable ads.
Arms
We expect at least 10,000 observations per treatment condition.
Primary outcomes
Video engagement time: we define it to be the time between (1) when the video loads after the ads and (2) the first time the user transitions out of the video page.
Secondary outcomes
We will look at heterogeneity with respect to the length of the video. We will categorize observations by video length in the following way – shorter than 3 minutes, 3-6 minutes, 6-10 minutes, 10-20 minutes, longer than 20 minutes.
We will look at the subsample of videos where we exclude music videos – which might be intended to be played in the background. We will identify those videos as ones that are more than 10 minutes long, and are in the “music” category.
Additionally, we are going to test whether the duration of exposure to factors affecting the sunk cost changes the strength of the effect. To that end, we compare the effect size in the first two weeks vs. the last two weeks.
Lastly, we will collect data on whether an ad is clicked.
Cited by
No citation data available for this registration yet.