Companies often obfuscate cookie preference policies and consent forms in order to nudge users to share their data more than they would otherwise do. These practices, known as “dark patterns,” are pervasive despite their effects being poorly understood. With the use of Webmunk, a browser extension developed for research studies of this type, we explore the effects of dark patterns on consumers’ privacy choices and the effects that such choices have on the type and quantity of ads they receive. We are particularly interested in how the effects of dark patterns differ across large and small companies, and the ensuing firms’ competitive advantage in consumer data.
Experimental design
The treatment arms are represented by different cookie consent banner designs, which vary in the number of options available, the color, and the order of the options.
Design details
Randomization method
Computer randomization
Randomization unit
For the banners, person by domain. For the frequency, by person.
Clusters
We will recruit 800 individuals on Prolific. We expect some leakage in the process of correctly installing the extension so that we only have browsing data for 80% of participants (640). We powered the study so that we could detect a statistically significant 5 percentage point interaction effect between treatment and site type.
Observations
We expect to have organic browsing data for 640 individuals. During phase one, we will have 21*640 = 13440 observations of consent choices. During phase two, since users are browsing organically, we can't know ex ante.
Arms
We will assign arms with equal probability. This will result in a balanced number, with some slight differences due to chance.
Primary outcomes
Consent choice: per domain, over time, by domain characteristics. In particular, the user choices that we are interested in include the following:
Accepting all cookies;
Clicking on “Cookie settings” and making more granular choices;
Rejecting all cookies;
Closing the banner without making a choice.
Accepting the 'default' (the top-most option in the banner).
Secondary outcomes
* Secondary analysis (end points, heterogeneity)
> We also plan to look at the following subject characteristics when examining subject-level heterogeneity:
>
> - Demographics: education, income, gender, age cohort, race and ethnicity; states that they live in (esp. if they are in a state that already enacted privacy laws)
> - Time spent online per day.
> - Stated reason for sharing vs. declining to share data with websites. This will involve classification of free form text responses in survey 2.
> - Attention while in the study: proxy measures include their time spent in answering the surveys and their response to our attention check questions.
> - Heterogeneity by order in which the choice was made in the survey.
> - Conditional on being able to correctly classify tracking cookies in our data, which we are still determining, we will look at how different treatments affect the composition of consumers willing to share data to a domain (e.g. whether they are potential or existing customers).
> We consider these to be secondary outcomes because our main focus is on site-level heterogeneity and not subject-level heterogeneity. However, to the extent that controlling for subject characteristics helps reduce the noise and improves the power of our estimate, and given the fact that participants are randomized into different treatment conditions, we will include these characteristics in our richest model specifications.
> We will also analyze the experiment by limiting the data to pairs of treatment arms, since this may be easier to explain and will likely result in similar estimates.
> To analyze the effects of frequency of pop-ups, using data from their organic browsing, we will consider whether individuals who were exogenously exposed to more frequent pop-ups made similar choices to those who were exposed to less frequent pop-ups.
Cited by
No citation data available for this registration yet.