An Experimental Infrastructure to Investigate the Impact of Online Tracking, Targeting, and Advertising on Consumer Behavior and Consumer Welfare
How to cite
Acquisti, Alessandro; Cheyre, Cristobal.
2025. "An Experimental Infrastructure to Investigate the Impact of Online Tracking, Targeting, and Advertising on Consumer Behavior and Consumer Welfare." AEA RCT Registry. AEARCTR-0015956.
https://doi.org/10.1257/rct.15956-2.0
Download:
BibTeX
·
RIS— for reference managers without a browser
translator. Zotero and most
others pick up this page's citation metadata directly.
The online data industry has often heralded the benefits of online tracking and targeting, particularly in the context of online advertising. Its claims are juxtaposed by the privacy concerns associated with the vast number of ad-tech companies tracking and analyzing consumers’ online behavior – often without consumers’ awareness. We designed a field experiment to analyze the impact of online tracking, targeting, and advertising (as well as the impact of ad-blocking and anti-tracking tools), on a variety of consumers’ online behaviors (including browsing, digital news/information/entertainment consumption, online searches, interactions with LLMs, interactions with privacy settings and "consent mechanisms, online shopping, and so forth), as well as a variety of consumers' outcomes (including metrics associated with online purchases, metrics related to perceived privacy, willingness to remain subject to tracking and targeting and advertising, as well as various self-reported measures of satisfaction, including satisfaction with browsing, products purchased, displayed ads, and so forth).
Intervention
Participants are assigned to three experimental conditions: control, ad-blocking, and anti-tracking.
Experimental design
Participants will be recruited via a variety of recruitment channels and screened through an initial Qualtrics survey. Qualified and consenting participants will complete a baseline entry survey about their online behaviors and preferences/attitudes, and will then install the study software (including the browser extension, email extension, and smartphone apps) on their devices. The software will apply experimental treatments and will collect data passively for three months. Participants will complete monthly surveys and a final exit survey. At the end, they may choose to upload additional data or extend participation for extra compensation. They will then be guided through uninstalling the software.
Design details
Randomization method
Randomization is performed by the software installed by the participants.
Randomization unit
Individual participant.
Clusters
1,200 participants planned, but will depend on how many actually get enrolled.
Observations
1,200 participants
Arms
400 per experimental treatment.
Primary outcomes
This is an experimental infrastructure designed to investigate an array of research questions related to the impact of online advertising, tracking, and targeting, as well as protections from advertising, tracking, and targeting, on a variety of consumers' online behaviors and online outcomes. The infrastructure consists in a client-server architecture, with the client component consisting of desktop and smartphone software that participants will install on their devices, and the server component consisting of secure databases that will receive and store de-identified/anonymized information collected from the participants' machines. While the experimental infrastructure itself is described under the "Experimental Design" section of this trial information, in this section ("Primary Outcomes") we discuss the key variables collected by the infrastructure. The infrastructure collects four types of data: desktop browser data, email data, smartphone browser data, and survey data. Before any type of data is sent from the clients to the servers, the data is stripped of any personal identifying information. The infrastructure is built to uphold the highest standards of privacy and confidentiality for its participants.
1. Desktop browser data
Desktop browser data includes multiple data fields. Some of these fields are collected for all websites visited by the participant during the experiment (for instance: visited urls); others data fields are collected only on specific websites (for instance: html content for the shopping, search, and LLM websites visited by the participant). The fields include:
+All Website Visits
Web Navigation Details:
URL (domain, parameters, timestamps), stripped of PII
HTTP Headers (cookies)
Header Bidding
Transition Type: Clicked link, typed, redirect, bookmark
Advertisement Content on Page:
Web requests to known ad domains
Visual Ad Content (HTML, images)
Non-visual Ad Content
Tracking elements (pixels, beacons, cookies, etc.)
Shopping, Website Visits:
Full Page Content (HTML, CSS, images, scripts), stripped of PII
Information Extracted:
Products: Viewed, compared, searched, added to cart, purchased
Timeline: Time spent on each stage of product research and purchasing
Search and LLM Website Visits:
Full Page Content (HTML, CSS, images, scripts), stripped of PII
Information Extracted:
Search: Queries, results, sponsored results, clicks
Timeline: Time spent reviewing results, paging through results
Browser Context and Configuration:
Settings and permissions for both the browser and for specific websites
Participant’s use of multiple windows, tabs, third-party extensions
Interactions with Consent Mechanisms
2 Email data
From the participant’s email, an algorithm identifies and collects data from purchase confirmation emails and promotional emails. Data collected from promotional emails includes subject line, timestamp, and sender. Data collected for shopping emails include:
Email Metadata: Timestamp, sender
Email content: Vendor, product information, price, quantity, stripped of PII
3 Smartphone data
Web Navigation Details:
URL (domain,timestamps)
4.4.3 Survey data
Survey data includes anonymized responses to entry, periodic, and exit surveys. Surveys include questions related to:
Buying experiences and finances
Browsing experiences
Subjective well-being
Ads attitudes
Tracking, targeting, and privacy attitudes
Demographic questions
WTA questions
Secondary outcomes
As noted above, this is an experimental infrastructure designed to investigate an array of research questions related to the impact of online advertising, tracking, and targeting, as well as protections from advertising, tracking, and targeting, on a variety of consumers' online behaviors and online outcomes. While the primary goal is to investigate research questions about participants as consumers and buyers of products, the infrastructure allows much broader investigations of participants' other online behaviors. For instance, a non-exhaustive list of additional research questions that we intend to tackle includes:
- Study how participants in the ad-blocking condition respond to websites that restrict access to users with ad blockers.
- Investigate how ads and tracking interact with the usage of large language models (LLMs).
- Explore the relationship between advertising/tracking and the consumption of online entertainment.
- Study how ads and tracking influence the consumption of online media.
- Analyze how advertising and tracking influence the sources and the quality of content consumed by participants.
- Analyze the relationship between advertising, tracking, and political beliefs.
- And so forth.
Cited by
No citation data available for this registration yet.