Political Communication on WhatsApp

How to cite

Carney, Kevin. 2021. "Political Communication on WhatsApp." AEA RCT Registry. AEARCTR-0007371. https://doi.org/10.1257/rct.7371-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Kevin Carney*

* Primary investigator

Registry ID
AEARCTR-0007371
DOI
https://doi.org/10.1257/rct.7371-1.0
First registered
Last updated
Status
In development
Trial dates
2021-03-14 – 2021-04-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/7371

Abstract

As communication has increasingly moved online, so have political conversations. In India, where the expansion of mobile internet access has been accompanied by the rise of social media, the relationship between social media and electoral outcomes is of particular interest. Yet little is known about the causal impact of social media on voters. Using an online field experiment, I will evaluate the impact of political groups on WhatsApp in the context of statewide election in Tamil Nadu, India. These groups are organized by political parties. Group members receive curated posts directly from party members, but are also able to post their own content to the groups and interact with each other. I will offer subjects an invitation link to a political WhatsApp group for their voting constituency, randomizing which of the two major political parties the assigned group is affiliated with. Conditional on clicking the hyperlink, I will further randomize subjects into one of three conditions: (1) a real group organized by the assigned party; (2) a broadcast-only group that mirrors the real group but where only official party content is forwarded but group members cannot post themselves; (3) a control, where upon clicking the link participants are redirected to a final survey page. Approximately 3-4 weeks later, I will resurvey participants, measuring political attitudes and beliefs. Conditions (1) and (3) provide an estimate of the treatment effect of the groups, while condition (2) allows me to parse the impact of the social interaction between group members relative to the official party messaging.

Experimental design

Prior to Tamil Nadu’s 2021 Legislative Assembly election, will recruit subjects to participate in the study using Facebook ads. We will target the ads at adults living in the 24 constituencies where we have WhatsApp group links for both major political parties contesting the election. The ads will link to a baseline survey on Qualtrics, where participants will answer questions about themselves, their media use, and their political opinions and attitudes. At the end of the survey, we will provide participants with a link to either a AIADMK or a DMK (the two leading political parties in Tamil Nadu) WhatsApp group. The partisan affiliation of the group will be randomly assigned, and participants are fully informed about the randomization. We will track clicks on the randomly assigned links. Participants who click a link will be redirected to one of two randomly assigned types of groups, or a control group.

Some participants will be redirected to a group organized by the assigned political party (condition 1). These groups exist outside the context of the study, are organized at the constituency level, and allow any member to freely post text messages, images, videos, and audio recordings. They may also reply to previous messages posted to the group. Additionally, party members that administer the group feed the group with a steady stream of curated official party messaging. All group members can see all content that is posted to the group while they are a member. The group that a participant is invited to will correspond to the constituency where they report that they vote. If a group is not available for their constituency, the subject will be offered a link for a group that is organized at state level.

Other participants will be assigned to a broadcast-only group (condition 2). These groups are also organized at the constituency level, and each possible group corresponds directly to a group from condition 1. However, in these groups, group members are not themselves allowed to post. Instead, only the messages posted to the corresponding condition 1 group are automatically forwarded to the group. Participants are informed about the nature of these groups and that they only contain content coming directly from party administrators.

Finally, some participants who click the assigned link will be assigned to a control group (condition 3) and redirected to a final page of the survey where they are told that no link will be offered.

Approximately 3-4 weeks later, we will recontact participants to complete an endline survey, where we will measure changes in their political beliefs, attitudes, and knowledge. To understand mechanisms, we will also elicit their perceptions of the political beliefs and attitudes of the general population in their constituency, to understand whether they under- or over-account for the degree of selection in the messaging they were exposed to.

Design details

Randomization method
All randomization will occur at the individual level. First, we will randomize the partisan affiliation of the group invitations, using an equal possibility of being assigned to each of the two major parties in Tamil Nadu (the AIADMK and the DMK). Because we do not expect full compliance with the group invitations, we will randomize participants to a full group, a broadcast group, or a control group conditional on them clicking on a link to join a group for the assigned party. The link will simply state the partisan affiliation assigned but not which of the two types of groups (or control) the person has been assigned to — this will only be revealed once the link is clicked. We will assign participants to a full group, broadcast group, or control at an equal 1:1:1 ratio.
Randomization unit
Individual
Clusters
N/A
Observations
We aim to enroll 1,500 people in the experimental portion of the study — 500 each in the full group, broadcast group, and control conditions. Because only people who click the link that appears will actually be randomized to a group, the total number of baseline participants will exceed 1,500 but is unknown, as it will depend on take-up rates. Additionally, because we will recruit using Facebook ads, which vary in price and success rates, the actual sample size may be slightly larger or smaller, subject to the budget and click rates. We will only invite experimental participants, who clicked a link (and are therefore the relevant “compliers” for this intervention), to the endline survey.
Arms
1/2 Assigned AIADMK link 1/2 Assigned DMK link Which will be cross randomized with 1/3 Full group 1/3 Broadcast-only group 1/3 Control
Primary outcomes
Political persuasion — Did treated subjects’ political opinions change as a result of the groups Second-order beliefs — Did group participation influence perceptions of others’ beliefs and attitudes among a general public? Group participation — How did click rates, join rates, leave rates, and attention vary across the groups?
Secondary outcomes
Political affect — Did subjects affect towards their ideological opponents change as a result of the groups? Political involvement — Do subjects feel personally invested in the outcome of the election? Knowledge — Did the groups make members more informed? Voting behavior — Did people vote and if so, for which candidates?

Cited by

No citation data available for this registration yet.

Keywords