Analysis of player decisions in a mobile game to study the influence of counterfactual thinking on insurance demand
How to cite
Strümpel, Dennis.
2020. "Analysis of player decisions in a mobile game to study the influence of counterfactual thinking on insurance demand." AEA RCT Registry. AEARCTR-0005996.
https://doi.org/10.1257/rct.5996-3.0
Download:
BibTeX
·
RIS— for reference managers without a browser
translator. Zotero and most
others pick up this page's citation metadata directly.
We analyze the impact of counterfactual thinking on the risk management decisions of players of a mobile game. In our experiment, individuals engage in risky lotteries that can lead to losses of their in-game wealth. To prevent a loss, individuals can purchase insurance coverage. It is well known that individuals adapt their behavior following a factual outcome (e.g., individuals exert a higher level of risk aversion after a loss). However, it is less known how individuals react to receiving the information of how close they were to avoiding or suffering a loss. We additionally examine whether counterfactual information affect the self-reported satisfaction of the preceding period’s insurance demand. The field experiment is incentive compatible and allows for tests against the null hypothesis that counterfactual thinking does not affect risk taking behavior.
Experimental design
The task of the participants is to select one of 12 boxes. The participants are informed that the boxes are either empty or contain a bomb. As we analyze decisions under risk, the distribution of empty boxes and bombs is shown to the participants. However, the participants do not know the content of a specific box until it has been opened. If the participants choose a box with a bomb, they lose some of their in-game currency. In contrast, choosing an empty box does not cause a loss.
Design details
Randomization method
Subjects are randomly allocated to the control or treatment group when agreeing to the consent form. 25% of the subjects are allocated to the control group. 75% of the subjects are allocated to the treatment group.
The lotteries will show up everytime a player completes at least three levels in three different runs within the same game session and are randomly chosen by the computer.
Randomization unit
The randomization unit of the group allocation is the individual subject.
Clusters
Not applicable to our case (see above).
Observations
Our setting deviates from traditional experiments in the sense that the number of downloads in Google’s Play Store determines the number of subjects in our experiment. We will upload the game to Google’s Play Store on 12 June 2020 and expect the game to be public on the same day (delays are possible due to Google's processing). We will additionally upload a promotional video to YouTube on 19 June 2020 (this date is, however, subject to discretion of the promoting influences). We expect only a small number of game downloads until the release of the promotional video and thus see the date of the promotional video as our trial start. For the analyses described, we only use data from the first 30 days after the release of the promotional video. The sample size of our experiment is therefore dependent on the number of downloads from Google’s Play Store and the game’s retention rate. Thus, the sample size is not predictable at this stage.
We will additionally filter our data as described below and provide for each filter corresponding reason in parentheses:
We remove players that are uniquely identifiable based on the collected demographic variables (self-reported age, self-reported gender, and country). [data protection law]
We are only allowed to process the choice of players that specify an age greater or equal to 16. [data protection law]
The lotteries will show up after every second run a player completes at least one level within the same game session[experimental design].
Example 1:
Session 1: Run 1: Completed Levels: 1
Session 1: Run 2: Completed Levels: 0
Session 1: Run 3: Completed Levels: 2
Session 1: Lottery is displayed to the player.
Session 1: Run 4: Completed Levels: 5
Session 1: Run 5: Completed Levels: 3
Session 1: Lottery is displayed to the player.
Example 2:
Session 1: Run 1: Completed Levels: 2
Session 1: Run 2: Completed Levels: 3
Session 1: Lottery is displayed to the player.
Session 2: Run 1: Completed Levels: 5
Session 3: Run 1: Completed Levels: 3
Session 3: Run 2: Completed Levels: 3
Session 3: Lottery is displayed to the player.
Arms
We have two treatment arms. We allocate 25% of the subjects in the control group and 75% into the treatment group.
Primary outcomes
We examine the difference in insurance demand for the treatment and control group. Since the control group doesn't receive any information regarding the counterfactual closeness, we can reject that counterfactual thinking don't affect insurance demand when we observe systematically different insurance choices between the two groups after the same factual outcome (loss, null).
We also examine the difference in the self-reported satisfaction of the players insurance demand for the treatment and control group. Since the control group doesn't receive any information regarding the counterfactual closeness, we can evaluate how this information affects the self-reported satisfaction for the same factual outcome (loss or null) and insurance coverage.
Cited by
No citation data available for this registration yet.