How to communicate uncertainty? The effects of asymmetrical interval predictions on ambiguity attitudes.

How to cite

Minnich, Aljoscha; Roggenkamp, Hauke; Lange, Andreas. 2021. "How to communicate uncertainty? The effects of asymmetrical interval predictions on ambiguity attitudes.." AEA RCT Registry. AEARCTR-0007598. https://doi.org/10.1257/rct.7598-1.3

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Aljoscha Minnich* , Hauke Roggenkamp , Andreas Lange

* Primary investigator

Registry ID
AEARCTR-0007598
DOI
https://doi.org/10.1257/rct.7598-1.3
First registered
Last updated
Status
Completed
Trial dates
2021-04-26 – 2021-09-15
Countries
Germany ()
JEL codes
D81, D83
Registry record
http://www.socialscienceregistry.org/trials/7598

Abstract

We investigate experimentally how a forecaster’s acknowledgement of uncertainty affects the reader’s ambiguity attitudes in a task that is characterized by a high degree of uncertainty. To this end, we expose a representative survey sample to historical temperatures and indirectly ask them to make a forecast using Baillon et al’s (2018) method. Subsequently, we introduce them to a real expert’s temperature forecast and repeat Baillon’s tasks. The weather forecast is manipulated exogenously in a 2x3 between-subject design and differs with respect to the communication strategies: The forecast contains either a point estimator, an asymmetric interval estimator, or both. In addition, we vary the forecasts’ moment of surprise as one set of forecasts (literally) is in line with the historical temperatures, while the other set is not. Baillon et al.’s elicitation method yields two ambiguity measures per respondent, both pre and post treatment. This allows us to make inferences about the impact of communication strategies and their interaction with conflict aversion arising from the (lack of) surprise on ambiguity attitudes.

Intervention

There are 2x3 groups in this study. All of them read the same set of instructions and are exposed to the same set of historical weather data. As a consequence, these are treated equally before treatment. The treatments are introduced as weather forecasts that vary between subjects in two dimensions: The forecast contains either a point estimator, an asymmetric interval estimator, or both. In addition, we vary the forecasts moment of surprise as one set of forecasts is in line with the historical weather data, while the other set is not.

Experimental design

This experiment will be conducted in the form of a representative survey in Germany. Before conducting a representative survey, we will also conduct a pilot project with about 120 participants drawn from a local adult convenience sample to test the participants' understanding and time requirements. The experiment (including the pilot) qualifies as an artefactual field experiment that will be conducted remotely and asynchronously.
After reading instructions and answering comprehension questions, respondents are exposed to some historical temperatures. With these information at hand, they decide at which probability of winning they prefer a risky lottery to a bet on temperature outcomes nine days in the future. Following Baillon et al. (2018), respondents make this decision for six different bets. Importantly, these six decisions are made before respondents are exposed to any treatment meaning that the provided information does not differ between respondents at this stage.
Before subjects make the same set of decisions once more, they are provided with a weather forecast, that we exogenously manipulate in a 2x3 between-subject design. More precisely, we provide the respondents with forecasts that differ with respect to its communication strategy as well as its momentum of surprise: The forecast contains either a point estimator, an asymmetric interval estimator, or both. In addition, we vary the forecasts moment of surprise as one set of forecasts is in line with the historical weather data, while the other set is not. The six treatments are randomly assigned at the individual level.
Respondents are then required to complete a short questionnaire to collect data on possible control variables. Questions include demographic variables (age, gender, income, zip code, education level, number of children, marital status), risk preferences (general, weather domain), assessment of the forecast (in terms of accuracy and trustworthiness), weather variables (use of weather forecasts, current outdoor temperature), and task comprehensibility.
Finally, the location, time, and realized temperatures corresponding to the historical and forecasted temperatures as well as the sources of these information are revealed, the payoffs are calculated, and the survey is closed.

Design details

Randomization method
Randomization is done applying python 3’s random.shuffle() function to two treatment arrays at the beginning of a session.
Randomization unit
Individual.
Clusters
120 individuals (pilot) + about 1500 individuals (the pilot was used to conduct a power analysis and therefore we increased the number of individuals from 1200 to 1500).
Observations
120 individuals (pilot) + about 1500 individuals (the pilot was used to conduct a power analysis and therefore we increased the number of individuals from 1200 to 1500).
Arms
Individuals will have a 50 percent chance of being randomly assigned to either the surprise or non-surprise treatment. In each of these arms they will have a 33.33 percent chance of being randomly assigned to one of the three communication strategies. As a consequence, there is an expected probability of 16.66 percent of being randomly assigned to one of the six treatments.
Primary outcomes
Baillon et al. ‘s ambiguity aversion index as well as their ambiguity-generated insensitivity index. Both pre and post treatment.
Secondary outcomes
Control variables from a short questionnaire at the end of the survey: • Demographic variables (age, gender, income, zip code, education level, number of children, marital status), • Risk preferences (general, weather domain), • Assessment of the forecast (in terms of accuracy and trustworthiness), • Weather variables (use of weather forecasts, current outdoor temperature), • Task comprehensibility.

Cited by

No citation data available for this registration yet.

Keywords