Effect of Question Order on the Statistical Relationship between Investors' Recall and Their Expectations

How to cite

Liu, Hongqi; Jiang, Zhengyang; Peng, Cameron; Yan, Hongjun. 2024. "Effect of Question Order on the Statistical Relationship between Investors' Recall and Their Expectations." AEA RCT Registry. AEARCTR-0013186. https://doi.org/10.1257/rct.13186-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Hongqi Liu* , Zhengyang Jiang , Cameron Peng , Hongjun Yan

* Primary investigator

Registry ID
AEARCTR-0013186
DOI
https://doi.org/10.1257/rct.13186-1.1
First registered
Last updated
Status
Completed
Trial dates
2024-03-25 – 2024-04-05
Countries
China ()
JEL codes
D83, D91, C91, G41
Registry record
http://www.socialscienceregistry.org/trials/13186

Abstract

The experiment studies the effects of question order on the statistical relationship between two pieces of data that we collect through surveys: investors’ memory of past stock market experiences and future return expectations. We conduct these surveys among retail investors in China. Respondents are randomly assigned to one of three groups, each answering the same questions but in varying sequences.

Intervention

The experiment studies the effects of question order on the statistical relationship between two pieces of data that we collect through surveys: investors’ memory of past stock market experiences and future return expectations. We conduct these surveys among retail investors in China. Respondents are randomly assigned to one of three groups, each answering the same questions but in varying sequences.

Experimental design

To collect investors’ recall of past experiences in the stock market and their expectations of the future performances of the market and one’s own portfolio, our study surveys retail investors in China.

Our survey contains four blocks, free recall block, probed recall block, the expectation block, and the demographical information block. The free recall block asks investors to recall an episode that first comes to their mind when they think about stock market movements in the past. The probed recall block asks investors to recall their own returns in the stock market in the past one day, one month, one year or five years. Respondents’ answers in these two blocks will be used to construct measures of their recall of past stock investment experiences. In the expectation block, we elicit two types of expectations, one about future market returns and one about future own returns. Respondents’ answers in this block will be used to construct measures of their return expectations for the future. At the end of the survey, we collect demographics and other information in a standard questionnaire, including age, gender, wealth, income, social activities, and so on.

To examine the effect of question order on the statistical relationship between recall and expectation, we've created three versions of our survey. Each version contains the same set of questions but arranged in different orders.

Design details

Randomization method
We will distribute three versions of the survey, each version containing the same questions but in different orders. To randomly assign investors, we require the Wenjuanxing platform (a prominent Chinese survey service provider equivalent to Amazon Mechanical Turk) to randomly send to each investor in their pool only one of the three invitations. To ensure the integrity of the randomization, we will analyze the distribution of respondents' biographical information.
Randomization unit
Our randomization is at the individual level.
Clusters
One cluster which is the sample pool of Wenjuanxing, a prominent Chinese survey service provider equivalent to Amazon Mechanical Turk.
Observations
1500 respondents in total.
Arms
We plan to send out three versions of the same survey. We target 500 respondents for each version.
Primary outcomes
Recalled episode returns, Recalled own returns, Expected future returns

Cited by

No citation data available for this registration yet.

Keywords