Scientific Decision-making (SDM) Measure Validation

How to cite

Apostoloski, Nenad; Spina, Chiara. 2023. "Scientific Decision-making (SDM) Measure Validation." AEA RCT Registry. AEARCTR-0012683. https://doi.org/10.1257/rct.12683-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Nenad Apostoloski* , Chiara Spina

* Primary investigator

Registry ID
AEARCTR-0012683
DOI
https://doi.org/10.1257/rct.12683-1.0
First registered
Last updated
Status
In development
Trial dates
2024-01-10 – 2024-01-31
Countries
Private
JEL codes
M13
Registry record
http://www.socialscienceregistry.org/trials/12683

Abstract

To understand scientific decision-making (a form of entrepreneurial decision-making), a reliable, standardized, and scalable measure is needed. As a part of the efforts to create a measurement for scientific decision-making, we plan to validate the items in our instrument through a “nudge” experiment. This is crucial, as the entrepreneurship field contains numerous non-validated items, posing a challenge to the integrity of our research. First and foremost, the validated measure ensures reliability that the instrument is measuring what it is meant to measure. That means that the data we collect is consistently and accurately representing the constructs being measured. Additionally, validated items provide us with accuracy and precision estimates of the true values that is essential in making informed decisions.

Intervention

In the first part of the experiment after gathering the consent form is the Learning Phase or the intervention. In this phase the participants will have 1 to 3 minutes to learn about a specific decision-making method depending on the group they belong to (participants in the “scientific” entrepreneur group read text about how scientific entrepreneurs behave, participants in the “intuitive” entrepreneur group read a text about how intuitive entrepreneurs behave, and participants in the placebo condition don’t learn anything).

Experimental design

The experiment will run with entrepreneurs recruited online on Prolific that will be randomly placed in one of the three conditions (scientific entrepreneur, intuitive entrepreneur, and placebo condition – being themselves). The first phase of the experiment after gathering the consent form is the Learning Phase. In this phase the participants will have 1 to 3 minutes to learn about a specific decision-making method depending on the group they belong to (participants in the “scientific” entrepreneur group read text about how scientific entrepreneurs behave, participants in the “intuitive” entrepreneur group read a text about how intuitive entrepreneurs behave, and participants in the placebo condition don’t learn anything). In Phase 2 the participants are asked to apply the decision-making approach they learned about in Phase 1 (except for the placebo group that are asked to be themselves). The participants are presented with the items from the SDM survey and are asked to answer the questions as if they were a “scientific” entrepreneur, an “intuitive” entrepreneur or themselves (placebo condition). We hypothesize that the entrepreneurs in a “scientific” entrepreneur role will have a higher score on the SDM measure than the “intuitive” entrepreneur or the ones in the placebo condition.

Design details

Randomization method
Randomization is done via software by adding a Randomizer block during the survey design in Qualtrics. Thus, the participants are randomly assigned to one of the three conditions (scientific entrepreneur, intuitive entrepreneur, and placebo condition – being themselves) immediately after signing they agree to participate in the study on the consent form.
Randomization unit
Individual
Clusters
Not clustered
Observations
600 observations (1 per participant)
Arms
600 participants (200 participants in the Scientific Treatment arm, 200 participants in the Intuitive Treatment arm, and 200 in the Placebo arm - no treatment). We plan to recruit 600 full-time entrepreneurs on the online platform Prolific between the age of 25 and 70 that are based in the UK or USA with English as their primary language. Additionally, we want them to have a minimum of a high school education (anything above secondary education).
Primary outcomes
We are interested in the participants' score on the Scientific Decision Making (SDM) measure that consists of 24 survey items and 6 vignette questions. The score is calculated as a combination of scores based on the survey items with polar options that differentiate “higher” from “lower” scientific decision-making and the answers to the vignette questions depicting typical entrepreneurial situations.

Cited by

No citation data available for this registration yet.

Keywords