A Scientific Approach to Innovation Management
How to cite
Novelli, Elena; Gambardella, Alfonso; Camuffo, Arnaldo; Bacco, Francesca; Coali, Andrea; Frosi, Claudia; Gagliardi, Luisa; Jannace, Diego; Mariani, Myriam; Messinese, Danilo; Raj, Devika; Triulzi, Giorgio; Berchicci, Luca; Huber, Laura Rosendahl; Chondrakis, George. 2022. "A Scientific Approach to Innovation Management." AEA RCT Registry. AEARCTR-0008945. https://doi.org/10.1257/rct.8945-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Economic growth depends critically on managerial decisions that concern innovation, a context characterized by high uncertainty. Unfortunately, research shows that managers or entrepreneurs do not have good routines or methods to make decisions under uncertainty. This suggests that there might be serious benefits from improving the efficiency of public and private investments to nurture entrepreneurship. The goal of this project is to understand the implications of an approach that teaches managers to start their decision making process with a good framing of the problem, developing models that predict the outcomes of actions from logical
connections between antecedents and consequences, testing the model using existing data or data drawn from well-defined experimental designs and that assess the results in a disciplined way. We call this approach scientific because it overlaps to a significant
extent with the approach that scientists use to develop new knowledge. To this aim, the project designs and implements a large-scale randomized control trial (RCT) conducted in six countries (Italy, UK, Spain, Colombia, the Netherlands, India) based on an intervention that comprises six/eight training sessions over about three months offered to randomly generated groups of entrepreneurs.
Intervention
We recruit participants through an online call for application. Applicants should be aspiring entrepreneurs willing to develop a new venture. Selected participants will be randomly assigned to three groups.
Participants in two treatment groups will receive six sessions of 4-hour in-person training (or 8 sessions of 3-hour in-person training). The sessions will take place every other week for about three months. These sessions will include interactive lectures and coaching by qualified mentors/instructors each working with a subset of the participants. Both treatment groups will receive general training related to entrepreneurial decision making and will learn how to collect and evaluate information about their entrepreneurial ideas. The two treatment groups are identical in terms of the number of classes offered, the basic structure of the course, and the examples used.
Content and instruction in one treatment group will emphasize both the theory and experimental elements within the Scientific Approach. Specifically, this content includes the theory behind hypothesis development, rigorous test design processes, hypothesis testing and experimentation. This will be referred to as the ‘theory-and-evidence-based’ treatment group.
For the second treatment group, greater emphasis will be devoted to experimentation and lesser attention devoted to the theory element. In particular, greater emphasis will be devoted to hypothesis testing and experimentation. This will be referred to as the ‘evidence-based’ treatment group.
Our expectations before conducting the study were that both treatments would be beneficial for entrepreneurs in different ways. We expected entrepreneurs who follow an evidence-based approach to engage in a fast-iterative decision-making process and improve their business idea through data collection and analysis. We expected entrepreneurs who follow a theory-and-evidence-based approach to be slower and more selective, taking more time to pivot to adapted, but more defined and effective, business idea.
The research team will collect various measures related to both participants and their business projects before, during, and after the training using surveys and interviews. Participation in the surveys, interviews and all the other activities of the present study is voluntary. Participants will not be paid for their participation, but they will receive free training and free access to all events and activities.
A third set of participants, the ‘pure control’ group, will not receive any formal training. However, these participants will be provided written materials relevant to decision making and the opportunity to participate in events held during the project.
The performance of participants in all three groups will be monitored over the course of one year and a half.
Update: the last RCT, run in India, has a slightly different design. In particular, interventions will be administered online, and there will not be a ‘pure control’ group.
Experimental design
We conduct a series of 6 RCTs in different Countries (Italy, the UK, The Netherlands, Colombia, Spain, and India) with approximately 150 early-stage entrepreneurs in each location to understand the conditions under which different elements to decision-making sustain entrepreneurial actions. We will randomly assign entrepreneurs who participate in the RCTs in each location to three experimental arms, corresponding to different combinations of the components of the scientific approach (theory-and-evidence, evidence, and a control group). The intervention consists in a three-month entrepreneurship training program, offered free of charge to participants. We will monitor the performance of these three groups over time. Firms in both treatment groups will learn how to collect and evaluate information about their entrepreneurial ideas, though the content of the training is different between the two groups:
1) The first treatment group will receive training focused on the ‘evidence-based’ approach, in which greater emphasis will be devoted to the “evidence” element within the scientific approach rather than devoted to the theory element
2) The second treatment group will receive training based on the ‘theory-and-evidence-based’ approach that emphasizes both the theory and experimental elements within the scientific approach
3) We also have a 'pure control' group, which includes entrepreneurs who will not receive training
We will observe the impact these decisions have over time, as the data collection process will take place over the course of one year
Design details
Cited by
No citation data available for this registration yet.