A Scientific Approach to Innovation Management – SAIM
How to cite
Camuffo, Arnaldo; Gambardella, Alfonso; Berchicci, Luca; Chondrakis, George; Gagliardi, Luisa; Mariani, Myriam; Novelli, Elena; Triulzi, Giorgio. 2022. "A Scientific Approach to Innovation Management – SAIM." AEA RCT Registry. AEARCTR-0009082. https://doi.org/10.1257/rct.9082-3.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
There is strong evidence that managers and entrepreneurs have poor methods to make decisions under uncertainty. This is a serious problem that discourages innovation and the success of many start-ups. At the aggregate level it sties economic growth and the returns from many public and private incentives to innovation or entrepreneurship. This project studies whether managers and entrepreneurs can improve their ability to make these decisions by adopting a scientific approach based on the formulation of models tested with data, such as scientists do. The project develops a framework that explains the mechanisms and implications of this approach and tests them through a large-scale RCT in six international sites. The framework shows that a scientific approach improves performance by pursuing valuable innovations and by terminating unsuccessful projects earlier. It also helps decision-makers to interpret signals: in particular, they understand better how to change a project in response to negative signals. The RCT tests mechanisms and performance of the scientific approach against current practice in innovation management, and its coverage ensures a good assessment of its validity across contexts and conditions. The results of this RCT are potentially ground-breaking because they can: (i) change the way we think innovation management and entrepreneurship; (ii) encourage the practical application of many economic and managerial theories ignored by managers or entrepreneurs in spite of their practical prescriptions; (iii) help to rethink the curricula of business schools by making a scientific approach to management more prominent and by revamping the application of economic and managerial theories; (iv) improve the mentorship of the many public and private initiatives that support innovation and entrepreneurship worldwide.
Intervention
We recruit participants through an online call for application. Applicants should either be working for an existing small business and willing to develop an innovative project within it or be aspiring entrepreneurs willing to develop a new venture. Selected participants will be randomly assigned to three groups.
Participants in two treatment groups will receive six sessions of in-person training. The sessions will take place every other week for about three months. These sessions will include interactive lectures and coaching by qualified mentors/instructors each working with a subset of the participants. Both treatment groups will receive general training related to entrepreneurial decision making and will learn how to collect and evaluate information about their entrepreneurial ideas. The two treatment groups are identical in terms of the number of classes offered, the basic structure of the course, the examples used, and the topics covered in the course.
Content and instruction in one treatment group will emphasize both the theory and experimental elements within the Scientific Method. Specifically, this content includes the theory behind hypothesis development, rigorous test design processes, hypothesis testing and experimentation. This will be referred to as the ‘theory-based’ treatment group.
For the second treatment group, greater emphasis will be devoted to experimentation and lesser attention devoted to the theory element. In particular, greater emphasis will be devoted to hypothesis testing and experimentation. This will be referred to as the ‘evidence-based’ treatment group.
Our expectations before conducting the study were that both versions would have been beneficial for entrepreneurs in different ways. We expected entrepreneurs who follow an evidence-based approach to engage in a fast-iterative decision-making process and improve their business idea through data collection and analysis. We expected entrepreneurs who follow a theory-based approach to be slower and more selective, taking more time to pivot to adapted, but more defined and effective, business idea.
The research team will collect various measures related to both participants and their business projects before, during, and after the training using surveys and interviews. Participation in the surveys, interviews and all the other activities of the present study is voluntary. Participants will not be paid for their participation, but they will receive free training and free access to all events and activities.
A third set of participants, the ‘pure control’ group, will not receive any formal training. However, these participants will be provided written materials relevant to decision making and the opportunity to participate in events held during the project.
The performance of participants in all three groups will be monitored over the course of one year and a half.
Experimental design
The RCT focuses on the entrepreneurial individual who intend to start a new business. We advertise the program through digital channels as a general course overseeing all the important aspects of entrepreneurship. The course is free of charge to ensure the participation of individuals with limited financial resources. The same amount of training is offered to both groups receiving training to ensure comparability.
Multiple instructors/coaches will be trained to deliver the training using standard materials, purposely designed. Each instructor/coach teaches two classes (one class employing the theory-driven approach and the second class using the experimentation-driven approach). The research team designs, coordinates, and oversees all activities, ensuring that the learning modules and coaching activities are appropriately carried out by the instructors/coaches.
The research team will collect various measures related to both participants and their business projects before, during, and after the training using surveys and structured interviews.
Participants will have to complete an initial survey after applying to the program. Data collected in the survey includes personal information about the participants, such as age, gender, education, but excludes any special data categories (religion, political affiliation, sexual orientation, etc.) or biometric data.
The survey will also include questions about the entrepreneurial project pursued by the participants, their goals and expectations regarding the project, the resources, and competencies they can access, and cognitive and decision-making aspects that are relevant to the research.
Participants will also be asked to provide a textual description of their business idea, akin to an "elevator pitch", and to perform a brief computer task to measure their approach to changing a digital 10x10 grid pattern.
Other surveys will be administered in subsequent steps of the project, according to the needs of the research, and following the same procedure and content type described for the initial survey.
Interviews will be conducted by research assistants, who we will contact participants to provide a periodical update on their entrepreneurial project for up to 15 months after the completion of the training program.
Individual-level measures include participant demographic information, education and work background, prior experience with entrepreneurship, and some cognitive and psychological traits. Project-level measures include past and current performance, team composition and perceptions of future performance. We will also collect specific measures related to participants’ perception of internal and external challenges to entrepreneurship as well as their perceived ability to respond to them.
Design details
Cited by
No citation data available for this registration yet.