Service Design Training vouchers for manufacturing SMEs

How to cite

Janssen, Matthijs; Hertog, dr. Pim den; Janssen, dr. Matthijs. 2017. "Service Design Training vouchers for manufacturing SMEs." AEA RCT Registry. AEARCTR-0002064. https://doi.org/10.1257/rct.2064-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Matthijs Janssen* , dr. Pim den Hertog , dr. Matthijs Janssen

* Primary investigator

Registry ID
AEARCTR-0002064
DOI
https://doi.org/10.1257/rct.2064-1.0
First registered
Last updated
Status
On going
Trial dates
2017-01-01 – 2018-11-15
Countries
Private
JEL codes
O31; O38
Registry record
http://www.socialscienceregistry.org/trials/2064

Abstract

Despite evidence that switching to service-based business models might increase their competitiveness, many manufacturing SMEs experience difficulties when trying to do so. Due to lacking awareness of its potential, the SMEs often are unable to identify tools and parties relevant for successful ‘servitisation’. In order to investigate whether policy support can make a difference, a Dutch pragmatic trial issues vouchers for manufacturing SMEs to receive service design training from public or private knowledge suppliers.

Aiming at >240 applications, the RCT is designed to grant 80 submissions and reject >160 of them. An initial benchmark survey is followed up (both amongst the intervention group and the control groups) 1 month and 13 months after the treatment period terminates. This, in combination with several case studies, generates a basis for examining the extent policy-backed service design trainings truly help manufacturing SMEs to strengthen their competitiveness.

Intervention

The core of the experiment is a voucher scheme for manufacturing SMEs to receive service design training from creative industries’ firms or knowledge institutes with relevant expertise. SMEs that are granted a randomly assigned voucher can approach a qualifying knowledge supplier with a ‘knowledge question’ related to service design. This question can range from “what is service design” in general, to more specific questions related to management, tools, or actual project development. The voucher is worth max. €4000, out of which the SME has to contribute 25%. In practice, this implies that a voucher project rewards a participating SME with a few days of interaction with one or multiple experts from the knowledge supplier. There is considerable freedom when it comes to the form and content of the pragmatic trial, as long as it meets the characteristics of service design training.

The primary research question is:
Do manufacturing SMEs that receive vouchers for obtaining service design training become more competitive than those who do not receive such support?

Experimental design

To assess the effect of the service design training vouchers, the performance of manufacturing SMEs (the unit of analysis) receiving the vouchers is compared against firms not getting any treatment. The trial type thus concerns a RCT with parallel group design.

The general set-up of the RCT involves a baseline survey, followed by two outcome surveys in later stages. The focal unit of analysis is the firm level. The items in the questionnaire are based on extensive review of literature on servitisation. All items, typically using yes/no-questions or 5-point Likert scales, are adopted from existing studies like the European Manufacturing Survey (EMS). This does not just guarantee the validity of the scales, but also opens up possibilities to benchmark the applicants against the response of those other studies. In line with the approach followed in the EMS, the benchmark and outcome survey items are based on a preference for surveying the implementation of actual practices rather than only asking for perceptions. A first outcome survey is conducted 1 month after the 4-month treatment period is over, and a second one follows 13 months later. The survey will be distributed amongst all applicants. In case there were only few of them, also control groups 2 and 3 will be addressed. Control group 2 is made up of early bird survey respondents who did not submit an actual application for a voucher. Control group 3 is the collection of firms who were not involved at all, but belong to the communities that were targeted in the recruitment strategy. Involving them would no longer fit with the principles of a RCT.

Design details

Randomization method
All communication on the voucher scheme clearly states that it concerns a RCT involving randomisation. Applications testify of informed consent when filling out their submission forms to RVO. Participants passing RVO’s technical check will be assigned to ‘In’ and ‘Out’ groups by means of a blocked randomisation, as this ensures that in the end 80 applications are granted. At the time of lottery, the full sample is known so the allocation ratio and ideal block size can be determined. There are no reasons to suggest stratified randomisation, unless response on the baseline survey suggests that there are substantial differences (on the outcome indicators part of that survey) between firms of different sizes or sub-sectors. The research team at Dialogic generates the allocation sequence. For both practical reasons as well as for the sake of allocation concealment, the RVO agency (where applications are received and checked) will be in charge of randomising the participants using the simple ‘aselect’ Excel-function.
Randomization unit
Firms. Inclusion/exclusion criteria The voucher scheme is open for applications by SMEs of 10-250 FTE from manufacturing industries (based on a selection of NACE-categories). As part of their application, the firms need to indicate at which specific knowledge supplier they intend to exchange their voucher for service design training. Knowledge suppliers can be either public research institutes or firms from selected creative industries. Part of the ongoing RCT-project is the development of a recruitment plan including outreach activities targeted at, amongst others, the RVO-website, the Chamber of Commerce, industry associations, and the Topsector ‘Creative Industries’.
Clusters
The funding available for just vouchers accounts for €280.000 out of the ± €470.000 (£400.000) budget for the formulation, implementation and evaluation of the entire policy experiment. This amounts to minimal 80 vouchers, given that for each voucher maximally €3000 is subsidized (and SMEs always have to match 25%). An intervention group of 80 firms seems sufficient for sensible statistical analyses, as there is no strict need for including control variables in extensive regressions as long as the intervention group is matched with a considerable amount of firms in the control group(s). For the primary control group we aim at a size of >160 firms, implying that at least 240 sound applications need to be submitted. Unequal allocation is preferred because it is takes little effort for firms in the control group to participate and it is likely that not all of them will keep participating in the outcome surveys. According to power calculations using free online software, a sample size of 240 firms with allocation ratio 1:2 would be sufficient for finding statistical significant results (p = 0.95) when using binary survey items like “did your firm introduce service type x?”.
Observations
See planned number of cluster.
Arms
See planned number of cluster.
Primary outcomes
Do firms in the intervention group, in comparison to those in the control group: A. have a better understanding of what service design is, and how it might be relevant for their particular case; B. have a better understanding of the challenges they need to overcome to succeed in developing competitive product-service combinations; C. have a better overview of the type of partners that might be able to support the servitisation process; D. are found to introduce more (and more advanced) services; E. are found to have a better customer satisfaction; F. are found to yield more turnover and be more profitable (in general / due to their services).

Cited by

No citation data available for this registration yet.

Keywords