Information Provision and Website Performance: Industrial firms in Spain
How to cite
Sanz, Ismael; Kneller, Richard; Tena, Juan de Dios; Vélez, José; Sainz, Jorge. 2024. "Information Provision and Website Performance: Industrial firms in Spain." AEA RCT Registry. AEARCTR-0014268. https://doi.org/10.1257/rct.14268-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Abstract
Productivity growth in firms remains a pressing policy issue worldwide. Inspired by the Randomised Control Trial (RCT henceforth) conducted by Adem et al.(2023, AEARCTR-0007125) for the distilling industry in the UK, we complement this research by focusing on a different sector and country, the textile sector in Spain. Moreover, we contribute to the previous literature by appraising how the degree of detail and the frequency of feedback information affect the adoption of digital innovation.
At the heart of our research is the exploration of the effects of information gaps on technology adoption and overall business performance. To this end, we inform a comprehensive set of textile firms in Spain. The research relied on a database provided by BTOMAIL, a company specialized in compiling and supplying email address lists segmented by product category and geographical area. BTOMAIL ensures the validity and updating of its data, complying with the privacy standards established by the GDPR. Then, we randomly select a group of these firms to provide them with more detailed feedback on their website improvements. The purpose of such an experiment is to estimate how the detail of feedback about online efficacy metrics influence the broader adoption of digital technologies. To conduct the study, we employ the following treatment arms:
Treatment Arm 1 (Benchmarked Information Provision): Firms in this group receive direct information regarding their website's performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.
Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information): Firms in this treatment arm receive not only the benchmarked information provided in Treatment Arm 1 but also a supplementary link that allows them to access to more detailed information. In particular, this link directs them to a platform offering in-depth analyses of their website's performance and recommendations for improving efficiency and optimising the reach of their website.
Treatment Arm 3 (Benchmarked Information Provision + Link with more detailed information + Bimonthly Feedback): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. Under this treatment, firms are presented with a comprehensive report every other month, providing further insights into the long-term efficiency and reach of their websites.
We have opted not to include a control group devoid of any information. This decision is motivated by the RCT conducted by Adem et al. (2023) in the UK, which demonstrated that providing benchmark information to UK firms did not significantly affect subsequent firms’ decisions compared to the non-informed group at the conventional levels.
The information provided is compiled using a sophisticated toolkit that benchmarks individual firm data against industry standards. This toolkit draws insights from technology usage data sourced from built with, website speed information from batch speed, and search engine performance metrics from Moz.
The principal objective of this research is to estimate the effect of providing feedback on the web performance of Spanish textile firms on subsequent decisions to improve it.
Although preliminary findings within the distilling sector in the UK indicated that the provision of benchmark information had negligible effects, it is interesting to examine whether the textile sector in Spain— with its distinct regional characteristics, industry-specific nuances, and exposure to various treatment arms—responds similarly or exhibits different patterns of reaction.
Intervention
At the heart of our research is the exploration of the effects of information gaps on technology adoption and overall business performance. To this end, we inform a comprehensive set of textile firms in Spain. The research relied on a database provided by BTOMAIL, a company specialized in compiling and supplying email address lists segmented by product category and geographical area. BTOMAIL ensures the validity and updating of its data, complying with the privacy standards established by the GDPR. Then, we randomly select a group of these firms to provide them with more detailed feedback on their website improvements. The purpose of such an experiment is to estimate how the detail of feedback about online efficacy metrics influence the broader adoption of digital technologies. To conduct the study, we employ the following treatment arms:
Treatment Arm 1 (Benchmarked Information Provision): Firms in this group receive direct information regarding their website's performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.
Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information): Firms in this treatment arm receive not only the benchmarked information provided in Treatment Arm 1 but also a supplementary link that allows them to access to more detailed information. In particular, this link directs them to a platform offering in-depth analyses of their website's performance and recommendations for improving efficiency and optimising the reach of their website.
Treatment Arm 3 (Benchmarked Information Provision + Link with more detailed information + Bimonthly Feedback): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. Under this treatment, firms are presented with a comprehensive report every other month, providing further insights into the long-term efficiency and reach of their websites.
We have opted not to include a control group devoid of any information. This decision is motivated by the RCT conducted by Adem et al. (2023) in the UK, which demonstrated that providing benchmark information to UK firms did not significantly affect subsequent firms’ decisions compared to the non-informed group at the conventional levels.
The information provided is compiled using a sophisticated toolkit that benchmarks individual firm data against industry standards. This toolkit draws insights from technology usage data sourced from built with, website speed information from batch speed, and search engine performance metrics from Moz.
The principal objective of this research is to estimate the effect of providing feedback on the web performance of Spanish textile firms on subsequent decisions to improve it.
Although preliminary findings within the distilling sector in the UK indicated that the provision of benchmark information had negligible effects, it is interesting to examine whether the textile sector in Spain— with its distinct regional characteristics, industry-specific nuances, and exposure to various treatment arms—responds similarly or exhibits different patterns of reaction.
Experimental design
Experimental design: This study adopts a three-arm block randomized design. Within the block, firms are randomly assigned to one of the following:
Treatment Arm 1 (Benchmarked Information Provision)
Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information)
Treatment Arm 3 (Benchmarked Information Provision + Link to more detailed information+ + Bimonthly Feedback):
Methodology: Randomised Control Trial (RCT)
Sampling:. Random sampling will be conducted among the Spanish textile firms with information contained in the BTOMAIL Database for this study
Sample Size: 3,601 firms from the textile sector.
Interventions:
Treatment: All firms will get insights into their website's performance, including speed and search efficiency metrics. We will randomly choose two groups of firms to provide them with more detailed information about the firm's relative performance benchmarked against industry standards. A final group of firms is randomly chosen and provided with bimonthly feedback.
Duration: From 10th September 2024 to 24th September 2024.
Mode:
The dissemination of the insights will occur via electronic mail. We will initially introduce our collaborative Research Group to the firms, emphasizing our affiliations at Universidad Rey Juan Carlos, the University of Nottingham, and the University of Liverpool. A second e-mail regarding their website’s performance will be sent one week after this introductory email.
Experimental Arms:
Treatment Arm 1 (40% of firms, 1,440 firms): Firms in this group receive direct information regarding their website’s performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.
Treatment Arm 2 (30% firms, 1,080 firms): Firms in this treatment arm receive not only the information provided in Treatment Arm 1 but also a supplementary link. This link directs them to a platform offering in-depth analyses of their website’s performance and recommendations for optimizing their site’s reach and efficiency.
.
Treatment Arm 3 (30% of firms, 1,080 firms): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. They will receive a comprehensive report every two months, providing further insights into the long-term efficiency and reach of their websites.
Outcome Metrics:
Primary Outcomes: The study will estimate the causal effects of the intervention on the firm’s website performance post-intervention paying special attention to whether the the firm adopts new web-based technologies as a result of the intervention.
Secondary Outcomes:
Experimental Design Details:
Randomization Method: A simple random assignment method will be used to select participating textile firms for the intervention. This will be achieved using tools such as Stata.
Randomization Unit: Random assignment occurs at the firm level.
Clustered Treatment: No
Design details
Cited by
No citation data available for this registration yet.