Information Provision and Website Performance: Industrial firms in Spain

How to cite

Sanz, Ismael; Kneller, Richard; Tena, Juan de Dios; Vélez, José; Sainz, Jorge. 2024. "Information Provision and Website Performance: Industrial firms in Spain." AEA RCT Registry. AEARCTR-0014268. https://doi.org/10.1257/rct.14268-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Ismael Sanz* , Richard Kneller , Juan de Dios Tena , José Vélez , Jorge Sainz

* Primary investigator

Registry ID
AEARCTR-0014268
DOI
https://doi.org/10.1257/rct.14268-1.0
First registered
Last updated
Status
In development
Trial dates
2024-09-16 – 2025-12-16
Countries
Spain ()
JEL codes
D22, D24, D83, L25, L67
Registry record
http://www.socialscienceregistry.org/trials/14268

Abstract

Abstract

Productivity growth in firms remains a pressing policy issue worldwide. Inspired by the Randomised Control Trial (RCT henceforth) conducted by Adem et al.(2023, AEARCTR-0007125) for the distilling industry in the UK, we complement this research by focusing on a different sector and country, the textile sector in Spain. Moreover, we contribute to the previous literature by appraising how the degree of detail and the frequency of feedback information affect the adoption of digital innovation.

At the heart of our research is the exploration of the effects of information gaps on technology adoption and overall business performance. To this end, we inform a comprehensive set of textile firms in Spain. The research relied on a database provided by BTOMAIL, a company specialized in compiling and supplying email address lists segmented by product category and geographical area. BTOMAIL ensures the validity and updating of its data, complying with the privacy standards established by the GDPR. Then, we randomly select a group of these firms to provide them with more detailed feedback on their website improvements. The purpose of such an experiment is to estimate how the detail of feedback about online efficacy metrics influence the broader adoption of digital technologies. To conduct the study, we employ the following treatment arms:

Treatment Arm 1 (Benchmarked Information Provision): Firms in this group receive direct information regarding their website's performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.

Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information): Firms in this treatment arm receive not only the benchmarked information provided in Treatment Arm 1 but also a supplementary link that allows them to access to more detailed information. In particular, this link directs them to a platform offering in-depth analyses of their website's performance and recommendations for improving efficiency and optimising the reach of their website.

Treatment Arm 3 (Benchmarked Information Provision + Link with more detailed information + Bimonthly Feedback): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. Under this treatment, firms are presented with a comprehensive report every other month, providing further insights into the long-term efficiency and reach of their websites.

We have opted not to include a control group devoid of any information. This decision is motivated by the RCT conducted by Adem et al. (2023) in the UK, which demonstrated that providing benchmark information to UK firms did not significantly affect subsequent firms’ decisions compared to the non-informed group at the conventional levels.

The information provided is compiled using a sophisticated toolkit that benchmarks individual firm data against industry standards. This toolkit draws insights from technology usage data sourced from built with, website speed information from batch speed, and search engine performance metrics from Moz.

The principal objective of this research is to estimate the effect of providing feedback on the web performance of Spanish textile firms on subsequent decisions to improve it.

Although preliminary findings within the distilling sector in the UK indicated that the provision of benchmark information had negligible effects, it is interesting to examine whether the textile sector in Spain— with its distinct regional characteristics, industry-specific nuances, and exposure to various treatment arms—responds similarly or exhibits different patterns of reaction.

Intervention

At the heart of our research is the exploration of the effects of information gaps on technology adoption and overall business performance. To this end, we inform a comprehensive set of textile firms in Spain. The research relied on a database provided by BTOMAIL, a company specialized in compiling and supplying email address lists segmented by product category and geographical area. BTOMAIL ensures the validity and updating of its data, complying with the privacy standards established by the GDPR. Then, we randomly select a group of these firms to provide them with more detailed feedback on their website improvements. The purpose of such an experiment is to estimate how the detail of feedback about online efficacy metrics influence the broader adoption of digital technologies. To conduct the study, we employ the following treatment arms:

Treatment Arm 1 (Benchmarked Information Provision): Firms in this group receive direct information regarding their website's performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.

Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information): Firms in this treatment arm receive not only the benchmarked information provided in Treatment Arm 1 but also a supplementary link that allows them to access to more detailed information. In particular, this link directs them to a platform offering in-depth analyses of their website's performance and recommendations for improving efficiency and optimising the reach of their website.

Treatment Arm 3 (Benchmarked Information Provision + Link with more detailed information + Bimonthly Feedback): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. Under this treatment, firms are presented with a comprehensive report every other month, providing further insights into the long-term efficiency and reach of their websites.

We have opted not to include a control group devoid of any information. This decision is motivated by the RCT conducted by Adem et al. (2023) in the UK, which demonstrated that providing benchmark information to UK firms did not significantly affect subsequent firms’ decisions compared to the non-informed group at the conventional levels.

The information provided is compiled using a sophisticated toolkit that benchmarks individual firm data against industry standards. This toolkit draws insights from technology usage data sourced from built with, website speed information from batch speed, and search engine performance metrics from Moz.

The principal objective of this research is to estimate the effect of providing feedback on the web performance of Spanish textile firms on subsequent decisions to improve it.

Although preliminary findings within the distilling sector in the UK indicated that the provision of benchmark information had negligible effects, it is interesting to examine whether the textile sector in Spain— with its distinct regional characteristics, industry-specific nuances, and exposure to various treatment arms—responds similarly or exhibits different patterns of reaction.

Experimental design

Experimental design: This study adopts a three-arm block randomized design. Within the block, firms are randomly assigned to one of the following:

Treatment Arm 1 (Benchmarked Information Provision)

Treatment Arm 2 (Benchmarked Information Provision + Link to more detailed information)

Treatment Arm 3 (Benchmarked Information Provision + Link to more detailed information+ + Bimonthly Feedback):

Methodology: Randomised Control Trial (RCT)
Sampling:. Random sampling will be conducted among the Spanish textile firms with information contained in the BTOMAIL Database for this study
Sample Size: 3,601 firms from the textile sector.
Interventions:
Treatment: All firms will get insights into their website's performance, including speed and search efficiency metrics. We will randomly choose two groups of firms to provide them with more detailed information about the firm's relative performance benchmarked against industry standards. A final group of firms is randomly chosen and provided with bimonthly feedback.

Duration: From 10th September 2024 to 24th September 2024.
Mode:

The dissemination of the insights will occur via electronic mail. We will initially introduce our collaborative Research Group to the firms, emphasizing our affiliations at Universidad Rey Juan Carlos, the University of Nottingham, and the University of Liverpool. A second e-mail regarding their website’s performance will be sent one week after this introductory email.

Experimental Arms:
Treatment Arm 1 (40% of firms, 1,440 firms): Firms in this group receive direct information regarding their website’s performance. This information offers insights from various metrics, including website speed, search engine efficiency, and user engagement.

Treatment Arm 2 (30% firms, 1,080 firms): Firms in this treatment arm receive not only the information provided in Treatment Arm 1 but also a supplementary link. This link directs them to a platform offering in-depth analyses of their website’s performance and recommendations for optimizing their site’s reach and efficiency.
.

Treatment Arm 3 (30% of firms, 1,080 firms): Firms in this treatment arm receive the services of Treatment Arm 2 and are also informed that their website performance will be monitored bimonthly. They will receive a comprehensive report every two months, providing further insights into the long-term efficiency and reach of their websites.

Outcome Metrics:
Primary Outcomes: The study will estimate the causal effects of the intervention on the firm’s website performance post-intervention paying special attention to whether the the firm adopts new web-based technologies as a result of the intervention.
Secondary Outcomes:
Experimental Design Details:
Randomization Method: A simple random assignment method will be used to select participating textile firms for the intervention. This will be achieved using tools such as Stata.
Randomization Unit: Random assignment occurs at the firm level.
Clustered Treatment: No

Design details

Randomization method
Randomization Method: A simple random assignment method will be used to select participating textile firms for the intervention. This will be achieved using tools such as Stata.
Randomization unit
Randomization Unit: Random assignment occurs at the firm level.
Clusters
Sample size: 3,601 firms from the Spanish textile industry sector.
Observations
Planned number of observations: Each participating firm will be observed for changes post-intervention.
Arms
Sample size by treatment arms: Of the 3,601 firms in the sample, 1,800 perform above the median baseline, while the remaining 1,800 perform below the median. For Treatment Arm 1, there are 720 firms treated and 720 control firms in both above and below median performance categories. Treatment Arms 2 and 3 each have 540 treated and 540 control firms in the above and below median performance categories. In summary, Treatment Arm 1 will include 1,440 firms, Treatment Arm 2 will consist of 1,080 firms, and Treatment Arm 3 will also consist of 1,080 firms. Approximately 40% of the firms will be assigned to Treatment Arm 1, while 30% will be assigned to Treatment Arm 2, and the remaining 30% to Treatment Arm 3.
Primary outcomes
Primary Outcomes (end points) Our main objective is to assess whether offering information about the company's website performance incentivizes adopting new web-based technology.
Secondary outcomes
Secondary Outcomes (end points) Additional outcomes involve evaluating whether the company's financial performance saw enhancements. Secondary Outcomes (explanation)
Sponsors
Name: Universidad Rey Juan Carlos Location: Region of Madrid, Spain Url: https://www.urjc.es/

Cited by

No citation data available for this registration yet.

Keywords