Evaluating the Effects of Targeted Information on Public Procurement Competition: Pre-Analysis Plan

How to cite

Srhoj, Stjepan; Decarolis, Francesco; Teso, Edoardo. 2025. "Evaluating the Effects of Targeted Information on Public Procurement Competition: Pre-Analysis Plan." AEA RCT Registry. AEARCTR-0014612. https://doi.org/10.1257/rct.14612-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Stjepan Srhoj* , Francesco Decarolis , Edoardo Teso

* Primary investigator

Registry ID
AEARCTR-0014612
DOI
https://doi.org/10.1257/rct.14612-2.0
First registered
Last updated
Status
In development
Trial dates
2025-04-20 – 2025-09-30
Countries
Private
JEL codes
H57; D22; D40
Registry record
http://www.socialscienceregistry.org/trials/14612

Abstract

We test whether providing firms with i) information on tender opportunities available in the procurement market, and ii) information on the extent of competition and on the bidding behavior for similar tenders in the past, increases the likelihood that they bid and win public procurement contract. Our experiment takes place in Croatia and involves more than 15,000 firms. For a random subset of tenders published in the Official Gazette of Croatia, we will send via email targeted information to a subset of the firms in our sample. We will then measure outcomes relying on administrative data covering the universe of procurement contracts in the country.

Intervention

There are 3 treatment arms. The control group will receive no information. Treatment arm 1 will receive an email with hyperlinks to a subset of tenders recently published in the Official Gazette, together with a simple step-by-step guide to access the tender documents and submit the bid. Treatment arm 2 will receive, in addition to the information received by Treatment arm 1, also information on the extent of competition and on the bidding behavior for similar tenders in the past.

Experimental design

We will randomize the intervention at two levels: tender and firm-level.

Design details

Randomization method
Randomization done in office by a computer.
Randomization unit
We will randomize the intervention at two levels: tender and firm-level. First, at week-level we will randomize at the level of active tenders, we will conduct an equal split with computer generated random selection of tenders subject to intervention, and others that serve as control. Second, within those treated tenders, we will randomly allocate firms with the expertise to participate in upcoming public tenders, determining which of these firms will receive a) information about the active tender, and b) a detailed report about the active tender. Within the treated tenders, firms will be randomly assigned to three groups: i) treatment arm 1 (information about the active tender), ii) treatment arm 2 (a detailed report about the active tender), and iii) a control group. This approach allows us to capture nuanced variations in competition and bidding behavior across different tenders, ensuring that the intervention is relevant to the specific context of each procurement opportunity. By selecting certain tenders to receive the treatment while others serve as a control, we can effectively evaluate the overall impact of the intervention on competition at the public tender level. The second level of randomization is implemented within the treated tenders, where firms with the expertise to participate in upcoming public tenders are randomly allocated to receive targeted information about those tenders. This individual-level randomization enables us to analyze changes in firm behavior, such as participation rates and bidding strategies, while providing insights into how access to information influences decision-making among various firms, particularly smaller firm and firms further away from the public buyer. By incorporating both tender and firm-level randomization, our study will yield comprehensive findings on the effectiveness of the intervention and its implications for enhancing competition in public procurement.
Clusters
800 tenders
Observations
15,000 firms
Arms
5000 firms, 400 tenders.
Primary outcomes
We will measure outcomes both at the firm-tender level (to assess whether treated firms change their participation in procurement for tenders that are part of the intervention), at the firm-level (to assess whether treated firms change their general participation in procurement), and at the tender-level (to assess whether treated tenders are characterized by different final outcomes). Outcomes at the firm-tender level: 1. Indicator equal to one if the firm bids for a specific tender 2. Indicator equal to one if the firm wins a specific tender Outcomes at the firm level: 1. Overall number of tenders for which the firm bids over the duration of the intervention. 2. Overall number of tenders that are not part of the intervention for which the firm bids over the duration of the intervention. 3. Overall number of tenders that the firm wins over the duration of the intervention. 4. Overall number of tenders that are not part of the intervention that the firm wins over the duration of the intervention. Outcomes at the tender level: 1. the total number of competitors on a particular tender. 2. Winning-to-estimated bid – the final contracted price divided by the estimated contract size.
Secondary outcomes
We will measure whether treated effects persist beyond the duration of our intervention. This would be consistent with a mechanism in which providing information about procurement opportunities for a short period of time manages to “teach” firms how to participate in the procurement market. The outcomes, measured at the firm level, will be the total number of bids submitted and of contracts won in the 6 months following the end of the intervention.

Cited by

No citation data available for this registration yet.

Keywords