Impact Evaluation of an Intervention on Small and Medium Enterprises in Chile

How to cite

A., Claudia Martinez; Eluchans, Josefina; Alvear, Claudia Martínez; Woodruff, Christopher; Huneeus, Federico. 2022. "Impact Evaluation of an Intervention on Small and Medium Enterprises in Chile." AEA RCT Registry. AEARCTR-0010546. https://doi.org/10.1257/rct.10546-1.2

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Claudia Martinez A.* , Josefina Eluchans , Claudia Martínez Alvear , Christopher Woodruff , Federico Huneeus

* Primary investigator

Registry ID
AEARCTR-0010546
DOI
https://doi.org/10.1257/rct.10546-1.2
First registered
Last updated
Status
In development
Trial dates
2022-12-06 – 2025-12-31
Countries
Chile (Latin America)
JEL codes
I22, J24, J21, L25, L26, L31, M10
Registry record
http://www.socialscienceregistry.org/trials/10546

Abstract

This impact evaluation aims to measure the effect of a program that combines business training, mentoring, and a large cash transfer on high-potential small and medium businesses in Chile. 250 out of the top 500 firms participating in a business plan competition will be randomly selected to receive all three components of the program, while the remaining firms will receive none of them.
In-person surveys with the entrepreneurs will be conducted before and 12 months after the program. The surveys will measure the program's impact on key indicators such as monthly sales, monthly profits, and the number of employees in the business. Other outcomes, such as the welfare of entrepreneurs, their business practices, and learning, will also be measured. In addition to the survey data, we will use available administrative data coming from Chilean tax and unemployment insurance authorities to analyze the firm’s profits, sales, costs and networks. The tax data will also be used to track the long-term growth of these firms. Finally, we use data from the videos submitted by the entrepreneurs as a part of the selection process to study potential treatment heterogeneities.

Intervention

Impulso Chileno is a program created by a Chilean NGO aimed to help high-potential Chilean firms grow faster by giving them business training, one-on-one mentoring, and a sizable monetary transfer. This program has been implemented yearly since 2018, and its fifth iteration will be evaluated with a randomized control trial.

The NGO identifies high-potential small and medium enterprises (SMEs) through a business plan competition in which entrepreneurs present their business, its financial statements, and a business plan detailing how they would invest the monetary transfer.

Firms that participate in the contest face a selection process with several stages. Ultimately, an evaluation committee will choose the 500 firms they believe show the most promise. During this year of the program, 250 of the 500 finalist firms will be selected at random from and assigned to the treatment group; the remaining 250 finalists will form a control group.

The treatment group will receive the three primary components of the program:
A monetary transfer
This cash transfer can range between 3 and 5 million Chilean pesos (approximately USD 3,500 to USD 5,800). The average value of the transfer is USD 5,300.
This transfer can only be used to buy physical assets, working capital, digital tools, and fund marketing campaigns.
A business training program
The training program consists of 30 hours of online, group-based, real-time business training sessions.
The Business Administration School of the Pontificia Universidad Católica de Chile (PUC Chile) delivers this program.
Individual mentoring.
At least eight one-on-one mentoring sessions, which have a free-form structure and usually last about an hour.
The mentors usually lead or work for larger Chilean companies in the same sector as the mentees. They are volunteers from Corporación Simon de Cirene’s mentoring network.

Additionally, two optional online talks were offered to entrepreneurs in both the treatment and control groups throughout the year to maintain a base level of engagement with both groups and minimize the risk of attrition bias. The subjects for these talks were: (1) empowerment, (2) business experiences and (3) work-life balance.

Experimental design

The Impulso Chileno program is divided into two stages. The first stage consists of a business plan competition to identify high-potential Chilean small and medium enterprises (SMEs). The program's second stage is where the top-rated firms from the competition receive the intervention itself: a business training course, individual mentoring, and a large cash transfer to invest in their businesses.
Our impact evaluation randomly assigned the top 500 firms participating in the competition into treatment and control groups to measure the program’s effect on the firm's growth.

Business Plan Competition:
The business plan competition was held between September 2022 and January 2023. During this period, 21,780 firms applied to the contest through an online application that gathers basic firm and entrepreneur-level data and their business plan proposal.
Firms had to be formal and have annual sales within a pre-specified bracket [~$7,600 to $380,000 USD] to qualify as a high-potential SME. Firms that did not comply with these prerequisites were disqualified. Firms that fit these criteria were scored based on their business model, entrepreneur’s profile, and business plan proposal.
The top-rated 2,500 firms were then asked to submit tax statements for the previous four months and a 3-minute video explaining their business model and business plan. An evaluation committee (formed by representatives of the implementation partners) watched the videos, reviewed the documents, and re-ranked the contenders to select the top 700 of them as semi-finalists.
Each semi-finalist had a 30-minute interview with members of the evaluation committee, where entrepreneurs presented their business plan proposals. Based on this interview, the 700 firms were re-ranked once again to find the top 500 finalists for the program.
Randomized Assignment:
Toward the end of January 2023, 250 finalists were randomly assigned to a treatment group, while the rest were assigned to the control group. Between March and July 2023, the treatment group received the three components of the program: a monetary transfer, business training and mentoring. Meanwhile, the control group received none of these components.
This randomization was stratified based on the entrepreneur’s gender and the macro-zone from where the business is operated. A macro-zone is an aggregation of different Chilean regions (analogous to US states), which split the country into 6 distinct areas; North, Center, Center-South, South, and Austral Macrozones, along with the Metropolitan region of Santiago de Chile.
Data Collection:
In-person baseline surveys were carried out at each finalist's place of work throughout December 2022 and January 2023, before the randomized selection process was carried out (N=500). Follow-up surveys will be conducted 12 months later. Most of the medium-term effects of the program will be measured using these surveys. We plan to use administrative tax data to measure the short and long-term impact of Impulso Chileno.
Impact Evaluation - OLS:
We will estimate the average treatment effects of the program by conducting an Ordinary Least Squares (OLS) regression, where the assignment variable will serve as the key predictor. To enhance the precision of our analysis, we will employ Machine Learning algorithms, specifically, Post-Double Selection LASSO to select controls in the main regressions; and causal forests to study heterogeneous effects, thereby adopting a data-driven approach.
In specific, regarding causal forests, we will study treatment heterogeneities estimating the Conditional Average Treatment Effect (CATE) including, in the causal forest, the following baseline characteristics: entrepreneurs’ gender, age of the entrepreneur, entrepreneur’s education level, business sector, years since business creation, and region of operation. Furthermore, we will use the predictions on the expected treatment effect for each individual, given the covariates, to investigate treatment heterogeneity.

We will divide the sample in two groups, that is, top and bottom half of the predictions. Then, we will report the balance test for the CATE and p-values adjusted for multiple hypothesis testing. Finally, using that input, we will further detect covariate differences between the two groups to know which are the groups that benefit the most from participating in the Impulso Chileno Program.

To increase power, we will control for the baseline value of dependent variables if available. We will also control by strata and survey specific differences (such as in-person or virtual follow-up).

We will also analyze (without the experimental variation) the program implementation (type of investment funded, attendance to training sessions).

Note that in a companion paper (Assessing Entrepreneurship Potential: Evaluating Video Submissions for Selection Process) we will analyze how applicant’s videos affect the selection process.

Design details

Randomization method
The randomization process was made through a series of 12 public lotteries. Each of the lotteries corresponded to different strata given our stratification design. For example, there was a lottery for female entrepreneurs that hail from the Austral macro-zone, where half of the lottery’s participants were chosen at random to participate in the treatment group. The main implementing partner lived-streamed this event and had a public notary to certify the transparency and fairness of it.
Randomization unit
Randomization done at the individual firm level, stratifying by gender and macro-zone.
Clusters
No clustering.
Observations
500 observations in total for the randomized control trial, with an extra 200 observations which will be used in the regression discontinuity design.
Arms
250 firms in the treatment group, 250 firms in the control group.
Primary outcomes
Monthly sales, costs, and profits from survey data; Number of employees and type (family members, formal employees, full time vs part-time employment, unpaid helpers). If available from tax data: sales, taxable profits, costs.
Secondary outcomes
Business assets, networks, and business practices knowledge. The number of hours worked by the entrepreneur; entrepreneur’s compensation. From tax data: transactions, number of vendors/buyers.
Sponsors
Name: Luksic Foundation (Fundación Luksic) Location: Chile Url: https://fundacionluksic.cl/
Partners
Name: Luksic Foundation (Fundación Luksic) Partner_type: ngo Url: https://fundacionluksic.cl/ Name: Simon de Cirene Corporation (Corporación Simón de Cirene) Partner_type: ngo Url: https://simondecirene.cl/ Name: The Pontificia Universidad Católica (PUC) de Chile’s Business Administration School (Escuela de Administración, PUC Chile) Partner_type: none Url: https://www.uc.cl/en

Cited by

No citation data available for this registration yet.

Keywords