Is More Better? Evaluating Interventions to Increase Female Students' Interest in economics

How to cite

Owen, Ann; Skoy, Evelyn; Zhan, Wei. 2025. "Is More Better? Evaluating Interventions to Increase Female Students' Interest in economics." AEA RCT Registry. AEARCTR-0016491. https://doi.org/10.1257/rct.16491-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Ann Owen* , Evelyn Skoy , Wei Zhan

* Primary investigator

Registry ID
AEARCTR-0016491
DOI
https://doi.org/10.1257/rct.16491-1.0
First registered
Last updated
Status
Completed
Trial dates
2022-08-26 – 2024-05-31
Countries
United States of America ()
Registry record
http://www.socialscienceregistry.org/trials/16491

Abstract

Women are still a minority of undergraduate economics graduates in the U.S, representing roughly 30% of economics undergraduates. In this study, we implement an RCT that evaluates the impact of combining light touch interventions in an introductory economics course. We examine the effect of combinations of treatments on the decision by male and female students to take additional economics courses. Treatment and control groups are drawn from all introductory economics courses taught at a liberal arts college over a two-year period. We evaluate if more interventions increase the effectiveness of interventions. Our interventions include: (1) a welcome email to female students at the beginning of the semester, (2) manipulation of gender composition of peer-facilitated required study groups, and (3) an end-of-semester email congratulating students for course performance at or above the median. We use stratified random assignment to manipulate gender composition of the study groups to ensure that no female student is the sole member of a study group. These interventions are designed to be easily deployed across a variety of institutional types. We find that any one intervention increases the probability of female students taking additional economics courses, but we find no evidence that more interventions increase the probability further.
In addition, we show that light-touch interventions are not equally successful for all female students. They have the greatest impact on those with low levels of beginning-of-semester interest in economics, no previous high school experience with economics, but high confidence in their math ability. For women who self-report higher math skills or no previous economics experience, sending a welcome email may increase economics grades, and we find that for these same subgroups they are much more likely to attend office hours frequently when they receive the welcome email. We find some suggestive evidence that these light-touch interventions work through increasing a sense of
belonging in the economics classroom (Bayer et al., 2020a). Overall, these findings suggest that while light-touch interventions can be effective, there is a limit to their ability to encourage female students. This paper currently has a completed draft.

Intervention

1) welcome email at beginning of semester, 2) required peer-facilitated study groups with gender composition manipulated, 3) end-of-semester congratulatory email to students who earned a course grade at or above the median. Interventions were assigned at the course-section level and students in any individual section would receive 0, 1, 2, or 3 of the interventions.

Experimental design

We conducted an experiment to study the impact of combinations of three light-touch interventions on increasing female students’ interest in studying economics. The interventions were: (1) a simple welcome email sent to female students at the beginning of the semester; (2) a peer-tutor–facilitated study group that ran for the entire semester; and (3) a congratulatory email sent at the end of the semester to students who received a median or higher grade. Treatments were assigned at the section level for the introductory economics course. Each section was randomly assigned to one of four conditions: control (no intervention), one intervention, two interventions, or all three interventions.

Design details

Randomization method
We randomized at the section level. For each section, we used a coin-flip-style randomization process to decide whether the section would receive each of the three light-touch interventions. This procedure resulted in sections being assigned to receive zero, one, two, or all three interventions.
Randomization unit
Each section of the introductory economics course (cluster level).
Clusters
18 sections of the introductory economics course
Observations
542 undergraduate students
Arms
5 sections in the control group, 7 sections with one intervention, 4 sections with two interventions, and 2 sections with all three interventions
Primary outcomes
The primary outcome is students' interest in economics, measured by whether they enroll in additional economics courses after completing the introductory course and receiving the intervention(s).

Cited by

No citation data available for this registration yet.

Keywords