Can non-teaching role models reduce the gender gap in science?

How to cite

Breda, Thomas; Effenterre, Clementine Van; Grenet, Julien; Monnet, Marion. 2016. "Can non-teaching role models reduce the gender gap in science?." AEA RCT Registry. AEARCTR-0000903. https://doi.org/10.1257/rct.903-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Thomas Breda* , Clementine Van Effenterre , Julien Grenet , Marion Monnet

* Primary investigator

Registry ID
AEARCTR-0000903
DOI
https://doi.org/10.1257/rct.903-1.0
First registered
Last updated
Status
In development
Trial dates
2015-09-01 – 2018-03-01
Countries
Private
JEL codes
I24, J16
Registry record
http://www.socialscienceregistry.org/trials/903

Abstract

Stereotypes and social norms influence females' academic self-concept, pushing them to choose humanities rather than science. Female scientists may serve as role models to lower the prevalence of the general stereotype associating quantitative science with men. Recent studies have shown that female science professors and teachers increase females' enrollment rates in scientific majors (e.g., Carrell et al, 2010). In this study, we investigate the effect of a one hour, one off intervention by an external female scientist in high-school classrooms. The scientist shares her own experience and provides information about scientific careers and the underrepresentation of women in science. Classes selected for the intervention are randomly drawn within each of the high schools that volunteered to participate in the program. The intervention will take place in about one hundred high schools of the Paris region and will target approximately 6,000 students in their first year of high school (Seconde generale et technologique, equivalent of 10th grade in the US) and approximately 3,000 final-year students preparing the scientific baccalaureate (Terminale scientifique, equivalent of 12th grade in the US).

The main goal of the study is to investigate if a short intervention by an external role model can effectively change students' stereotyped perceptions and educational choices. Such an intervention can easily be scaled up, should it prove effective, whereas it is not always possible to use female teachers as role models to reduce the gender gap in science.

Intervention

The intervention consists in a one hour, one off visit of a high school classroom by a woman science career role model. The classroom visits are aimed at changing students' perceptions and attitudes towards scientific careers and towards women in science, with a view of ultimately reducing the gender gap in science by increasing female enrollment in science courses.

The classroom visits are performed by approximately sixty volunteer female scientists recruited by the program's sponsor (a large French company). Half of the scientists are young researchers of post-doctoral level, while the other half are young professionals working in the research and development department of the program's sponsor. All participants receive a one-day training session, which is divided into three workshops. The training begins with a roundtable, where each participant is invited to introduce herself and to share her experience about being a woman in science. The roundtable is followed by a detailed presentation of the intervention and of the evaluation protocol. The final part of the training consists of a four-hour performance-based public speaking coaching session under the supervision of a professional comedian.

Each one-hour classroom intervention takes place during normal teaching hours and is attended by all students in the class (females and males) in the presence of the teacher who has agreed to host the intervention. The female scientists begin their intervention with a slideshow that provides factual information about scientific careers in general, and about the underrepresentation of women in scientific studies and scientific occupations. This short introduction is followed by a three minutes video showing real-life students' stereotyped representations of scientists and of women in science in an entertaining way. For example, some students interviewed in the video claim that jobs in science are solitary, that women working in such occupations are unattractive, and that girls are not made for scientific careers. Students are then invited to react to these claims and to share their own views. During the second half of the intervention, the female scientist tells about her academic and professional background, shares her experience about being a woman in science, describes what a typical day is like for her, and answers any question that the students may have about scientific studies and careers.

The interventions take place in approximately one hundred public and private general high schools (Lycee d'enseignement general et technologique) located in the Paris region (Ile-de-France). The students selected for the classroom interventions are either in their first year of high school (Seconde generale et technologique, equivalent of 10th grade in the US) or final-year students preparing the scientific baccalaureate (Terminale scientifique, equivalent of 12th grade in the US). The choice of these two grade levels is motivated by the fact first- and final-year high school students need to take important and hard-to-reverse educational decisions which determine to a large extent whether or not they will pursue studies and careers in science or technology. At the end of their first year of high school, students who decide to prepare a general baccalaureate (Baccalaureat general) are required to choose between three different two-year tracks (11th and 12th grades) that lead to different baccalaureate specializations: in science (Baccalaureat S), in literature (Baccalaureat L) or in social and economic sciences (baccalaureat ES). Students who decide instead to prepare a technical baccalaureate (Baccalaureat technologique) must choose one of eight different fields of specialization, two of which put a strong emphasis on science subjects (Baccalaureat STI2D and Baccalaureat STL).

Classroom interventions are grouped into three one-hour sessions per high school, and are performed consecutively by the same female scientist during a half-day visit to the school. In each participating high school, the visited classrooms are two classrooms of first-year students and one classroom of final year students preparing the scientific baccalaureate.

Experimental design

The one-hour classroom interventions will take place in approximately one hundred general track high schools located in the Paris region (Ile-de-France) during the school year 2015-2016.

The students selected for the classroom interventions are either in their first year of high school (Seconde generale et technologique, equivalent of 10th grade in the US) or final-year students preparing the scientific baccalaureate (Terminale scientifique, equivalent of 12th grade in the US). The choice of these two grade levels is motivated by the fact that first- and final-year high school students need to make important and hard-to-reverse educational decisions which determine to a large extent whether or not they will pursue studies and careers in science or technology.

In each of the three local education authorities covered by the program (Créteil, Paris and Versailles), public and private high schools were selected on a voluntary basis at the beginning of school year 2015-2016. A key challenge was to recruit high-schools to participate in the program. To minimize the number of journeys by the female scientists involved in the program, while ensuring that participating schools are reasonably representative, we first established the list of all 325 private and public general track high schools in the Paris region with at least four 10th grade classes and at least two 12th grade classes with a science major. At the start of the school year, the local education authorities--who officially support the program--informed the principals of those preselected high-schools about the program, its aims, and the evaluation protocol. Participation remained, however, non-mandatory.

Towards the end of September 2015, we contacted the principals of the pre-selected high schools and invited them to participate in the program's evaluation, after providing them with detailed information about the experimental design. With an approval rate of approximately 30 percent, we expect about one hundred schools to participate in the program.

In each participating school, the principals are invited to pres-select at least four 10th grade classes and two 12th grade /science major for the intervention. At least two of the pre-selected 10th grade classes and at least one of the pre-selected 12th grade classes are then randomly drawn by the evaluation team to host the intervention (treatment group). The other pre-selected classes are assigned to the control group.

The female scientists' interventions are grouped into two waves, the first during the first term of the school year (October-December 2015), and the second during the first half of the second term (January-February 2016). In each participating high school, the three classroom interventions (sometimes more) are scheduled during the same half day and are performed by a single female scientist, with two interventions for the two treatment classes of 10th grade students and one intervention for the treatment class of 12th grade students. The female scientists volunteering for the program commit to carry out at least half-day visits to the schools, representing a total of six classroom interventions.

The program's impact evaluation will rely on the combination of a post-intervention survey questionnaire and of several administrative data sources, which will be linked using an encrypted student identifier. The survey instrument is a 30-minutes 7-page paper-and-pencil to be completed by students from the treatment and control groups in their respective classrooms, under the supervision of a member of the school staff. The questionnaire consists of four main sections: (i) general questions about the student's home environment; (ii) questions on taste for and self-assessed performance in subjects taught in high school; (iii) educational and career pans; and (iv) perceptions towards science and attitudes towards women in science.

The questionnaire will be administered to all control and treatment classes of participating schools in two waves: (i) during the first half of February 2016, for approximately 30 percent of participating schools ; (ii) during the second half of March 2016, for the remaining 70 percent. Although the assignment of schools to either of these survey waves was primarily determined by the date of the classroom interventions, a subsample of schools which hosted the interventions during the first or second term of the school year was randomly assigned to either of the two survey waves. The aim of this randomization step is to test whether the program's impact on students' perceptions is sensitive to the time interval between the intervention and the survey.

Design details

Randomization method
The randomization of pre-selected classes to the treatment and control groups is done in office by a computer, as follows: - create a unique identifier for each (high school, grade level) pair; - for each pre-selected class, randomly draw a number between 0 and 1 from a uniform distribution, using the unique (high school, grade level) identifier as the seed for the sequence of pseudo-random numbers (for replicability); - Within each (high school, grade level) cell, sort the preselected classes by ascending value of the random draw; - Assign the k classes with the lowest value of the random number to the treatment group, where k= int[(n+1)/2] with n the number of pre-selected classes in the high school and grade level under consideration (in most schools, n=4 for 10th grade classes and n=2 for 12th grade classes). - Pairwise matching: pairs of classes (one trated, one control) are also created within each (high school, grade level) by matching the treated classe having the lowest random draw with the control class having the lowest random draw, matching the treated class having the second lowest random draw with the control class having the second lowest random, etc. This pairwise matching is used to allow us to keep the maximum possible number of classes for the analysis in case tratment assignation has failed for some classes (in which case we only remove the corresponding pair). It may also be used for correcting standard errors.
Randomization unit
The randomization of interventions is performed at the class-level within participating high schools and is implemented separately at the 10th grade level (Seconde generale et technologique) and at the 12th grade level (Terminale scientifique). In each participating school, the school principal is invited to pre-select at least four 10th grade classes and at least two 12th grade classes for the intervention. The randomization is performed so that at least half of the pre-selected classes at each grade level are selected for the classroom intervention. Denoting n the number of preselected classes at a given grade level (either 10th grade or 12th grade), the number of classes assigned to the treatment group is int[(n+1)/2]. The survey design involves two additional levels of randomization: - A subsample of schools with classroom interventions programmed for before January 15, 2016, were randomly assigned to either of the two survey waves, in order to test whether the program's impact on students' perceptions is sensitive to the time interval between the intervention and the survey. The randomization was performed at the school level, with two-thirds of the schools being assigned to the first survey wave (first half of February 2016), and the remaining third being assigned to the second survey wave (second half of March 2016). - To control for potential biases induced by survey features, the order of answer choices was randomized for several questions. In addition, one question related to students' stereotyped representation of persons working in science occupations was randomly assigned across questionnaires, so that this question would refer to a male scientist in the questionnaires assigned to half of the students in each classroom, and to a female scientist for the other half.
Clusters
The expected number of randomization units is 400 10th grade classes and 200 12th grade classes in approximately 100 high schools (usually four 10th grade classes and two 12th grade classes per school).
Observations
The planned number of observations is 18,000 students from 600 10th grade (50 percent females) and 12th grade/science major (40 percent females) classes in 100 high schools. Classes are evenly divided between treatment and control groups.
Arms
The principals of participating high schools provided us with a preselection of at least four 10th grade classes and at least two 12th grade classes. We then randomly draw half of them for treatment, and the other half for control. Pairs of trated/control classes are also formed (see above).
Primary outcomes
A) Student attitudes towards science and the role women in science Student perceptions about science and about the role of women in science will be measured through a paper-and-pencil questionnaire which will be completed by the control and treatment students in their respective classrooms, under the supervision of a member of the school staff. The survey questionnaire will be administered between one month and three months after the classroom interventions. Key outcome variables: A1) Self-assessed taste for and performance in science subjects (i) Taste for the different subjects taught in high school (math, physics, French, English, history and geography, biology, etc.). (ii) Self-assessed performance in the different subjects taught in high school. (iii) Self-assessed performance relative to both the other boys and the other girls in the classroom: in math and French (for first-year students); in math and biology (for final-year students preparing thea scientific baccalaureate). (iv) Self-confidence in ability to solve mathematics and science problems. A2) Education and career plans (i) Intended study plan for the following and subsequent years. (ii) Career aspirations: - preferred occupations (several responses allowed); - whether the student would see herself /himself in particular occupations (engineer, physician, industrial designer, chemist, pharmacist, lawyer, researcher in biology, alternate energy technician, computer specialist, psychologist). (ii) Motivations that influence educational and career choices: personal interest the field of study; fear that other fields of study might be too difficult; financial and employment prospects; gender balance; personal workload. A3) Perceptions about science and scientific occupations (i) Whether the student is interested in science in general. (ii) Whether she/he considers that there are interesting jobs involving science. (iii) The student sees herself/himself in a scientific career. (iii) Jobs in science pay well. (iv) Jobs in science require lengthy studies. (iv) Jobs in science are monotonous. (iv) Jobs in science are rather solitary. A4) Perceptions about women in science (i) There are more men than women in science. (ii) Men are more skilled in mathematics than women. (iii) Men and women's brains are different. (iv) Women do not have much interest in science. These items are designed to measure students' perceptions about the role of innate differences in ability ((ii) and (iii)), of differences in taste (iv) and of discrimination (v) when assessing gender differences in science. A5) Descriptors for male/female scientists Students' stereotypes representation of men and women with a science career are measured based on a list of positive/negative descriptors among which respondents are asked to choose to describe how they would portray a scientific person (interesting/boring, repetitive/creative, solitary/sociable, stylish/old-fashioned, respected/not respected, shy/outgoing, exemplary/ordinary). In each classroom, half the students are randomly assigned the question that refers to a man working in a science career, whereas the other half is assigned the question that refers to a woman working in a science career. B) Educational outcomes Information on students' post-intervention academic performance and choice of studies are obtained from administrative data sources that are linked with the survey data using an encrypted student identifier. Key outcome variables: B1) Academic performance across science subjects (for 12th grade students only) 12th grade students' academic performance in science subjects (mathematics, physics and biology) is measured from their grades in the corresponding final exams of the scientific baccalaureate. B2) Choice of studies in the years following the intervention (i) For 10th grade students: probability of preparing a baccalaureate in science (Baccalaureat S) or a technological baccalaureate with a major in science (Baccalaureat STL or STI2D) in 11th grade. (ii) For 12th grade students preparing a scientific baccalaureate: - Probability of applying to one or more undergraduate degree programs in science or technology (based on the data from France's centralized application system for higher education Admission Post-Bac). - Probability of applying to one or more undergraduate degree programs in Science, Technology, Engineering and Mathematics (STEM) fields, as opposed to non-STEM scientific fields such as biology and medical sciences. - Probability of enrolling in an undergraduate degree program in science or technology in the year following the intervention and in subsequent years. - Probability of enrolling in an undergraduate degree program in a STEM field in the year following the intervention and in subsequent years.

Cited by

No citation data available for this registration yet.

Keywords