Effect of Role Model Videos on Student Cognitive and Non-Cognitive Outcomes
How to cite
Wang, Tong; Zhang, Leah; Avilova, Tatyana; Tanaka, Ryuichi. 2022. "Effect of Role Model Videos on Student Cognitive and Non-Cognitive Outcomes." AEA RCT Registry. AEARCTR-0010297. https://doi.org/10.1257/rct.10297-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Research has shown that female students are less likely to study STEM fields and more likely to perform worse on tests for STEM-related disciplines compared to male students. Previous studies have shown that role model interventions – which expose students to information about inspirational individuals of the same gender, race, or background – could have a positive impact on those students’ academic performance. We conduct a randomized controlled trial in China to determine the effect of a role model intervention on students. Our contribution to the literature is to test the effect not only on cognitive (academic) student outcomes but also on non-cognitive (personality) outcomes. We control for grading bias when measuring cognitive outcomes through an academic exam, and we also control for a myriad of parent and teacher characteristics that may affect student outcomes.
Intervention
The treatment is a series of 8 short (less than 10 minutes) videos about accomplished Chinese women in STEM fields. Each video contains biographical information about its respective protagonist, as well as her accomplishments (impact on domestic and international society, notable awards, etc.), all set to music. In particular, the videos portray the role models' path to becoming successful scientists through perseverance and hard work. Students in classes assigned to the treatment arm are shown videos over a course of 4 weeks, two videos each week, at the start of their mathematics class on Mondays and Wednesdays.
The 8 role models are:
1. Tu Youyou (pharmaceutical chemist, Nobel Prize Laureate in Physiology or Medicine)
2. Zhu Xuejun (rocket scientist)
3. Xiu Ruijuan (medical scientist)
4. Wang Yaping (astronaut)
5. Liu Ying (biological chemist)
6. Liu Hongtao (biological chemist)
7. Han Xiqiu (oceanist)
8. Katherine Jin (biologist)
In general, the videos will be shown following the order of the age of the role models, from older to younger.
Experimental design
Schools were recruited in September 2022 through academic contacts. To study how the impact of the intervention differs by the level of education, we recruited primary schools, middle schools and high schools.
In schools in China, each grade is split into multiple smaller classes. Primary schools have 40 students in each class, middle schools - 45 students, and high schools - 50 students. The students in each class take all of their classes together and do not interact with students from the other classes academically (although they may interact after school). Treatment is in general assigned at grade level. The only exception is one school from which we are able to recruit only one grade (4 classes), we randomly assign 2 classes to the treatment group, and the other two classes to the control group.
Each treated class receives the same treatment. In the grades in the treatment group, students view 8 short (less than 10 minutes each) videos over the course of 4 weeks, two videos per week.
Before the start of the treatment implementation, we administer several exams/questionnaires to the students, their parents, and their teachers to collect data on baseline characteristics.
- Students take a baseline mathematics exam (which is of a similar difficulty level but contains different questions than the exam administered after treatment); The Rotter Locus of Control Scale Questions; The Rosenberg Self-Esteem Scale Questions; Sternberg Thinking Style in Teaching Questionnaires
- Parents take the Big Five Personsality Questionnaire.
- Teachers take the Big Five Personality Questionnaire.
After the completion of the intervention, students are administered additional exams/questionnaires to collect information on outcome measures of interest (for more information, see the Primary Outcomes section).
The mathematics exams and questionnaires administered to students are conducted inclass. Links for questionnaires administered to parents and teachers are sent to study participants over WeChat, a Chinese social media app. WeChat was chosen as the means of administering the surveys because of its near universal use. Questionnaire responses are collected through Qualtrics and stored securely on encrypted hard drives.
Design details
Cited by
No citation data available for this registration yet.