Fostering study-success in Higher Education through a 2-hour in class training

How to cite

Ketel, Joram van; Lent, Max van; Vetten, Arjen de. 2024. "Fostering study-success in Higher Education through a 2-hour in class training." AEA RCT Registry. AEARCTR-0014805. https://doi.org/10.1257/rct.14805-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Joram van Ketel* , Max van Lent , Arjen de Vetten

* Primary investigator

Registry ID
AEARCTR-0014805
DOI
https://doi.org/10.1257/rct.14805-1.0
First registered
Last updated
Status
On going
Trial dates
2024-07-09 – 2026-06-30
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/14805

Abstract

Students in the transition to higher education (HE) face particular challenges, resulting in e.g. unnecessary dropout from their studies. Institutions therefore develop interventions to improve student well-being, sense of belonging, and academic engagement. Effects of such interventions are promising but not always investigated rigorously. This study aims to deepen our understanding of the impact of short curricular training. A (quasi)-experimental design including control groups is used to compare the impact of three training versions, respectively aimed at well-being, metacognitive and behavioral academic engagement or sense of belonging. These trainings do so by teaching self-regulation skills or professional social skills. The sample includes two, hopefully three, cohorts (maximum ~2700 students) from the Faculty of Law at a European university, with relatively high first-year dropout rates (~30%). The first cohort and 25% of the second cohort served as a control group and did not receive training. Selected study programs constituting 75% of students in the second (and hopefully third) cohort receive a 2-hour in-class training in the autumn. Three training versions are randomly assigned to student groups. Measured outcomes are students’ self-reported beliefs and behaviors on respective training aims, as well as academic performance. All outcomes are controlled for with a pre-measurement. We also explore how student characteristics predict difficulties in the transition to higher education, and whether students benefit differently from such trainings. Final results will help inform HE institutions on optimizing strategic support for first-year students.

Intervention

Three versions of a 2-hour in-class skills training were developed to address different known key aspects of academic functioning. Training content in all versions was tailored for the specific student population through interviews, focus groups, and collaboration with experienced educational professionals during finalization of the content.
The versions 1 and 2 deliver virtually identical training in self-regulation, based on previous initiatives on reflection and goal setting at Leiden University. Version 1 aimed to support general academic well-being. Version 2 focused on fostering (metacognitive) self-regulation for learning and behavioral academic engagement.
Version 3 aimed to support students’ sense of belonging by training professional collaboration and recognizing personal and others’ professional qualities.

Experimental design

The sample consists of two (presumably three) cohorts of first-year students at the Faculty of Law of a European university offering different undergraduate study programs with an almost identical propaedeutic phase. Students in these programs typically come from diverse backgrounds ranging from e.g. a family of lawyers to a substantial, stable minority of first-generation students (FGS, ~20%). Dropout in the first year is relatively high (~30-40%).

In our (quasi-)experimental design, the first cohort (2023-2024) and some study programs in the second (2024-2025) and possibly third cohort (2025-2026) serve as a control group and do not receive any training. In the second (and possibly third) cohort, student groups in a majority of study programs receive training in the 9th week of the academic year, strategically planned right after their first exams. These student groups are randomly assigned to any of the three versions.
All student groups in the second (and possibly third) cohort are presented with identical pre- and post-measurement surveys in week 4/5 and 10/11 of the academic year to assess the interventions’ intended psychological and behavioral outcomes. We also obtain administration on individual previous performance in high school, exam performance and formal dropout during the propaedeutic phase, and answers on an intake survey for prospective students in July (before the start of the study program).

All survey data and administrative data is merged and pseudonymized by designated officers. The first analyzable dataset will be accessed by the investigators at the earliest in January 2025.

Design details

Randomization method
Study programs were first assigned to 'any treatment' or 'no treatment' to obtain equal numbers in the treatment arms. Selection of study programs for 'any treatment' or 'no treatment' was based on practical considerations and latest available dropout rates from earlier years to reach best comparable conditions in the second cohort. If the intervention can be continued in the third cohort, practical administrative reasons will dictate the choice of study programs for the 'no treatment' group, but these will likely be limited to programs that were in the 'no treatment' selection in the second cohort. In the study programs selected for treatment, training versions were manually, randomly distributed over student groups taking into account that versions were as much as possible equally spread over study programs, the intervention week, and time of day, with all five trainers assigned to at least two training sessions of two training versions.
Randomization unit
Student groups of 25-30 students each, assigned to voluntary training
Clusters
76 student groups over 2 cohorts (+ 38 if a third cohort is included)
Observations
maximum ~2700 students
Arms
cohort 1: 38 student groups control cohort 2: 14 student groups control, 24 student groups treatment (8 self-regulation training for wellbeing, 8 self-regulation training for learning, 8 training professional social skills) cohort 3: 10 student groups control, 28 student groups treatment (9 self-regulation training for wellbeing, 9 self-regulation training for learning, 9 training professional social skills). The opportunity to have this cohort 3 depends on organizational decisions and is independent of the results of cohort 2.
Primary outcomes
Primary intended training effects (i.e. manipulation checks) are obtained from student agreement with two single statements on students beliefs: one statement for version 1 and 2, one statement for version 3. Key psychological and behavioral outcomes are students' development in self-reported beliefs and behaviors on a pre- and post-measurement (i.e. transfer effects). For the first training version on self-regulation for wellbeing, the key outcomes are wellbeing and help-seeking behaviors. For the second training version on self-regulation for learning the key outcomes are metacognitive self-regulation for learning and academic behavioral engagement. For the third training version on professional social skills, the key outcome is sense-of-belonging within the student group. Academic performance in exam grades and dropout are considered as outcomes of interest for all training versions.
Secondary outcomes
We also explore the effect of several known predictors of study-success. This includes high school grades and answers on an intake survey for prospective students in July (before the start of the study program). We wish to replicate the relation between these variables and study success, as well as investigate differences in treatment effect of the training on the basis of these student characteristics.

Cited by

No citation data available for this registration yet.

Keywords