The effect of informational sessions on student’s college application: evidence from a policy experiment in France

How to cite

Gurgand, Marc; Behaghel, Luc; Gleyo, Louis; Andreescu, Marie; Liu, Vivien. 2024. "The effect of informational sessions on student’s college application: evidence from a policy experiment in France." AEA RCT Registry. AEARCTR-0014625. https://doi.org/10.1257/rct.14625-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Marc Gurgand* , Luc Behaghel , Louis Gleyo , Marie Andreescu , Vivien Liu

* Primary investigator

Registry ID
AEARCTR-0014625
DOI
https://doi.org/10.1257/rct.14625-1.0
First registered
Last updated
Status
Completed
Trial dates
2024-01-08 – 2024-03-14
Countries
France ()
JEL codes
C93, C25, D83, D91, I24
Registry record
http://www.socialscienceregistry.org/trials/14625

Abstract

For this study, we conducted a trial preceding the implementation of a nationwide tool in France to help high school seniors decide on their track choice after they graduate. To test the effectiveness of this policy, we recruited voluntary high schools and randomly assigned some classes to a placebo and some to the treatment. Both control and treated students were asked for information on their history, preferences and areas of interest. The treated students were given recommendation and information on paths of higher education that might interest them, based on the information provided. In addition, another A/B test was nested within this experiment, this time with individual randomization within treated classes. In version A of the platform, assigned to half the students, each path’s information note is clearly accompanied by information on the distribution of grades of students entering this path, whereas in version B this information must be sought out by students.

Intervention

The goal of this intervention is to improve educational track decisions and to assist students, particularly girls and those from disadvantaged backgrounds, in making better-informed decisions about their future studies. A user-friendly online platform called MonProjetSup was designed to help high school seniors explore potential educational pathways by providing personalized recommendations based on their academic background, interests, and preferences. The system incorporates an algorithm that suggests relevant tracks (rather than specific programs), allowing students to discover options they might have otherwise overlooked. A track is a combination of a field of study and a type of diploma (for example, bachelor’s of mathematics, corresponding to an official government classification), whereas a program also specifies the institution of higher education (for example, bachelor’s of mathematics at the University Lyon 1).

Experimental design

The main experiment (experiment 1) tests the effects on high school students’ higher education (HE) track choices, of providing information and individualized recommendations on HE tracks. Randomization happens at the class level in a set of volunteer high schools. In a first sitting, all classrooms’ students were offered a prototype of the MonProjetSup platform, asking them questions about their history, preferences and areas of interest, and offering relevant suggestions of careers that might be of interest to them. Randomization of classes followed the closure of that sequence; it was stratified by high school and within high schools, classes regrouped by majors, and restricted to classes that had participated in the first sitting. A second sitting was then reserved to treated classrooms, during which students were offered precise and individualized recommendations for tracks of study, determined by an algorithm that used the information filled-in during the first sitting. This intervention takes the form of an encouragement design as professors and students were free to participate in the second sitting and focussed with varying degrees of intensity on the information provided to them. However, students in the control group did not at any point have access to the treatment. To increase take-up, we also allowed treated students to participate in the second sitting at home if they had not done so at school.
The nested experiment (experiment 2) consists in an encouragement design testing the effect of providing information on programs’ selectivity. It was conducted in the subset of classes that were assigned treatment in experiment 1. For this A/B test, half of students who opened an information note on a track were readily given information on the distribution of grades in the target program, and the other half had to exert effort to retrieve this information. Treated students were determined ex ante by a Bernouilli trial (at rate 50%).

Design details

Randomization method
Computer randomization. For assignment of classes to control or treatment in experiment 1: stratified by high school and then by major. For assignment of students to control or treatment in experiment 2: no stratification.
Randomization unit
Classes for experiment 1, students for experiment 2.
Clusters
207 recruited classes
Observations
5056 students
Arms
In experiment 1 :105 classes assigned to treatment; 102 classes assigned to control. In experiment 2 : 376 students for Version A (test), 384 students for Version B (control)
Primary outcomes
All measured using students’ university choices in the Parcoursup application platform: -How diverse applications are -How ambitious applications are
Secondary outcomes
-Additional measures of ambition -Dyadic analysis
Partners
Name: Parcoursup Partner_type: government Url: https://www.parcoursup.gouv.fr/ Name: ONISEP Partner_type: government Url: https://www.onisep.fr/

Cited by

No citation data available for this registration yet.

Keywords