Labour market information and study choice: One-size-fits-all?
How to cite
Rodriguez, Sandra Perez; Fouarge, Didier; Künn-Nelen, Annemarie. 2023. "Labour market information and study choice: One-size-fits-all?." AEA RCT Registry. AEARCTR-0011785. https://doi.org/10.1257/rct.11785-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Career guidance is essential for an informed study choice. Information on labour demand (e.g., wages) is particularly relevant in order to help youngsters make study choice that fit current and future demand. However, experiments that make such labour market information available to youngsters do not always have the expected effect, suggesting that there is no one-size-fits-all solution. Responsiveness to such information is likely to depend on personal characteristics (e.g., gender and migration background), time and risk preferences and skill level (e.g., numeracy, literacy, graph literacy or economic literacy), as well as on the way the information is presented. In collaboration with one of the largest career guidance platforms in the Netherlands, we conduct a field experiment for 15-year-old students to investigate what format of presenting wage information has the strongest effect on study choice. Our experiment aims at expanding the literature in two ways. First, we analyse what format of labour market information has the strongest effect on study choice. We distinguish between a pictograph (bar chart vs. icon arrays), a (neutral or colourful) ladder or a table in providing wage information for occupations. We hypothesize that the effects depend on gender, socio-economic status, time and risk preferences and migration background. Second, we analyse to what extent the potential heterogeneous effects are driven by differences in numeracy, literacy, graph literacy and economic literacy skills. This enables us to distinguish whether different individuals make intrinsically different choices, or whether different choices are a result of different skill levels. We hypothesize that at least part of the effect of making different choices is the result of different skill levels. We would like to investigate whether differences in skills can fully explain the expected differences in responsiveness towards labour market information. This insight would not only contribute to scientific literature, but would be also highly valuable for policy makers as it provides directions on how to reduce inequality of opportunities by improving the way career guidance is provided.
Intervention
In the Netherlands, secondary schools have the obligation to provide career guidance to their pupils. Often, they will do this by contracting a private company that specialized in career guidance. In collaboration with a career counseling platform called Qompas, one of the largest in the Netherlands, we propose a field experiment to answer the following research questions: What format of labour market information has the strongest effect on study choice? Does displaying labour market information using a pictograph (bar chart or icon arrays), a (neutral or colourful) risk ladder or a table have a different effect on study choice depending on the students’ numeracy, literacy, graph literacy and economic skills? Is there heterogeneity by gender, socio-economic status, time and risk preferences and migration background?
Our target population are 3rd year students at the general and academic high school tracks in the Netherlands, who use Qompas’ resources to help them choose their profile in secondary education as part of their school curriculum. We are building on the experiment conducted by de Koning (2022) in cooperation with Qompas; who showed that information has a positive effect on belief’s accuracy in the short-term, and occupational preferences. Nonetheless, there are several differences between that study and ours, as we would like to take into consideration students’ individual characteristics and to analyse their response to different formats of information.
Students take several tests that are already included in the platform regarding their competences, interests and high school profile preferences. Based on pupils’ answers, Qompas presents the occupation sectors that fit best each student, including a list of example occupations. We will ask the pupils to make a shortlist of 10 favourite occupations and rank them in terms of their preferences (ranking A). The average gross hourly wage corresponding with the shortlisted occupations will be displayed for the students in the treatment groups.
Each treatment group would see the corresponding information in a different format: table, (colourful or neutral) risk ladder or bar chart or icon arrays. Students that belong to the control group will not have access to wage information. Right after receiving the information, treatment group students shall rank the shortlisted occupations again (ranking B), which helps test the short run effect of the information intervention on preferences. We would compare the average wage corresponding to the preferred occupations among the pupils that received information in different formats and those that did not, given gender, socioeconomic background, migration background, numeracy, literacy, economic and graph literacy, time and risk preferences. On two later points in time during the experiment, after students have gone through other assignments, we ask all students again to rank a (reduced) list of occupations based on their preferences (rankings C and D) in order to study the mid run effect of the information treatment.
Reference
de Koning, B. K. (2022). Empirical studies on information, beliefs, and choices in education and work [Doctoral Thesis, Maastricht University]. Maastricht.
Experimental design
Students in the third year of the academic and the general track of high school in the Netherlands must choose a profile for the remaining of their secondary education. A large number of schools hire the services of career counselling companies, such as Qompas. Therefore, as part of their career guidance activities in their school curriculum, students already answer multiple tests regarding skills and preferences within the Qompas platform. These tests are presented in the following order: 1) “Profile choice test”, 2) “Competency test” and 3) “Interest questionnaire”. At a later stage, pupils are asked to fill in a Provisional profile choice and finally, their Definite profile choice. Within the platform, students receive information of what profiles and occupations would be a good match for them based on their responses to the test. The aim of our experiment would be to estimate the effect of providing labour market information on the gross hourly wage for these shortlisted occupations in different formats on students’ preferences for occupations and their study profile choice.
Prior to the beginning of the experiment, certain preparations have been done. First of all, having a direct match between the occupations that students will select and the labour market information is essential. Therefore, we substituted the occupational groups that are listed under the 11 categories of occupational sectors in the “Interest test” in Qompas with the ROA-BRC 2014 list of occupations, which is the adaptation to the Dutch context of the International Standard Classification of Occupations (ISCO). A graph literacy test has been incorporated into the platform, based on Okan et al. (2019). Furthermore, we have also included a shorter adaptation of the economic competences test from Oberrauch et al. (2023). Only schools whose headmaster has given consent will participate in the experiment. Moreover, students have the option to opt out of the experiment if they so wish.
Our intervention would take place after the “Interest questionnaire”. When pupils fill in the so-called “Interest questionnaire”, Qompas provides an overview on how the following 11 occupational sectors match them in a 5-point scale ranging from Very much (represented by ++) to Not at all (displayed as - -). A list of the occupations that are comprised within each sector is shown when clicking in the arrow on the right side of the category. All students will be asked to first select their preferred 10 occupations out of the top 3 of broad categories of occupations (beroepensectoren). Then we give them the option to choose additional existing occupations and exchange them for any of the already selected ones, so they keep a total of 10. Once they have their shortlist of 10 occupations, we would ask them to rank them (Ranking A). We have decided to have a shortlist of 10 occupations instead of 5 to reduce the risk of having too little variation between occupations (e.g. if a student chooses 5 occupations that are very similar in terms of wage, the intervention would have no effect).
Immediately after, students allocated to each treatment group will receive the average hourly wage corresponding to their shortlisted occupations in the format of table (T1), neutral risk ladder (T2), colourful risk ladder (T3), bar chart (T4) or icon arrays (T5), respectively. The average hourly wage will refer to the most up to date information available (currently 2021). Students in the control group schools will not receive information. Students in the treatment groups will be asked to rank these occupations according to their preferences immediately after seeing the information (Ranking B), in order to measure the short term effect of the intervention. Furthermore, all students (control and treatment groups) will be asked to rank their preferred occupations again when they fill in their provisional (Ranking C) and definite profile choice (Ranking D), which are completed, on average, 15 and 31 days after the interest questionnaire, respectively.
References:
Oberrauch, L., Kaiser, T., & Seeber, G. (2023). Measuring economic competence of youth with a short scale. Journal of Economic Psychology, 97, 102633.
Okan, Y., Janssen, E., Galesic, M., & Waters, E. A. (2019). Using the Short Graph Literacy Scale to Predict Precursors of Health Behavior Change. Medical Decision Making, 39(3), 183-195. https://doi.org/10.1177/0272989x19829728
Design details
Cited by
No citation data available for this registration yet.