Demand for Online Teaching - Evidence from a large-scale survey

How to cite

Wiborg, Vegard Sjurseike; Fidjeland, Andreas Østbø. 2023. "Demand for Online Teaching - Evidence from a large-scale survey." AEA RCT Registry. AEARCTR-0011297. https://doi.org/10.1257/rct.11297-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Vegard Sjurseike Wiborg* , Andreas Østbø Fidjeland

* Primary investigator

Registry ID
AEARCTR-0011297
DOI
https://doi.org/10.1257/rct.11297-1.0
First registered
Last updated
Status
Completed
Trial dates
2023-03-23 – 2023-04-26
Countries
Norway ()
JEL codes
I2, I23
Registry record
http://www.socialscienceregistry.org/trials/11297

Abstract

Research on students’ attitudes towards online teaching is a vital factor in predicting market changes, due to the increasing prevalence of online teaching in higher education. Still, there is little research on this topic in economics. Moreover, studies across the social sciences seldomly apply experimental methods to elicit such attitudes, instead relying and small samples prone to selection bias. This pre-analysis plan describes a survey experiment designed to overcome the methodological shortcomings of the existing literature, and an important knowledge gap by shedding light on students’ perceptions of online teaching on their own motivation and learning outcomes. The plan includes motivation, and information about the conduction of the survey, about the implementation of the experiment, hypotheses, power tests and exploratory analyses. The survey was launched in mid-March 2023 and is administered by the Norwegian Agency for Quality Assurance in Education (NOKUT). The data collection period is scheduled to end in late April. We expect to receive the dataset in the end of April/beginning of May.

Intervention

In a survey experiment, students are presented with a scenario describing hypothetical changes of four aspects of their study program – teaching, feedback, exchange possibilities and semester fee. We implement three between-subjects treatments with regards to the share of online teaching in the study program: 25%, 50% and 75% online teaching.

Experimental design

We present students with a scenario describing hypothetical changes of four aspects of their study program – teaching, feedback, exchange possibilities and semester fee – and implement three between-subjects treatments with regards to the share of online teaching in the study program: 25%, 50% and 75% online teaching. For comparison we also randomly vary the level of semester fees which is paid by students prior to each semester. This allows us to compare the effects of our online teaching treatments with the effects of increased semester fees, thereby providing a scale with a natural interpretation to which we can anchor our estimates of the demand for online teaching. Based on the information provided, we ask students to answer three questions regarding their motivation, learning outcomes, and probability of finishing their degree on time (30 ECTS credits per semester on average). We also ask them to evaluate two claims regarding 1) the attractiveness of the changes and 2) whether the changes would affect the extent of part-time work.

Design details

Randomization method
Randomization done in office by computer. Our experimental set up has nine treatment groups (3 online treatment x 3 semester fee treatments). Respondents were randomly assigned to one of the treatment groups prior to the distribution of the survey.
Randomization unit
Between subjects at the individual level.
Clusters
No treatment clusters
Observations
10603 students from Norwegian higher education institutions were invited to participate in the survey. Based on a conservative estimate of the response rate, 20%, we expect to have around 2000 respondents in our endline sample.
Arms
About 220 respondents in each of the nine treatment arms.
Primary outcomes
Our aim is to gauge how the share of online teaching in the scenarios affect students perception of three outcomes: - Academic outcomes - Time spent on side work - Probability of changing study program

Cited by

No citation data available for this registration yet.

Keywords