A randomized controlled experiment for comparing the effectiveness of hybrid and online teaching during COVID-19 pandemic
How to cite
Cheung, Yue Yat Harrison; Lam, Kwok Fai. 2021. "A randomized controlled experiment for comparing the effectiveness of hybrid and online teaching during COVID-19 pandemic." AEA RCT Registry. AEARCTR-0008750. https://doi.org/10.1257/rct.8750-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This study aimed to compare the effectiveness of hybrid and online teaching through a large-scale randomized controlled experiment. A total of 725 students were randomly assigned to either the hybrid or online teaching mode where students assigned to the hybrid mode received face-to-face lectures and tutorials and those to the online mode received exactly the same live-streamed lessons on Zoom. Since all students had access to the recorded teaching videos, the face-to-face element was the only difference between the hybrid and online teaching modes. This experiment can help to identify the add-on value of face-to-face teaching in a hybrid mode over a purely online teaching mode. Results showed that the difference in learning outcomes between the two modes were statistically insignificant. Class size was found to be an effect modifier that students assigned to the hybrid mode had significantly higher final weighted and final exam scores if they had face-to-face lessons with 25 students or less. The Pass/Fail grading option was found to have significantly negative effect on course performance. Continuous assessment should be emphasized and contribute more toward the final grade so that students are encouraged to work hard throughout the entire semester.
Intervention
Students in each course were randomly assigned to the intervention and control groups where students in the intervention group received hybrid mode instructions and those in the control group received purely online mode instructions.
Experimental design
A total of 725 undergraduate and postgraduate students from the University of Hong Kong taking one of the 7 statistics courses were invited to participate in this study. Students in each course were randomly assigned to the intervention and control groups where students in the intervention group received hybrid mode instructions and those in the control group received purely online mode instructions. The assignment score, test score, coursework score (a weighted average of the test and assignment scores), final exam score and final weighted score (a weighted average of the final exam and coursework scores) along with the baseline variables were collected for the purpose of this study.
Design details
Cited by
No citation data available for this registration yet.