The Impact of Cell Phones in Traditional Classrooms
How to cite
Hussain, Karrar; Naseer, Muhammad.
2018. "The Impact of Cell Phones in Traditional Classrooms." AEA RCT Registry. AEARCTR-0003659.
https://doi.org/10.1257/rct.3659-1.1
Download:
BibTeX
·
RIS— for reference managers without a browser
translator. Zotero and most
others pick up this page's citation metadata directly.
The rise in the use of social media applications has dramatically increased the time spent on cell phones especially among the educated youth. Whereas the widespread ownership of mobile phone devices presents unique opportunities for the design of educational experience, and has created a lot of interest in newer models of imparting education, the life of a typical university student still predominantly revolves around attending lectures and taking exams. In such a setting, use of mobile phones in class could potentially have an adverse effect by drawing student attention away from learning. This research aims to carefully measure whether having access to a cell phone during class impacts student learning outcomes.
In this study, we aim to carefully measure the impact, if any, from students’ use of cell phone in the classroom using a randomized experiment. One of the questions we want to answer carefully is the extent to which use of a cell phone in class affects learning as measured by test scores. In addition, we want to collect data on intermediate outcomes of interest: class attendance and student engagement with class. Therefore, our primary outcome of interest is test scores while the secondary outcome variables are attendance and classroom activity.
Experimental design
This research aims to carefully measure whether having access to a cell phone during class impacts student learning outcomes and establish some potential mechanisms. One of the questions we want to answer carefully is whether using your cell phone in class affects learning (and, if so, to what extent) as measured by test scores. We may also be able to establish any spillover effects of cell phones on other students in the class. In addition, we want to collect data on intermediate outcomes of interest, namely class attendance and student attentiveness, to establish the underlying mechanism behind any such impacts. Therefore, our primary outcome of interest is test scores while the secondary outcome variables are attendance and classroom activity.
Design details
Randomization method
At the start of Week 2 of the semester (after the initial course ‘shopping’ window had formally closed), we obtained the enrollment list of each participating course from the instructors. While no new students could enroll after Week 1, some students still dropped their course before the end of the experiment due to which we will test for differential attrition by treatment status. Simultaneously, students were asked to complete a short baseline survey and a subject-specific test by the end of Week 3.
Several of the 11 courses had students from different batches enrolled in them. Within each class and batch cohort, students were randomized into treatment and control groups with equal probability. Beginning Week 4, students in the Treatment group were asked to comply with the “Treatment” condition i.e. deposit their cell phones with members of the project team at the start of each lecture and collect it after class.
For the latter half of the semester, we re-randomized students into T and C groups again stratifying on class and batch indicators while ignoring the prior treatment status. This decision was based on the following considerations:
i. By creating 4 ex-ante identical experimental groups (CC, CT, TC, TT), we varied treatment intensity orthogonally to student attributes. Besides allowing us to test if the duration of treatment matters, this set up also allows us to ask if the order of treatment matters.
ii. For the simple comparison of outcomes in Treatment versus Control, the second randomization can effectively allow us to double the sample size which improves power on the main hypothesis of interest.
iii. Like the pilot study conducted during the summer, subject fatigue started to arise in the Treatment group with students in that group increasingly disinclined to give their cell phones as the semester went on. Therefore in order to maintain high compliance with the experiment, which was crucial for power given that we estimate the ITT effect, we decided to do a second randomization offering everyone in the experiment a “fair second chance”.
Randomization unit
The experiment was carried out in Pakistan at the Lahore University of Management Sciences (LUMS) which offers undergraduate and Masters level courses in Economics and other disciplines.
With consent from the instructors, students from a total of 8 undergraduate courses (ranging from freshmen to junior level courses) were included in this study which amounted to 11 classes or sections being taught by 9 different instructors. All of these are economics courses with the exception of one course from the education school and all instructors were generally quite permissive towards cell phone use by students in their classes.
Clusters
The number of clusters are 11 participating courses (679 unique students).
Observations
Planned number of observation is comprised of 824 student-course units.
Arms
50% of each cluster is selected randomly in the treatment group.
Primary outcomes
Primary outcome of interest is the test scores in quizzes and exams.
Secondary outcomes
The secondary outcome variables are students' classroom attendance and classroom activity.
Cited by
No citation data available for this registration yet.