A Randomized Controlled Trial to Replicate and Personalize with Technology the Effects of a Model of Reading Engagement (MORE) on First- and Second-Graders’ Science and Social Studies Domain Knowledge, Reading Engagement, Reading Comprehension, and Basic Literacy Skills

How to cite

Scherer, Ethan; Kim, James. 2023. "A Randomized Controlled Trial to Replicate and Personalize with Technology the Effects of a Model of Reading Engagement (MORE) on First- and Second-Graders’ Science and Social Studies Domain Knowledge, Reading Engagement, Reading Comprehension, and Basic Literacy Skills." AEA RCT Registry. AEARCTR-0003488. https://doi.org/10.1257/rct.3488-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Ethan Scherer* , James Kim

* Primary investigator

Registry ID
AEARCTR-0003488
DOI
https://doi.org/10.1257/rct.3488-1.0
First registered
Last updated
Status
Completed
Trial dates
2018-10-25 – 2023-06-30
Countries
United States of America (South)
Registry record
http://www.socialscienceregistry.org/trials/3488

Abstract

The purpose of this study is to develop a content area literacy intervention and to examine near transfer effects on first- and second-graders’ science and social studies domain knowledge and reading motivation and far transfer effects on reading comprehension and reading engagement. The Model of Reading Engagement (MORE) lessons provides teachers with 20 lessons that (a) give students access to complex and conceptually-related science and social studies content through engaging texts, (b) extend content learning through integrated, standards-aligned reading and writing activities, (c) attend to student motivation and engagement through a variety of strategies (e.g., choice, collaboration), and (d) increase exposure to content vocabulary through home book reading activities. The randomized controlled trial tests the efficacy of an augmented MORE curriculum. First the curriculum expands builds upon the existing 10 science lessons and adds an addition 10 lessons focused on social studies. Second, using technology as a tool we personalize gamified reading activities based upon common early literacy screeners through a software application.

Intervention

The Model of Reading Engagement (MORE) curriculum provides teachers with 20 lessons that (a) give students access to complex and conceptually-related science and social studies content through engaging texts, (b) extend content learning through integrated, standards-aligned reading and writing activities, (c) attend to student motivation and engagement through a variety of strategies (e.g., choice, collaboration), and (d) increase exposure to content vocabulary through home book reading activities. Teachers will implement these lessons during January, February, and March of 2019. The first 10 lessons are focused on either animal survival (grade 1) or dinosaur fossils (grade 2) and are aligned to both the Next Generation Science Standards and the Common Core State Standards. The second 10 lessons are focused on either explorers (grade 1) or people who made history (grade 2) and are aligned to both the College, Career, and Civic Life Framework and the Common Core. In addition, each MORE classroom will receive 10 thematically-related books at the end of each set of 10 lessons (science or social studies) to add to their classroom library. The students will receive six books of their own to take home during the intervention.

The randomized controlled trial aims to test the efficacy of the MORE lessons enhanced with gamified reading activities administered through an application compared to classrooms with traditional instruction. These reading activities will be personalized based two literacy screeners. We will assess the difference between the literacy screeners using engagement with the reading activities, and on standardized performance assessment.

The content in the application will leverage the Wish, Outcome, Obstacle, and Plan (WOOP) process (Oettingen, 2012) and MORE framework. The application will complement the books utilized in the MORE lessons and the reading activities will be based upon these books and developed by the researchers to mimic content on the relevant screeners. These reading activities will be tailored to the students reading level using baseline measure of the MCLASS or Northwest Evaluation Association - Measure of Academic Progress (MAP) screeners. We will test the predictive validity of these reading activities using the post intervention standardized test. These activities will feel like a game for the students where there will be a clear overall objective with smaller task to complete along the way.

Experimental design

Researchers at the READS Lab at the Harvard Graduate School of Education will conduct the randomized controlled trial. The unit of randomization for the main treatment (e.g., MORE lesson) vs. control group conditions (e.g., business as usual) is the school-grade. We block by prior experience with MORE lessons, student enrollment and prior achievement on 3rd grade test scores during the 2016-17 school year. With the exception of the prior experience where there are six schools, four schools are within each cell. Next, we randomly assign whether the schools will receive treatment in grade 1 or 2. Thus, within each cell there will be two treated second-grades and two corresponding second-grade controls. Similarly, there will be two first-grade treatment grade and two controls, so all schools will have either have a treated first or second grade. The unit of randomization for the screener will be the student. All students take the beginning of year and mid-year MCLASS and MAP. We will then use either MCLASS, MAP, or a combination to designate students into three areas of proficiency. One third of the students will be designated by their MCLASS scores only and be assigned reading activities in the application aligned with the MCLASS. The second group of students will be designated by their MAP scores only and be assigned reading activities based upon MAP. The third group will use a combination of the assessments and receive a combination of reading activities.

Design details

Randomization method
Randomization was conducted in an office by a computer and implemented using STATA code.
Randomization unit
The unit of randomization is the school, blocked by prior experience with MORE in the spring of 2018, school size, and performance third grade state accountability test during the 2016-17 school year. The unit of randomization for using the MAP, MCLASS, or a combination as a screener conditions is the student, conditional on receiving the application and blocked by classroom.
Clusters
Planned number of clusters = 30 school clusters (15 first-grade and 15 second-grade)
Observations
Of the total of 6,400 students in participating classrooms, we expect approximately 80% of students to receive parental consent, yielding an analytic sample around 2,570 Grade 1 and 2,540 Grade 2 students.
Arms
2,540 students in the control group, 2,570 students in the MORE group: 857 students in the APP condition using the MAP screener; 857 students in the APP condition using the MCLASS screener; 856 students in the APP condition using both screeners
Primary outcomes
There are three primary outcomes. First, we will administer a researcher-developed measures of student knowledge of science and social studies concepts taught in the MORE lessons. Second, we will use administrative data on a vertically scaled reading test – the MAP, Primary Grade Reading. Third, we will use administrative data on a measure of early literacy skills (MCLASS Dynamic Indicators of Basic Early Literacy Skills (DIBELS) Next and 3-D.
Secondary outcomes
o There are five secondary measures of student engagement including a task-specific reading motivation measure, student self-report measure (Me and My Reading Profile, MMRP), teacher ratings based on a previously developed measure (Leppola et al., 2005), student school attendance and the data collected by the application.

Cited by

No citation data available for this registration yet.

Keywords