Evaluation of Big Word Club

How to cite

Michelini, Michelle Park; Kalil, Ariel; Oreoupoulos, Philip. 2018. "Evaluation of Big Word Club." AEA RCT Registry. AEARCTR-0002631. https://doi.org/10.1257/rct.2631-3.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Michelle Park Michelini* , Ariel Kalil , Philip Oreoupoulos

* Primary investigator

Registry ID
AEARCTR-0002631
DOI
https://doi.org/10.1257/rct.2631-3.0
First registered
Last updated
Status
Completed
Trial dates
2017-11-13 – 2018-12-31
Countries
United States of America ()
JEL codes
I20; I21; I24
Registry record
http://www.socialscienceregistry.org/trials/2631

Abstract

Vocabulary is an important part of literacy skill development, and understanding the effectiveness of various types of programs can help parents, schools, and states decide what to invest in. Programs that use entertainment to engage students to learn (“Edutainment” programs) are popular, but experimental evidence on their effectiveness at teaching vocabulary is sparse. In this paper, we use an RCT to evaluate the effectiveness of a program that uses technology and entertainment to teach vocabulary to children. The program, Big Word Club (BWC), is a web-based platform consisting of animated book videos, dance videos, and music videos intended to help children learn one new word per day. Our field experiment was conducted with 818 Pre-K and Kindergarten students in 47 schools across 3 U.S. states. We randomly assigned schools to a control condition or to use the BWC platform in their curriculum. We find that the program was effective in teaching the vocabulary words that were targeted by the program (0.30 SD) after four months of use. Further, this effect persisted in a follow-up test 2 months later. Treated students also scored higher on a standardized vocabulary assessment (PPVT), but this difference was not statistically significant.

Intervention

The Big Word Club (BWC) is a digital learning program that uses books, songs, animation and dance to introduce children to a new word every day of the school year. It is intended for children in preschool to grade 4 with different classroom materials depending on the grade. In general the words are “big” in the sense that many are not typical of the vocabulary of such young children. For example the words for preschoolers include gargantuan, primate, prehensile, equator, and slither. Each week the BWC provides classroom teachers with nine new videos based on that week’s theme. The videos include five that introduce the word for each day, one animated book, one animated music video, and one dance video all of which include the five words for that week. The videos also include a review of the week’s words. The BWC provides much flexibility to teachers who can use the videos any time during the day. Each video is only 3-4 minutes long so implementing the BWC is not costly in terms of classroom time. Many teachers report using the animated books at story time, the dances as a break during the day and the songs during sing along time. The review is typically done on Fridays. It is intended to supplement and not substitute for the normal classroom literacy curriculum.

Experimental design

Schools are randomly assigned to participate in either the BWC or to be in a business as usual control group.

Design details

Randomization method
Randomization completed in office by a computer.
Randomization unit
School level
Clusters
50-65 schools
Observations
Estimated 750-1,000 children assessed twice (1,500 - 2,000 total observations)
Arms
50 - 65 schools with an estimated 16 - 20 children per classroom.
Primary outcomes
Receptive vocabulary

Materials

Cited by

No citation data available for this registration yet.

Keywords