Knowledge in Action Efficacy and Maturation Studies
How to cite
Saavedra, Anna; Morgan, Kari; Rapaport, Amie. 2017. "Knowledge in Action Efficacy and Maturation Studies." AEA RCT Registry. AEARCTR-0002189. https://doi.org/10.1257/rct.2189-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Globalization and technological innovation compound the need for schools to prepare students for college, career, and citizenship in the 21st century. To transfer their skills, knowledge, and attitudes to new contexts, students must learn deeply to develop the ability to think and communicate in sophisticated ways, demonstrate creativity and innovation, and learn adaptively. Yet learning course content through the traditional, and currently predominant, “transmission” mode of instruction – in which teachers lecture while students take notes, memorize content, and restate content in multiple-choice assessments – is not an effective way to learn deeply. Through the Knowledge in Action (KIA) project-based approach to Advanced Placement (AP) teaching and learning, students actively engage in teacher- and student-posed learning challenges (i.e., projects) rather than playing a passive role. The goals of the KIA Efficacy Study are to 1) test the hypothesis that the KIA project-based learning approach to AP U.S. Government and AP Environmental Science leads to improved or “deeper” student learning, interpersonal and intrapersonal skills, and civic engagement and 2) identify factors that correlate with successful KIA implementation, such as support from districts, schools, the KIA professional development provider, and professional learning communities. The KIA Efficacy Study examines the impact of a one-year intervention. The KIA Maturation Study evaluates the impact of a second year of KIA.
Intervention
KIA is a response carefully designed to meet the challenges of traditional AP instruction. The initiative was based on the potential, yet under-realized, impact AP courses could have on deeper learning for all students. KIA values both transmission and inquiry instructional approaches, but seeks to maximize the two methods’ respective benefits. The KIA treatment for AP U.S. Government and AP Environmental Science in a teacher’s first year includes access to: curriculum materials through an online portal, a four-day Summer Institute, four full-day professional development sessions offered throughout the school year, one-on-one virtual coaching, and the KIA in-person and virtual professional learning community. In a teacher’s second year, the KIA treatment includes all these elements, save for one-on-one coaching, available to teachers only in their first year.
Experimental design
We recruited five large urban school districts geographically spread across the United States to participate in the study. Within districts, we offered study-enrollment opportunities to AP U.S. Government and AP Environmental Science teachers with at least one year of experience teaching their course (or similar prior experience). In three districts, participation was open to teachers of either AP U.S. Government and AP Environmental Science. In the fourth district, only AP Environmental Science teachers could participate, while in the fifth district the opportunity was limited to teachers of AP U.S. Government.
In the KIA Efficacy Study, across the five districts we randomized 76 schools into treatment or control arms, blocked by school district. Treatment teachers received KIA intervention starting in the summer of 2016 through May 2017, and control teachers continued to teach their AP U.S. Government or AP Environmental Science courses as usual. Students began their AP U.S. Government or AP Environmental Science course starting in September 2016.
Critical to the entire endeavor’s success was the delayed-entry design that provided all teachers enrolled in the Efficacy Study with the opportunity to use KIA curriculum and professional-development supports, either during the 2016-17 or 2017-18 school years. District research review boards likely would not have approved a design in which half the teachers never had the opportunity to use KIA resources yet still were expected to participate in research activities. Teachers may have been hesitant to enroll with the expectation of only probabilistic odds of receiving the opportunity to participate in KIA.
In the KIA Maturation Study, we are following the same teachers who participated in the KIA Efficacy Study and are teaching AP U.S. Government or AP Environmental Science in their district during the 2017-18 school year, as well as their 2017-18 AP U.S. Government or AP Environmental Science students. During this period, both groups of teachers are offered access to the intervention (i.e., the original experimental arm receives a second year of treatment and the original control arm receives a first year of treatment). We then indirectly estimate the two-year effect by summing the estimated one-year effect (from the Efficacy Study period) and the estimated difference between the first year and the second (from the Maturation Study period).
Design details
Papers from this trial
- Saavedra, A. R., Lock Morgan, K., Liu, Y., Garland, M. W., Rapaport, A., Hu, A., Hoepfner, D., & Haderlein, S. K. (2022). The Impact of Project-Based Learning on AP Exam Performance. Educational Evaluation and Policy Analysis, 44(4), 638-666. https://doi.org/10.3102/01623737221084355 https://doi.org/10.3102/01623737221084355
- Saavedra, A., Rapaport, A., Lock Morgan, K., Garland, M., Liu, Y., Hoepfner, D., Hu, A., & Haderlein, S.K. (2021). Knowledge in Action Efficacy Study Over Two Years. University of Southern California. ERIC Number: ED616435 https://files.eric.ed.gov/fulltext/ED616435.pdf
Cited by
No citation data available for this registration yet.