Improving Teachers’ Equitable Mathematics Instruction Through Integrating Automated Feedback and Coaching: A Randomized Controlled Trial
How to cite
Liu, Jing; Hill, Heather; Demszky, Dora. 2024. "Improving Teachers’ Equitable Mathematics Instruction Through Integrating Automated Feedback and Coaching: A Randomized Controlled Trial." AEA RCT Registry. AEARCTR-0014383. https://doi.org/10.1257/rct.14383-2.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Embedding artificial intelligence-based automated feedback in teacher coaching can enhance teacher effectiveness with mathematics curriculum materials. This project will provide all teachers in this study with automated feedback and coaching on curriculum-aligned, equity-focused instructional moves. While doing so, we will vary the approach taken by this coaching to evaluate whether reflective or directive coaching is more effective in changing instructional quality and, down the line, student outcomes. This project seeks to evaluate these two models of instructional coaching by integrating state-of-the-art automated feedback on mathematics lessons with coaching routines that support teacher change. The M-Powering Teachers automated feedback tool provides teachers with feedback related to instructional moves such as focusing questions, uptake of student ideas, student idea attribution, and more. Our central goal is to design feedback and coaching experiences that maximize impact on teaching and learning, especially for historically marginalized student populations.
Intervention
In this study, we will explore the efficacy of two coaching approaches, reflective and directive, through a randomized controlled trial. In the reflective coaching model, teacher self-reflection guides the coaching conversation. Goker (2021) defines reflection as “a reaction to past experience and includes deliberate recall and analysis of that experience and decision-making and as a reference for further plans and actions” (p. 425). By giving teachers the space to think critically about their practice and to take the lead in analyzing their own instruction, teachers feel empowered to make changes to their practice. Literature on adult learning theory shows that self-direction is crucial for adults to change their behavior (Knowles et al., 2011; Merriam, 2001). Soisangwarn and Wongwanich (2014) find that teacher self-reflection through peer coaching improves teachers’ motivation to improve their teaching skills in Thailand. Additionally, a study of pre-service teachers in Turkey shows that reflective coaching improves teachers’ instructional skills in lesson planning and implementation (Goker, 2021).
Because teachers’ self-reflections are sometimes inaccurate and biased (e.g., teachers might think they are using an instructional talk move more than they are in reality), some recommend a more directive approach to coaching (Hammond & Moore, 2018). In the directive coaching model, the instructional coach leads the conversation with the teacher by providing more explicit guidance and specific advice. Ippolito (2010) defines directive coaching as “coaching for the implementation of particular practices” (p. 164). In the directive approach, the instructional coach takes the role of the expert to guide the teacher toward executing certain instructional moves with less teacher input than the reflective approach. Directive coaching may be more beneficial for novice teachers, while responsive coaching may foster more trusting relationships between the teacher and coach (Ippolito, 2010). Both coaching models utilize structured routines to encourage PL, but the approaches vary in the level of coach direction and teacher self-reflection. In practice, many coaching conversations incorporate both approaches, and many coaches switch between the two models depending on the teacher and the context of the PL (Ippolito, 2010). While both approaches seem valuable, determining which coaching model is more successful in improving effective and equitable mathematics instruction will allow practitioners to maximize PL impacts in the future.
Experimental design
Half of teachers will be assigned to reflective coaching, and the other half will be assigned to directive coaching. Randomization will be done within coaches.
Design details
Cited by
No citation data available for this registration yet.