The Promises and Perils of Diagnostic Labels
How to cite
Chu, James; Kardanova, Elena; Abdurakhmanova, Elen; Loyalka, Prashant. 2020. "The Promises and Perils of Diagnostic Labels." AEA RCT Registry. AEARCTR-0006472. https://doi.org/10.1257/rct.6472-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Diagnostic labels are commonly used in educational and medical fields. Although research has shown that diagnostic labels can have adverse consequences on individual outcomes, there remain fundamental, unresolved questions in this literature: (1) To what extent does the introduction of diagnostic labels affect outcomes for a group on average? (2) To what extent do labels improve average group outcomes at the expense of certain subgroups of individuals? (3) How do the effects of diagnostic labels for groups and individuals depend on the proportion of other individuals who are also labelled in the group? To answer these questions, we propose a large-scale cluster randomized controlled trial among approximately 5,000 first-grade schoolchildren in 195 schools in Russia. Schools were randomly assigned to one of two treatment arms, where teachers received information about the performance of their students (a) without a corresponding diagnostic label for their students’ performance or (b) with a label for students as being “basic” / “proficient” in their academic performance or “developing” / “mature” in their behavioral performance. Results will inform the functions and tradeoffs of diagnostic labels for groups and individuals.
Intervention
In the control group schools, psychometricians will provide teachers with numeric measures of student cognitive (academic) and non-cognitive (behavioral) performance (on a scale between 0 to 100) on the baseline assessments. This information is provided as part of an ongoing partnership with the regional governments to equip teachers with more information about their students.
In the treatment group schools, psychometricians will not only provide teachers with the numeric measures of student cognitive and non-cognitive performance but also diagnostic labels of student performance. Specifically, students across the sample who scored below 50 in their academic assessment are labeled as “basic” rather than “proficient,” and students in the sample who scored below 50 in their behavioral assessment are labeled as “developing” rather than “mature.” These assessments and labels are designed and pre-tested by Russian academics to be easily interpretable by teachers. For instance, teachers were invited to focus groups to offer feedback on different labels, and these labels were the most easily understood.
Experimental design
We will conduct a cluster randomized controlled trial (RCT) involving 5,392 first grade schoolchildren (mean age of children = 7.4 years, proportion female = 0.50) across 195 schools in two regions of Russia. The vast majority of the 195 schools had one first grade class and teacher, but some schools had multiple first grade classes, each with its own teacher. Students and teachers from all first-grade classes were requested to participate in the study (for a total of 288 classes and teachers). All teachers participated in both a baseline and follow-up survey questionnaire. All students, in both baseline and follow-up, also participated in standardized cognitive and non-cognitive assessments produced by trained psychometricians.
Schools were randomized to one of two treatment arms in the RCT. Sample strata or blocks were created by placing the four schools with the closest mean math scores in a strata. Altogether, this resulted in 49 strata. Schools were then randomly allocated within these strata to one of two different treatment conditions.
Design details
Cited by
No citation data available for this registration yet.