Education for All? A Nationwide Audit Study of School Choice
How to cite
McFarlin, Isaac; Bergman, Peter. 2020. "Education for All? A Nationwide Audit Study of School Choice." AEA RCT Registry. AEARCTR-0005288. https://doi.org/10.1257/rct.5288-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
School choice may allow schools to “cream skim,” or impede access, to students perceived as easier to educate or challenging to educate. To test this, we conducted two field experiments, where we sent emails from fictitious parents to charter schools and traditional public schools subject to school choice in 29 states and Washington, D.C. The fictitious parent asked whether any student is eligible to apply to the school and how to apply. Each email signaled a randomly assigned attribute of the child. These randomly assigned attributes signaled the child had one of four conditions about their behavior: a significant special need, poor behavior, high or low prior achievement, and no indication of a condition. Furthermore, fictitious parents and children were randomly assigned attributes, including ethnic-sounding names, gendered-sounding names, whether the child is raised in a two-parent versus one-parent household, and whether the child is a son or daughter. E-mail responses are monitored to detect any systematic evidence of discriminatory practices.
Intervention
Across two field experiments, we sent email messages to charter schools and traditional public schools subject to school choice. We framed each message as coming from a parent looking for a school. The parent contacts the school to ask about their child’s eligibility and how to apply. The baseline message indicated that the parent is looking for a school for their son or daughter and they would like to know whether anyone can apply to that school and how to apply. Each treatment message added a sentence to this baseline message to signal a child’s potential cost to educate, disadvantage, or prior academic performance. This sentence indicated the child has one of the following: an IEP requiring they be taught in a classroom separate from mainstream students; poor behavior; bad grades; or good attendance and good grades. In each experiment, we sent two emails to each school three to four weeks apart.
Experimental design
The first audit study focused exclusively on charter schools from 17 states that have the largest number of charter schools; it was implemented between November and December 2014. The sample of schools included in the first experiment is 3,131 charter schools or roughly half of all the charter schools in the country at that time. The treatment messages were randomly assigned at the school level in the first experiment.
Based on feedback we received from researchers (in November 2016), we conducted a second audit study of both charter schools matched to traditional public schools subject to school choice policies. The purpose of this exercise is to compare response rates between traditional public schools and charter schools. Specifically, we limited the geographic scope of our study to areas that practice some type of intra-district school choice. For every charter school in these areas, we matched it to the nearest traditional public school with the same entry-grade level and within the same school district boundaries. This latter sample consists of 4,338 schools or 2,169 matched-pairs of traditional public schools and charter schools. For the second experiment, treatment messages were clustered at the matched-pair level; identical messages from the same fictitious parent were sent to each charter school and its matched-paired traditional public school.
Within each experiment, no school received the same message treatment twice and a school was assigned a treatment without replacement. We also randomized the order in which schools were contacted.
Design details
Cited by
No citation data available for this registration yet.