How Mode and Message Shape Principal Responses: An Experimental Survey Study

How to cite

Ersoy, Fulya; Komisarow, Sarah. 2025. "How Mode and Message Shape Principal Responses: An Experimental Survey Study." AEA RCT Registry. AEARCTR-0015986. https://doi.org/10.1257/rct.15986-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Fulya Ersoy* , Sarah Komisarow

* Primary investigator

Registry ID
AEARCTR-0015986
DOI
https://doi.org/10.1257/rct.15986-1.0
First registered
Last updated
Status
In development
Trial dates
2025-05-12 – 2026-06-01
Countries
United States of America ()
JEL codes
C83, I28, D83
Registry record
http://www.socialscienceregistry.org/trials/15986

Abstract

The purpose of our research is to experimentally investigate how different modes of invitation and delivery affect survey take-up and completion among K-12 school principals. We will also measure respondents’ beliefs about disciplinary practices and test respondents’ attention to survey items, comprehension of information provided, and judgement of the credibility and relevance of the information provided.

Intervention

Intervention is research-based evidence on racial disparities in school discipline.

Experimental design

Our experiment will randomly vary the following among our sample of K-12 school principals:
(1) how K-12 principals are invited to participate in the survey (email vs postcard)
(2) how intervention is presented to participants within the survey (flyer vs video) and whether it contains academic references or not.
(3) timing of the intervention

Design details

Randomization method
-For email vs postcards randomization, stratified complete assignment via STATA random number generation is used. Within each state, half of the principals was randomly assigned to receive postcards and the other half was randomly assigned to receive emails. -For randomization to one of the delivery treatments (Flyer-w/o references, Flyer w references, Video w/o references, Video w References), stratified complete random assignment via Qualtrics is utilized. The 12 strata are Kentucky-Elementary-post card, Kentucky-Middle-post card, Kentucky-High-post card, Tennessee-Elementary-post card, Tennessee-Middle-post card, Tennessee-High-post card, Kentucky-Elementary-email, Kentucky-Middle-email, Kentucky-High-email, Tennessee-Elementary-email, Tennessee-Middle-email, Tennessee-High-email. -For randomization of when belief questions are shown (before/after informational material), complete random assignment is used.
Randomization unit
school principal level randomization.
Clusters
We invite 3800 principals (1700 in Tennessee and 1100 in Kentucky) to participate in our survey. We expect a participation rate between 10%-25%.
Observations
We invite 3800 principals (1700 in Tennessee and 1100 in Kentucky) to participate in our survey. We expect a participation rate between 10%-25%.
Arms
post-card:1400, email:1400 Assuming 10% participation rate, Flyer-w/o references: 95, Flyer w references:95, Video w/o references:95, Video w References:95. Assuming 10% participation rate, intervention before belief elicitation: 190, intervention after belief elicitation: 190.
Primary outcomes
-survey take-up -comprehension of the informational material -beliefs about the relevance, clarity, usefulness, and credibility of the informational material -beliefs about disciplinary practices.
Secondary outcomes
-time spent on the informational material

Cited by

No citation data available for this registration yet.

Keywords