Survey Nonresponse Bias Among University Students Receiving Charitable Food Assistance

How to cite

Ahn, Seoyoon; Cronin, Christopher; Gundersen, Craig. 2026. "Survey Nonresponse Bias Among University Students Receiving Charitable Food Assistance." AEA RCT Registry. AEARCTR-0018620. https://doi.org/10.1257/rct.18620-2.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Seoyoon Ahn* , Christopher Cronin , Craig Gundersen

* Primary investigator

Registry ID
AEARCTR-0018620
DOI
https://doi.org/10.1257/rct.18620-2.0
First registered
Last updated
Status
On going
Trial dates
2026-04-29 – 2027-01-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/18620

Abstract

The Wilson Sheehan Lab for Economic Opportunities (LEO) is partnering with the Houston Food Bank to understand the characteristics, needs, and behaviors of Food Scholarship program participants. The Food Scholarship program provides university students with groceries to help reduce financial strain, alleviate food insecurity, and support academic success. This randomized controlled trial will test whether financial incentives offered to participants for the completion of an end-of-semester survey changes the composition of survey completers. Three groups will receive email and text invitations to complete the online survey. One group (control) will not be offered any financial incentive to complete the survey, while the other two groups (treatment) will be offered $10 and $20, respectively, for completion. We will assess survey nonresponse bias using three complementary approaches. First, we will compare survey completers and non-completers on pre-survey administrative and enrollment characteristics observed for the full eligible sample (e.g., age, gender, monthly income). Second among survey respondents, we will compare self-reported measures that can be validated against administrative data, such as food pantry visits, academic credits, and GPA. Third, also among survey respondents, we will test whether survey-only outcomes such as food insecurity, mental health, and human flourishing differ across incentive arms, which can indicate whether incentives change the observed composition of respondents on outcomes unavailable for nonrespondents.

Intervention

Food for Change (FFC) is an initiative run by Houston Food Bank to help people at-risk of food insecurity find a path towards long-term stability. One of the programs operated through this initiative is the Food Scholarship (FS) program, where Houston Food Bank partners with colleges and universities to provide students with groceries to lower the financial stress of students’ grocery costs. FS distributes up to 30 pounds of groceries per week from FFC markets to students who may be at-risk of food insecurity. By distributing free food to students, the program aims to encourage continued enrollment in higher education and support academic success.

On May 12, 2026 the HFB will contact FS participants via text and email, inviting them to complete an end-of-semester survey by clicking a personalized link that takes the participant to a Qualtrics survey. Participants will be randomized into three groups. One group (control) will not be offered any financial incentive to complete the survey, while the other two groups (treatment) will be offered $10 and $20, respectively, for completion. The research team will then test for survey nonresponse bias by comparing survey completers and non-completers across the three groups along several sets of characteristics. All students are enrolled at one of three college partners with the Houston Food Bank: The University of Houston, The University of Houston Downtown, and Houston City College.

Experimental design

Each of the three participating schools conducted their standard outreach and marketing activities for the Food Scholarship program. This study focuses on students enrolled in the program through April 29, 2026, including a subset of students who participated in a Spring 2026 pilot intervention that utilized text message nudges designed to encourage continued use of campus food pantries.

Participants will be randomized into one control group and two different treatment arms. The control group will not be offered a financial incentive for survey completion, while the two treatment groups will be offered either a $10 or $20 financial incentive for completing the endline survey. The study will assess whether financial incentives for survey completion affect survey response behavior, the composition of survey respondents, and the extent of survey nonresponse bias.

Beginning May 12, 2026, all eligible participants will receive the endline survey via email and text message, with up to three reminder contacts (two text messages and one email). The survey includes questions related to food insecurity, financial well-being, mental health, human flourishing, self-reported academic outcomes (including GPA and credit hours), and experiences using campus food pantry resources. Responses will be collected through May 29, 2026. Survey outreach messages will be identical across groups except that participants assigned to treatment groups will receive additional language describing their financial incentive offer.

Design details

Randomization method
Randomization will occur prior to survey outreach using the roster of all students enrolled in the Food Scholarship program through April 29, 2026. Randomization will be stratified based on three pre-treatment characteristics collected through program enrollment records: (1) monthly income reported at enrollment (measured as high (i.e., above $300, the sample median) / low / missing), (2) completion of an optional baseline survey at enrollment, and (3) whether the participant previously received text message nudges through the pilot intervention in the Spring 2026 semester. The combination of these variables results in 12 distinct strata (3 income levels × 2 baseline survey completion statuses × 2 previous text message receipt statuses). Within each stratum, we assign each participant a randomly generated value between 0 and 1 and sort participants in ascending order. We then assign the first two thirds of the participants in the strata to the control group (No Incentive), the next one sixth to the first treatment arm (Offered $10 incentive), and the remaining one sixth to the latter treatment arm (Offered $20 incentive). When stratum sizes are not divisible by six, treatment counts within strata will be rounded to preserve the target allocation shares as closely as possible. The list of eligible survey participants and their corresponding treatment assignments will be generated prior to survey distribution. Following randomization, balance checks will be conducted across treatment groups using standardized differences in the three variables used to determine strata, as well as other baseline characteristics collected at program enrollment, including university, whether the student was new to the program in the spring of 2026, age, gender, ethnicity, whether the student has a bachelor’s degree, marital status, primary language, income source, and monthly income. Rerandomization will occur if any standardized differences exceed the threshold of 0.1.
Randomization unit
Individual
Clusters
N/A - not clustered; 4,153 individual units of randomization
Observations
The sample covers 4,153 students enrolled at The University of Houston, The University of Houston Downtown, and Houston City College. To be included in the study, students must meet one of two criteria: (i) they enrolled in the FS program during the spring semester (i.e., enrollment occurred between 1/1/2026 and 4/29/2026) – or – (ii) they enrolled in the FS program in a prior semester and visited a campus market during the spring semester (i.e., between the two previously mentioned dates). In other words, we exclude any previously enrolled students who had no interaction with the campus markets during the spring 2026 semester.
Arms
There are two treatment arms and one control group, with the respective sample shares outlined below: Control (No incentive): 2/3 Treatment 1 (Offered $10): 1/6 Treatment 2 (Offered $20): 1/6 The total sample size is 4,153. Of these, 2,769 participants will receive no financial incentive for survey completion, while 692 participants will be offered a $10 incentive and another 692 participants will be offered a $20 incentive.
Primary outcomes
Completion of the end-of-semester survey
Secondary outcomes
Opening the survey by clicking the survey link. Answering at least one survey question.

Cited by

No citation data available for this registration yet.

Keywords