Examining Undergraduate Grading Policies and Student Behavior

How to cite

Owen, Stephanie; Lonn, Steve; Zafar, Basit; Stange, Kevin; Jacob, Brian. 2021. "Examining Undergraduate Grading Policies and Student Behavior." AEA RCT Registry. AEARCTR-0007215. https://doi.org/10.1257/rct.7215-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Stephanie Owen* , Steve Lonn , Basit Zafar , Kevin Stange , Brian Jacob

* Primary investigator

Registry ID
AEARCTR-0007215
DOI
https://doi.org/10.1257/rct.7215-1.0
First registered
Last updated
Status
On going
Trial dates
2021-01-08 – 2025-05-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/7215

Abstract

In response to the myriad challenges students are facing due to the COVID-19 pandemic, many universities have modified their academic policies to provide more flexibility for students. During the 2020-2021 academic year, the University of Michigan (UM) adopted a policy that gives students the option to convert letter grades to “Pass” or “No Record Covid” and also to drop courses late in the term without it appearing on their official transcript. This policy should reduce the risk associated with poor course performance and permit students to attempt more challenging courses without fear that it will adversely affect their grades.

We will use this setting to better understand the role that grading systems play in students’ course selection, major choice, and other academic behaviors. Using a survey of UM undergraduates, we will solicit information about students’ beliefs about grades and knowledge of the new and old grading policy. In an experimental intervention embedded within the survey, some students will receive additional information highlighting how the grading policy reduces the risk of taking more difficult and more varied courses. We will combine survey responses with administrative student records to see whether making salient the insurance aspect of the policy changes students’ attitudes towards coursetaking, intended academic behavior, and realized academic decisions.

Intervention

The intervention entails providing students with additional information and context about the University’s grading policies for the Winter 2021 semester. Specifically, the treatment highlights that the new grading policy reduces the risk of bad grades, makes it easier to experiment with more varied classes, and makes it less risky to take more classes. This informational treatment is embedded within a survey that all study participants take, but is shown to only half the respondents.

Experimental design

All currently enrolled undergraduate students at the University of Michigan are eligible to participate in the study. All students who consent to participate will be fielded a survey about their academic plans. Among survey respondents, half will be randomly assigned to treatment and half to control using the Randomizer tool within Qualtrics survey software, which randomizes students to treatment or control at the point in the survey where the intervention text appears.

The intervention entails providing students with additional information and context about the University’s grading policies for the Winter 2021 semester, embedded within the survey. Control students do not receive the additional information.

Design details

Randomization method
Randomization done using the Randomizer tool within Qualtrics survey software.
Randomization unit
Individual
Clusters
We do not have a target sample size in mind. The survey (and therefore the intervention) will be open to all undergraduate students enrolled at the University of Michigan for Winter 2021 (N = approx. 29,000 students). The survey will remain open for two weeks, and all survey respondents will be included in the analysis. The design is individual (student) level, not clustered.
Observations
We do not have a target sample size in mind. The survey (and therefore the intervention) will be open to all undergraduate students enrolled at the University of Michigan for Winter 2021 (N = approx. 29,000 students). The survey will remain open for two weeks, and all survey respondents will be included in the analysis.
Arms
Half of survey respondents will be assigned to control and half to treatment.
Primary outcomes
Survey outcomes: subjective probability of course withdrawal; subjective probability of changing letter grade to “Pass”; intended number of credits (enrolled, completed, and relative to hypothetical policy counterfactual); intended difficulty of courses; intended breadth of courses; intended graduation date. Administrative outcomes: number of credits (enrolled and completed); subjects taken; difficulty of courses taken; course withdrawals; letter grades converted to “Pass” or “No Record Covid”; declared major.
Secondary outcomes
Survey outcomes: concern about grades; concern about dropping classes; intended time use (studying, working, other extracurricular activities)

Cited by

No citation data available for this registration yet.

Keywords