NEXTlearn - New strategies for digital learning and assessment

How to cite

Steinmayr, Andreas. 2025. "NEXTlearn - New strategies for digital learning and assessment." AEA RCT Registry. AEARCTR-0016760. https://doi.org/10.1257/rct.16760-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Andreas Steinmayr*

* Primary investigator

Registry ID
AEARCTR-0016760
DOI
https://doi.org/10.1257/rct.16760-1.0
First registered
Last updated
Status
In development
Trial dates
2025-10-02 – 2026-03-31
Countries
Private
JEL codes
I21, I23
Registry record
http://www.socialscienceregistry.org/trials/16760

Abstract

The NEXTlearn project is a randomized controlled trial to improve learning outcomes in introductory courses for first-year undergraduate students. The intervention provides targeted learning support designed to enhance study habits, motivation, and self-control while fostering student engagement with course materials. The evaluation uses a baseline survey administered in the first lecture session and follow-up surveys throughout the semester. Survey measures include expected study time allocation across activities (lectures, problem sets, textbook learning, group study), learning strategies, interest in economics, subjective understanding of course material, and non-cognitive skills such as self-control. Baseline data are linked to administrative records on course participation and performance, conditional on student consent. The study aims to identify the causal impact of the intervention on academic effort, engagement, and achievement, contributing to the literature on economics of education and teaching innovation in higher education.

Intervention

All students attend the same lecture and take the same lecture exam. The content of the
discussion sections is identical. The difference lies solely in how the sections are organized.

• Treatment condition: NEXTlearn format: students receive access to digital take-
home quizzes that include both assignments to be discussed in class and additional
exercises, which are automatically graded. These take-home exercises can be repeated
multiple times during the week for practice. They are graded but contribute only
marginally to the overall grade. In the discussion sections, students discuss their solu-
tions in groups and with the instructor. At the end of each session, a short (15-minute),
paper-based exam on the previous week’s content is administered. The discussion sec-
tion grade is primarily based on these short tests, with minor contributions from the
take-home quizzes.

• Control condition: Traditional course structure: students receive PDFs with as-
signments to be solved before the respective session, but assignments are not graded.
The solutions are discussed in class. The assignments are not graded. The discussion
section grade is based on a midterm and end-of-term exam.

Experimental design

Discussion sections - grouped by instructors - are randomly divided into a control and a treatment group. Students enroll in a discussion section using the regular enrollment process. The treatment condition is revealed only after enrollment is completed.

Design details

Randomization method
We randomized at the discussion section-instructor level using complete enumeration of all possible assignments. We applied pre-specified constraints on seminar types and instructor pairings, calculated a balance score for time slots, and retained only assignments meeting all constraints and achieving optimal balance. One final assignment was randomly drawn from this restricted set. All assignments, balance scores, and the final draw were archived for full replicability.
Randomization unit
Instructors for discussion sections
Clusters
12 instructors, 27 discussion sections
Observations
700 students
Arms
About 50% in each treatment arm.
Primary outcomes
• Exam participation at the first sitting • Passing exam at the first sitting (unconditional) • Exam score at the first sitting (conditional on participation) • Interest in economic topics (anticipated probability of taking a voluntary economic class in the future) • Engagement score (survey-based)
Secondary outcomes
Differentiation of exam scores by question type: – Calculation tasks – Factual knowledge – Conceptual understanding • Interest in economic topics in general (overall, components) • Supportiveness of the course for a) exam preparation and b) general understanding of economics • Time use for all introductory modules (economics, mathematics, business) • Enrollment in subsequent economics courses Mechanisms: Attendance in discussion sessions (number of sessions attended) • Perceived usefulness of study materials • Time use related to the economics course (weekly hours across main learning activities) • Study behaviors and learning strategies • Exam preparation and attitudes before the first sitting (intention to participate, time investment, preparedness, confidence, stress)

Cited by

No citation data available for this registration yet.

Keywords