Beyond Moving Pictures: The Added Value of Interactivity in Learning Economics

How to cite

Balbeid, Luthfi Bin Muhsin. 2026. "Beyond Moving Pictures: The Added Value of Interactivity in Learning Economics." AEA RCT Registry. AEARCTR-0018224. https://doi.org/10.1257/rct.18224-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Luthfi Bin Muhsin Balbeid*

* Primary investigator

Registry ID
AEARCTR-0018224
DOI
https://doi.org/10.1257/rct.18224-1.0
First registered
Last updated
Status
On going
Trial dates
2026-02-24 – 2026-11-06
Countries
Private
JEL codes
A22, I23, C93
Registry record
http://www.socialscienceregistry.org/trials/18224

Abstract

This study examines how different types of digital learning tools affect students’ understanding of introductory economics. In many courses, students learn using videos that show economic graphs and concepts. Newer tools allow students to interact with these graphs directly by adjusting values and seeing how outcomes change. However, it is not yet clear whether this interactivity improves learning or whether watching the same content in video form is equally effective.

The goal of the study is to determine whether interactive learning tools improve student outcomes compared with traditional video resources, and whether encouraging students to use these tools leads to greater engagement and performance. The findings may help inform how digital resources are designed and used in economics education

Intervention

Students in an introductory microeconomics course at a large public university in Australia are offered supplementary online materials that present the same economic content in two formats: an interactive version where students change parameters and see graphs update, and a video version showing the same graphs and scenarios without student control. Content is held constant across formats. Materials are released in step with teaching across the semester. Students are also randomised so that some receive standard weekly course communications and others receive communications that more prominently direct them to their assigned version of the tool. All students retain access to their assigned format for the semester; nothing is withheld for experimental purposes. A general announcement on the learning platform early in the semester ensures everyone can find the resource

Experimental design

Randomised field experiment in a large credit-bearing introductory microeconomics unit at a public university in Australia, conducted over two semesters (Semester 1 and Semester 2, 2026). Each student is randomly assigned to an interactive versus a video format and, independently, to an encouraged versus a standard messaging about the tool, yielding four groups. Assignment is stratified by teaching group (workshop). Randomisation is performed by computer in Stata on the weekend at the end of Week 2, after the deadline for withdrawing without academic penalty, so the assigned roster aligns with students who remain enrolled at that census point; assignments are then fixed for the remainder of each semester. The same design, timing structure, and procedures are implemented independently in each semester.

The supplementary tool and the weekly encouragement contrast begin from Week 3 (see intervention text). The main analysis compares outcomes by assigned format (intention to treat), regardless of actual use. Encouragement is also used, as pre-specified, to study how usage relates to outcomes for students whose use is shifted by the messages. Pre-specified heterogeneity includes prior mathematical preparation and gender where administrative data allow.

Design details

Randomization method
Randomisation done by computer using Stata on the weekend of Week 2 (since this is after the last date to withdraw without penalties), with stratification by workshop group.
Randomization unit
Individual students. Each student receives two independent random assignments: format (interactive or video) and encouragement (encouraged or control). Workshop groups are strata, not the unit of assignment.
Clusters
N/A
Observations
Approximately 1,800 to 2,200 students enrolled across the two semesters (consistent with recent cohorts).
Arms
Four factorial cells from independent randomisation of format (interactive vs video, roughly 50/50) and encouragement (encouraged vs control, roughly 50/50). Intended allocation: about one quarter of the analysis sample per cell (e.g. roughly 450–550 students per cell if total N is about 1,800–2,200), subject to realised enrolment and the Week 2 sample definition.
Primary outcomes
Official in-class test scores and the final examination score, each from university course records, were analysed on each assessment’s recorded scale.
Secondary outcomes
Engagement with the online materials, summarised from automated usage data: for example, time spent, frequency of use, breadth of topics accessed, and simple interaction or playback measures for each format. These support the interpretation of mechanisms and uptake; learning is judged on the administrative assessments listed as primary outcomes.

Cited by

No citation data available for this registration yet.

Keywords