Assessing Critical Thinking: A Structured Approach

How to cite

List, John; Cuna, Michael; Jabarian, Brian; Kattan, Faisal. 2026. "Assessing Critical Thinking: A Structured Approach." AEA RCT Registry. AEARCTR-0019134. https://doi.org/10.1257/rct.19134-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

John List* , Michael Cuna , Brian Jabarian , Faisal Kattan

* Primary investigator

Registry ID
AEARCTR-0019134
DOI
https://doi.org/10.1257/rct.19134-1.0
First registered
Last updated
Status
On going
Trial dates
2026-03-10 – 2027-09-01
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/19134

Abstract

This study evaluates the impact of an augmented critical thinking (CT) curriculum on the development of CT skills among 9th grade students in Saudi Arabia. Saudi Arabia recently introduced a national critical thinking course as part of its Vision 2030 education reforms, aiming to shift students away from rote learning toward analytical, evidence-based reasoning. While the curriculum represents an important policy commitment, little is known about whether it effectively develops students' CT abilities in practice. We ground our work in List's (2022) CT Hierarchy, which defines critical thinking as the ability to reason empirically and abstractly, and recognizes that these skills develop progressively: from intuitive, bias-prone thinking toward more deliberate, reflective reasoning. Building on this framework, we developed a structured CT assessment and an augmented curriculum module for 9th grade that intensifies the existing national course with active learning methods, including logic exercises, claim-evidence-reasoning tasks, and metacognitive reflection. Using a randomized controlled trial across schools in Makkah and the Eastern Province, we measure whether students who receive the augmented curriculum show greater gains in CT scores relative to those receiving the standard curriculum. Our assessment captures performance across four cognitive domains: correlation vs. causation, logical reasoning, mathematical and statistical thinking, and cognitive bias. We also examine variation by gender, and baseline CT level. Results will inform curriculum policy and teacher training at scale, with implications for how CT can be effectively taught within national education systems.

Experimental design

This study uses a school-level randomized controlled trial to evaluate the impact of an augmented critical thinking (CT) curriculum on 9th grade students in Saudi Arabia. Schools in Makkah and the Eastern Province were randomly assigned to either the augmented curriculum (treatment) or the standard national CT curriculum (control). The augmented curriculum is a 4-week module that intensifies the existing national course with active learning methods grounded in List's (2022) CT framework, including logic exercises, claim-evidence-reasoning tasks, and metacognitive reflection. Student CT is measured using a 25-item assessment covering four domains: correlation vs. causation, logical reasoning, math and statistical reasoning, and cognitive bias.

Design details

Randomization method
Stratified randomization with rerandomization. Schools were first stratified on three variables: region, school gender composition, and baseline CT score quartile. Within each stratum, complete random assignment was used, with singletons and remainder units assigned with equal probability. Rerandomization was then applied following Li, Ding, and Rubin (2020), accepting only assignments where the minimum p-value from an F-test of covariate balance across treatment and control exceeded 0.5. The final assignment was selected by computer using R.
Randomization unit
School-level
Clusters
72 schools; 36 per region
Observations
9,128 students
Arms
36 control schools, 36 treatment schools
Primary outcomes
Critical thinking score Critical thinking subscores: cognitive bias, math & stat reasoning, logical thinking, correlation vs. causation
Secondary outcomes
Heterogeneity of treatment effects by gender and baseline CT score

Cited by

No citation data available for this registration yet.

Keywords