Cognitive Profiling of LRMs' Reasoning Traces Using Bloom's Taxonomy

2026-08-24Artificial Intelligence

Artificial IntelligenceComputation and Language
AI summary

The authors studied how large reasoning models (LRMs) think step-by-step when solving problems by organizing these steps into different types of thinking based on Bloom's Taxonomy, such as remembering or evaluating. They created a system to automatically label each reasoning step with these thinking types and analyzed large amounts of data from different models and tasks. Their work showed patterns in how models think and found connections between certain thinking types and correct answers. This helps better understand and improve the reasoning abilities of these models.

Large Reasoning ModelsBloom's TaxonomyReasoning StepsCognitive LevelsAutomatic AnnotationModel BehaviorReasoning PatternsCorrectness Correlation
Authors
Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos
Abstract
Large Reasoning Models (LRMs) have revolutionized reasoning in LLMs, and the increasing public availability of reasoning traces creates valuable opportunities to study model behavior not only at the surface level but also at the granularity of individual reasoning steps. However, understanding the types of thinking employed during reasoning - which offers critical insights into models' reasoning patterns and enables actionable applications - remains underexplored. To address this gap, we introduce a framework for automatic annotation of reasoning steps through the lens of Bloom's Taxonomy, which classifies thinking into six cognitive levels, such as Remembering, Applying and Evaluating. Using this framework, we perform a large-scale analysis across models and datasets, revealing both similarities and differences in thinking patterns across models and tasks. Moreover, we demonstrate that thinking-type information derived from reasoning traces correlates with correctness, paving the way for improved reasoning. Our findings establish a fine-grained framework for analyzing thinking patterns in LRMs and provide actionable insights for enhancing reasoning quality.