The Theoretical Foundation of Socratic Tests: Dynamic, Multimodal, Conversational Examinations
2026-07-31 • Computers and Society
Computers and SocietyArtificial IntelligenceHuman-Computer Interaction
AI summaryⓘ
The authors explain a new way to test students called the Socratic Test, which uses a computer to have a conversation instead of a traditional written or oral exam. This test helps understand what a student can learn next by giving hints and guiding questions based on Dynamic Assessment methods. It also uses educational tools like Bloom's and SOLO Taxonomies to check how well students understand material step-by-step. Their scoring system focuses on rewarding mastery and growth instead of just counting mistakes, aiming for fairer and more reliable results.
Static AssessmentDynamic AssessmentSocratic TestZone of Proximal DevelopmentBloom's TaxonomySOLO TaxonomyGraduated ScaffoldingNon-compensatory GradingHuman-AI Alignment
Authors
Ilya Mikhelson
Abstract
Traditional static assessments rely on a subtractive, deficit-based grading model that often penalizes ambition and obscures diagnostic feedback. Conversely, traditional face-to-face oral examinations introduce severe construct-irrelevant variance by exacerbating performative anxiety and the sociological power imbalances inherent to academic hierarchies. This paper presents the theoretical foundation for the "Socratic Test," an automated, computer-mediated conversational assessment. By integrating Dynamic Assessment principles, multimodal workspaces, Bloom's Taxonomy for real-time proctoring, and the SOLO Taxonomy for structural evaluation, the Socratic Test actively maps a student's cognitive boundaries. This paper formalizes the use of graduated scaffolding to quantify the Zone of Proximal Development (ZPD) and details a non-compensatory, additive grading architecture that prioritizes mastery over penalty and human-AI alignment to ensure unprecedented measurement reliability.