Papers for

educational data analysts

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Human learning model parameters recoverable only with designed practice data

Identifiability of a dissipative knowledge-dynamics model: exact recovery under designed excitation, degeneration on observational data

Abstract: Human learning is a dissipative dynamical process: mastery accumulates through practice, decays through forgetting, and propagates across interdependent concepts. We model it as a nonlinear dissipative system of ordinary differential equations whose parameters are mechanistically meaningful (a concept-transfer matrix encoding prerequisite coupling, per-concept forgetting rates, and a saturating practice-response gain), and we study when those parameters can actually be recovered from data. We prove a structural identifiability theorem for the associated inverse problem under explicit excitation conditions, with constructive closed-form recovery for the two-concept case, together with monotonicity, robustness and L-stability results. We derive a semi-implicit L-stable scheme for the dissipative subsystem and a batched solver numerically equivalent to the per-trajectory formulation (bit-exact predictions, gradients to $10^{-10}$) yet two orders of magnitude faster, making estimation feasible on cohorts of $10^5$ learners. The empirical study is two-sided. Under the theorem's excitation conditions, synthetic recovery is exact: parameters to machine precision, prerequisite structure at $F_1 = 1.0$. On large observational benchmarks it is not. An apparently strong recovery, with forgetting rates correlating with topic difficulty at Spearman $ρ= 0.83$, is refuted by four independent controls: it survives destroying the temporal order of the data, is matched by a classical Bayesian baseline, and is unaffected by removing real timestamps. We trace this to the stationary structure of the model and show that it is the degeneration the theorem predicts in the absence of designed excitation. The result delineates a sharp boundary between identifiable and unidentifiable regimes and yields a validation protocol for interpretability claims.

Wed 7 OctMachine Learning
The gist
Learning can be thought of as a process where knowledge builds up, fades, and spreads between related ideas. The authors created a math model that tries to capture this process and studied when you can figure out the model’s settings just by looking at learning data. They found that if the learning experiences are carefully planned, you can exactly recover these settings. But with ordinary, real-world data, you can’t reliably find them, meaning some results about learning difficulty might be misleading. This shows when a learning model is trustworthy and when it isn’t.
Open → 2610.09889v1

Topological data analysis reveals key intervention windows in learning behavior

Period Segmentation in Transition Network Analysis: A Topological Data Analysis Approach

Abstract: Temporal dynamics in learning behavior can be revealed through period segmentation in Transition Network Analysis (TNA). Cristea et al. demonstrated that segmenting courses into halves and quarters reveals how learning strategies evolve and relate to academic performance. Building on this approach, we investigate whether Topological Data Analysis (TDA), specifically connected components ($β_0$) change points from Zigzag Persistent Homology, can provide data-driven period boundaries that identify intervention windows. Analyzing 22 courses from the Open University Learning Analytics Dataset, we find that $β_0$-based segmentation captures greater between-period variation than time-based segmentation (median variance ratio (VR) = 4.10$\times$; 21/22 courses show VR $>$ 1.1). Permutation tests confirmed significance ($p < 0.05$) in 18% of individual courses, with 73% showing positive improvement over random breakpoints. Only one course showed better performance with time-based segmentation. However, analysis of academic outcomes reveals a key insight: final-period behavior shows lower correlation with outcomes in $β_0$-based segmentation than in time-based segmentation, reflecting a marked behavioral collapse where engaged learners rapidly disengage. We interpret this as evidence that final-period behavior reflects rather than causes outcomes: students who will pass maintain engagement, while those who will fail disengage. This reframes the value of $β_0$: rather than improving prediction, change points identify intervention windows. These are periods where behavioral structure shifts and targeted support may be most effective.

Fri 25 SeptComputers and SocietyMachine Learning
The gist
Learning behavior changes over time during a course, but finding exactly when these changes happen can be tricky. The authors used a math tool called topological data analysis to spot moments when student behavior shifts strongly. These change points mark the best times to offer extra help to students, rather than just splitting courses by time periods. They also found that the way students act near the end of a course reflects their likely success rather than predicting it.
Open → 2609.32094v1