Papers for
educational data analysts
Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.
Human learning model parameters recoverable only with designed practice data
Identifiability of a dissipative knowledge-dynamics model: exact recovery under designed excitation, degeneration on observational data
Abstract: Human learning is a dissipative dynamical process: mastery accumulates through practice, decays through forgetting, and propagates across interdependent concepts. We model it as a nonlinear dissipative system of ordinary differential equations whose parameters are mechanistically meaningful (a concept-transfer matrix encoding prerequisite coupling, per-concept forgetting rates, and a saturating practice-response gain), and we study when those parameters can actually be recovered from data. We prove a structural identifiability theorem for the associated inverse problem under explicit excitation conditions, with constructive closed-form recovery for the two-concept case, together with monotonicity, robustness and L-stability results. We derive a semi-implicit L-stable scheme for the dissipative subsystem and a batched solver numerically equivalent to the per-trajectory formulation (bit-exact predictions, gradients to $10^{-10}$) yet two orders of magnitude faster, making estimation feasible on cohorts of $10^5$ learners. The empirical study is two-sided. Under the theorem's excitation conditions, synthetic recovery is exact: parameters to machine precision, prerequisite structure at $F_1 = 1.0$. On large observational benchmarks it is not. An apparently strong recovery, with forgetting rates correlating with topic difficulty at Spearman $ρ= 0.83$, is refuted by four independent controls: it survives destroying the temporal order of the data, is matched by a classical Bayesian baseline, and is unaffected by removing real timestamps. We trace this to the stationary structure of the model and show that it is the degeneration the theorem predicts in the absence of designed excitation. The result delineates a sharp boundary between identifiable and unidentifiable regimes and yields a validation protocol for interpretability claims.
Topological data analysis reveals key intervention windows in learning behavior
Period Segmentation in Transition Network Analysis: A Topological Data Analysis Approach
Abstract: Temporal dynamics in learning behavior can be revealed through period segmentation in Transition Network Analysis (TNA). Cristea et al. demonstrated that segmenting courses into halves and quarters reveals how learning strategies evolve and relate to academic performance. Building on this approach, we investigate whether Topological Data Analysis (TDA), specifically connected components ($β_0$) change points from Zigzag Persistent Homology, can provide data-driven period boundaries that identify intervention windows. Analyzing 22 courses from the Open University Learning Analytics Dataset, we find that $β_0$-based segmentation captures greater between-period variation than time-based segmentation (median variance ratio (VR) = 4.10$\times$; 21/22 courses show VR $>$ 1.1). Permutation tests confirmed significance ($p < 0.05$) in 18% of individual courses, with 73% showing positive improvement over random breakpoints. Only one course showed better performance with time-based segmentation. However, analysis of academic outcomes reveals a key insight: final-period behavior shows lower correlation with outcomes in $β_0$-based segmentation than in time-based segmentation, reflecting a marked behavioral collapse where engaged learners rapidly disengage. We interpret this as evidence that final-period behavior reflects rather than causes outcomes: students who will pass maintain engagement, while those who will fail disengage. This reframes the value of $β_0$: rather than improving prediction, change points identify intervention windows. These are periods where behavioral structure shifts and targeted support may be most effective.