Papers for

numerical simulation developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Convex equilibrium networks give stable solutions for nonlinear equations

Convex Equilibrium Potentials for Monge--Ampère: Curvature Bounds and A Posteriori Evaluation

Abstract: Equilibrium neural networks define their hidden state as the fixed point of a contraction, so their effective depth is set at evaluation time rather than by the architecture. Using them for fully nonlinear PDEs raises two issues that explicit networks avoid: second derivatives may grow with the effective depth, and the potential is only ever evaluated approximately. We study nonnegative softplus equilibrium networks with contraction factor $q<1$, a convex class suited to the Monge--Ampère equation. A positivity cancellation in the resolvent shows that the Hessian grows at most like $(1-q)^{-2}$, rather than the $(1-q)^{-3}$ of a direct estimate, and an explicit one-neuron family shows that this exponent is sharp; third derivatives satisfy a sharp $(1-q)^{-3}$ bound. Residual-based a posteriori estimates then control the state, its input derivatives and, in two dimensions, the Hessian determinant at an approximate equilibrium. Combined with interval arithmetic on complete covers of the domain, they yield rigorous uniform bounds on the Monge--Ampère residual and, through a comparison argument, on the solution error of a fixed trained network. On two manufactured Dirichlet problems on the unit disk, all six trained models are certified with residual below $0.25$ and boundary error below $0.01$. Adaptive stopping halves float64 evaluation time at best, whereas certified adaptive evaluation remains costlier than fixed depth.

Thu 22 OctMachine Learning
The gist
Solving complex nonlinear equations like the Monge--Ampère equation often requires deep neural networks, but deeper networks can be unstable or hard to evaluate precisely. The authors study a special kind of neural network called a convex equilibrium network, which finds stable fixed points without relying on fixed depth. They prove that the network’s curvature behaves well under certain contraction constraints and provide methods to rigorously check how close approximate solutions are to true solutions. This approach was tested on example problems, successfully certifying accuracy and improving evaluation efficiency.
Open → 2610.31386v1

Low rank approximation certification costs revealed for expanding matrix checks

Information Limits of Low-Rank Approximation Certification

Abstract: Low-rank approximation can require additional matrix--vector products to verify that its error meets a prescribed tolerance. We characterize this certification cost for both relative matrix error and mean-square output error. For a single approximation matrix candidate, we determine the exact dimension-uniform minimax query constant as the allowed failure probability vanishes. Our main result concerns reusing validation responses as the approximation space expands. For a candidate family constructed independently of validation, one batch supports an entire nested path without increasing the query budget with the number of checks. Across \(W\) paths, a concentration bound exploiting shared residual energy yields a \(\sqrt{\log(W+1)}\) dependence. A matching lower bound establishes its optimality for fixed interior error targets and sufficiently small separation gaps. Finally, we compare two uniformly valid certificates on the same dispersed-spectrum family. Optimizing the validation budget within each rule family yields costs of orders \(N^{1/3}\) and \(N^{2/3}\) for validation and construction beyond the true target. Code is available at https://anonymous.4open.science/r/Low-rank-approximation-1275/

Fri 2 OctArtificial IntelligenceInformation Theory
The gist
Low-rank approximation is a method used to simplify large matrices, but checking that this simplification is accurate can be costly. The authors studied how many checks or queries are needed to be confident the simplification error is within acceptable limits. They discovered that you can reuse some checks efficiently as you consider sequences of approximations, reducing the overall cost. Their findings precisely show how the cost scales depending on how many approximation paths are tested and the error levels desired.
Open → 2610.03321v1

Physics-informed method builds adaptive fluid simulations efficiently

Physics-Informed Method of Group Data Handling: Adaptive Construction of Functional Representations with an Application to the Navier-Stokes Equations

Abstract: Physics-informed computational methods usually optimize parameters within a functional representation whose structure is fixed in advance. This work proposes a Physics-Informed Method of Group Data Handling (PI-GMDH), in which representations of coupled physical fields are progressively constructed during solution. Candidate functional directions are evaluated through the first variation of the complete physical and observational objective, introduced in packages, and followed by block-coordinate damped Gauss-Newton coefficient optimization. The framework is demonstrated with tensor-product Chebyshev functions on the incompressible Navier-Stokes equations using a two-dimensional time-dependent Taylor-Green benchmark. Under the tested configuration, adaptive PI-GMDH reached validation and held-out test losses of 5.299e-19 and 5.296e-19 with 204, 201, and 175 active functions for u, v, and p. Complete degree-by-degree and all-terms PI-GMDH variants, together with selected PINN and KAN reference configurations, are used to examine the effect of structural construction policy. The results show that, for this controlled synthetic benchmark, selective progressive construction can provide a favorable combination of accuracy, representation size, and wall-clock time. The comparison is illustrative rather than a claim of universal superiority over alternative physics-informed approaches.

Wed 30 SeptMachine Learning
The gist
Simulating complex fluid flows often requires choosing a fixed mathematical form in advance, which can limit accuracy or efficiency. The authors propose a new method that gradually builds these mathematical models by adding pieces selectively as the simulation proceeds. They tested this approach on a fluid flow problem described by the Navier-Stokes equations and found it could achieve very low errors while using a manageable number of mathematical functions. This method balances precision, model size, and computation time better than some other approaches in this controlled test.
Open → 2609.39291v1