Papers for

aerospace system developers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Model-based reinforcement learning improves flow controller design efficiency

Audited Gradients, Anchored Policies: Model-Based Reinforcement Learning for Efficient Flow Control

Abstract: Feedback controllers for flows are expensive to design, since each candidate must be evaluated with a high-fidelity solver. Differentiable surrogates reduce that cost, but they also introduce a failure mode that prediction error cannot detect. Policy optimization uses the derivative of the objective with respect to the action, which we call the action gradient and which can be computed either through the surrogate or through the high-fidelity solver. Optimization through the surrogate uses only its action gradient, and a surrogate can follow the flow trajectory closely while misestimating this derivative. The surrogate action gradient is compared against a central finite-difference estimate from the high-fidelity solver on held-out states, under acceptance criteria fixed before the comparison, and we call that comparison an audit. A low-dimensional feedback law is then fitted to the surrogate action gradient when the surrogate passes the audit, and to the solver estimate when it does not. This law initializes a neural policy, and a quadratic penalty holds the policy near it during optimization. The proposed approach is validated on four test cases. The resulting controllers outperform or match a model-free baseline, while using 3 to 156 times fewer high-fidelity solver interactions across the four test cases. One surrogate predicts the objective at correlation 0.9996 but its action gradient at only 0.459, so prediction accuracy does not identify a usable surrogate. Another surrogate, whose action gradient agrees with the solver estimate at correlation 0.996, makes the objective 0.52% worse when the policy is optimized through it without the anchor penalty, so an accurate gradient alone does not provide a working controller. Finally, a surrogate that passes the audit at one fixed action fails it around the actions the deployed controller applies, so a pass is local.

Mon 9 NovMachine Learning
The gist
Designing feedback controllers for flow control is costly because each option needs testing with detailed simulations. The authors introduce a way to check if a cheaper, approximate model’s information about how changes affect outcomes is reliable. If the model passes this check, they trust it to help find a good control strategy, otherwise they rely on the accurate but expensive simulation. This method leads to effective controllers using far fewer expensive simulations than traditional methods. They show that having a good prediction doesn't always mean the model can guide improvement, and that checks must be specific to where the controller acts.
Open → 2611.13203v1

Neural network observer trains faster with provable stability guarantees

Learning Provable Neural Network Observer for Uncertain Dynamical Systems

Abstract: In many safety-critical applications, control of uncertain dynamical systems relies on observers that estimate states and external disturbances. Neural network observers can improve estimation accuracy, but certifying their Lyapunov stability via Linear Matrix Inequality (LMI) constraints leads to large-scale semidefinite programs (SDPs) that are difficult to solve for large networks. To overcome this scalability bottleneck, we propose a novel two-stage training framework for provably stable neural network observers. Our approach decouples the optimization into a point-guided Lyapunov pre-training phase, which rapidly achieves high estimation accuracy and local stability over sampled states, followed by an LMI fine-tuning phase that efficiently satisfies a strict global Lyapunov stability certificate. We provide formal theoretical guarantees for local stability radii and probabilistic coverage over a prescribed compact error-state domain under specified regularity and sampling assumptions. Experiments on nonlinear control benchmarks and X-29 aircraft ablations show that our LMI-certified neural network observers train significantly faster than direct LMI-based methods and generalize robustly across diverse systems, achieving improved tracking accuracy over a range of observer baselines. The code is available at https://github.com/Berry-Myon/LearningNeuralNetworkObserver.

Fri 25 SeptMachine Learning
The gist
Controlling systems that change over time and face uncertainties requires ways to estimate current states accurately. The authors developed a new two-step training method for neural networks that observe and estimate these states more reliably and faster than before. Their approach first quickly learns to estimate well in specific cases, then fine-tunes to ensure the system remains stable overall. They prove that their method guarantees stability within a certain range and demonstrate better accuracy on various control tasks including aircraft models.
Open → 2609.30819v1