Physics-informed reinforcement learning improves battery safety in power grids
Physics-Informed Graph-Based Safe RL with Constraint-Specific Critics for Community Battery Coordination in Distribution Network
Artificial Intelligence
Summary
Managing power grids is harder when many homes use solar panels and electric cars, because this can cause unsafe voltages and overloaded power lines. The authors developed a new computer approach that uses physics knowledge and smart learning to control community batteries and keep the power system safe and affordable. Their method watches the network with a special graph model that respects real power flows and uses separate safety checks for different types of problems. In tests, this approach greatly reduced voltage problems and line overloading while keeping costs low.
What this means in practice
- •For utility grid operators: Control community batteries in distribution networks to reduce voltage and line violations while maintaining low operating costs under high solar and electric vehicle use.
- •For power system software developers: Integrate physics-informed graph models and constraint-specific critics in reinforcement learning tools to enhance safe coordination of energy storage systems.
Authors
Chenghao Huang, Yue Yang, Hao Wang
Abstract
High penetrations of distributed energy resources (DERs) and fast-varying electric vehicle (EV) charging intensify voltage and line-limit violations in distribution networks (DNs), making safe, low-cost operation increasingly challenging. This paper proposes a physics-informed safe deep reinforcement learning (DRL) framework for coordinating community battery energy storage systems to mitigate constraint violations while minimizing operating cost. To represent nonlocal spatiotemporal interactions, we develop a dual-level physics-informed graph representation in which line impedance and capacity shape spatial information propagation, while power-balance, voltage-profile, and flow-reconstruction losses regularize the latent state toward control-relevant physical consistency. Building on this representation, we develop Lagrangian Dedicated-Critic PPO (LDCPPO), which implements constraint-specific value decomposition: independent reward and cost critics preserve heterogeneous voltage- and line-loading-related learning signals and combine their advantages only during the Lagrangian policy update. Case studies on DNs with high rooftop photovoltaic penetration and EV charging demonstrate that the proposed method reduces the key voltage-violation degree by up to 80.5% compared with the tested baselines, while also achieving the lowest voltage-violation count and line-overload degree with competitive operating cost.