Papers for

industrial equipment suppliers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Offline rl selects faulted lines accurately in simulated power grids

Offline Reinforcement Learning for Distribution-Grid Protection

Abstract: Data-driven protection may complement conventional relays in distribution grids whose operating conditions vary with distributed generation, switching events, and changing short-circuit levels. We study line-selective tripping from static trajectories of a realistically simulated CIGRE medium-voltage network using offline reinforcement learning. A convolutional Q-network receives causal voltage-current phasor and apparent-impedance features, optionally together with raw waveforms, and is trained with conservative Q-learning (CQL). A controlled sensitivity study evaluates two observation windows, reward variants, and three CQL weights under a common split and training protocol; one exploratory post-hoc run additionally increases the discount factor from $γ$=0.95 to 0.99. On 225 held-out episodes, the best per-timestep result is obtained with combined input and CQL weight $α$=0.9, reaching precision 0.9993, recall 0.9496, and F1-score 0.9738. Because dense per-timestep scores do not encode the terminal semantics of relay operation, we also evaluate the first non-wait action in each episode. The default combined-input agent selects the correct line-trip action first in 98.13% of 214 fault episodes, but trips in 72.73% of the 11 non-fault episodes. In the post-hoc run, the corresponding rates are 98.60% and 54.55%, respectively. The results show that dense predictive performance and terminal protection behavior can lead to different model rankings. Offline CQL therefore demonstrates strong faulted-line selection on the simulated fault episodes, while the static trajectories, small non-fault set, and single-seed post-hoc design preclude conclusions about practical relay security or deployment readiness.

Mon 21 SeptMachine Learning
The gist
Protecting electrical lines in power distribution networks is tricky because conditions change a lot. The authors tested a method called offline reinforcement learning to identify and isolate faulty lines using simulated data. Their system analyzes electrical signals to decide which line to trip, achieving high accuracy in test scenarios. However, the study was done under limited conditions and more work is needed to confirm how well this would work in the real world.
Open → 2609.24703v1