Onboard detection of unusual marine activity improves space observation
Onboard Marine Anomaly Detection on $Φ$sat-2: From Simulation-Based Development to In-Orbit Demonstration
Artificial IntelligenceComputer Vision and Pattern Recognition
Summary
Satellites that watch the Earth can work better if they can spot unusual things happening in the ocean themselves, without sending everything back to Earth first. The authors describe how they built and tested a lightweight system on a European satellite to detect strange marine events like unusual water patterns. Before launch, they trained their system on simulated satellite images, but after launch, they found the real images were different and had to retrain the system with real data to improve accuracy. This work shows that building space AI needs careful preparation with real data and smart design to work well in orbit.
What this means in practice
- •For satellite operators: Detect marine anomalies directly on board satellites to reduce data transmission and improve responsiveness.
- •For environmental monitoring teams: Enhance early detection of unusual ocean events by using space-based systems capable of onboard data processing.
Authors
Clotilde Szywala, Thomas Goudemant, Marjorie Bellizzi, Benjamin Francesconi, Adrien Girard
Abstract
Onboard Artificial Intelligence can improve responsiveness and bandwidth efficiency of Earth Observation systems by processing data directly on the satellite. This paper presents the experience gained from the development, onboard integration, and post-launch adaptation of a lightweight marine anomaly detection pipeline deployed on the European Space Agency's $Φ$sat-2 mission. The application combines sea segmentation, self-supervised feature encoding of marine regions, generic anomaly detection based on deviations from a normal sea state, and optional characterization of selected anomaly types. Before launch, the pipeline was trained and validated on simulated $Φ$sat-2 imagery to assess algorithmic performance and compatibility with resource-constrained onboard hardware. After integration and functional validation in the mission environment, early experiments on real $Φ$sat-2 acquisitions revealed a significant mismatch between simulated and in-orbit data. The pipeline was therefore retrained on real Level-1 imagery using an improved annotation strategy to better handle ambiguous marine regions, substantially enhancing performance. Beyond demonstrating the onboard feasibility of the application, the $Φ$sat-2 experience highlights the importance of robust annotation strategies and sensor-aware design, and shows that simulation-based development is valuable for pre-flight risk reduction, while reliable scientific validation requires representative in-orbit data and should be clearly distinguished from functional validation.