Classifier adapts to changing data and new categories in streams

Open-world Reconstruction-based Classifier with Concept Drift Adaptation

Machine Learning

Summary

Data that changes over time, like images or sensor info, can confuse computers trying to recognize patterns. The authors developed a method that detects when new kinds of data appear and learns to recognize them, while also adjusting when the known data changes. Their system uses special neural networks called autoencoders to spot these changes and adapts continuously. Tests show it works well compared to other leading methods, especially when the data shifts or new categories show up.

What this means in practice

Authors

Joanna Komorniczak

Abstract

Data stream processing has become central to modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by recognition methods. Adapting to concept drifts while also being able to detect novel classes and distinguish groups of unknown observations can be seen as a step towards effective method employment in an open-world setting. This work proposes a classification method that can detect and learn the distributions of new, unknown classes, as well as adapt to concept drifts once the distribution of known classes shifts. The proposed method uses the autoencoders' reconstruction errors and the KDE that models their distribution. The autoencoders incrementally adapt to the changing distributions of known classes via weight fine-tuning, resulting in continuous adjustment to evolving concepts. Conducted experiments used a diverse set of synthetic data streams, embeddings of a real-world static CIFAR dataset arranged into a stream to simulate concept drifts and the emergence of unknowns, as well as real-world datasets where novelty is observed. The methodology was compared with state-of-the-art approaches with three-criterion recognition quality assessment and resource consumption evaluation. The results indicate that the proposed method is competitive with reference approaches in stationary environments and performs best when concept drifts occur.