Neuromorphic continual learning made robust to memory faults during training

RobustNCL: Robustifying Neuromorphic Continual Learning under Transient Faults with Lightweight Detect-and-Cure Strategy

Neural and Evolutionary ComputingArtificial IntelligenceMachine Learning

Summary

Continual learning helps computers adapt by learning new information over time, but hardware errors can cause it to perform badly. The authors study neuromorphic continual learning, an energy-saving way to do this type of learning. They propose a system called RobustNCL that detects and fixes errors in memory that stores the model's data. Their method keeps the learning accurate even when errors are frequent, without adding much delay or power use.

What this means in practice

  • For embedded systems engineers: Develop reliable neuromorphic AI devices that continue to learn accurately despite transient memory faults in resource-limited settings.
  • For hardware reliability teams: Implement lightweight fault detection and correction in AI accelerators that use off-chip DRAM for weight storage during continual learning.

Authors

Rachmad Vidya Wicaksana Putra, Shuochen Zhou, Muhammad Shafique

Abstract

In neural networks, continual learning (CL) is a prominent approach for enabling deployed systems to adapt to dynamic operational environments by effectively learning from new unseen data at runtime. Recently, the neuromorphic continual learning (NCL) concept has emerged as an energy-efficient alternative to CL by leveraging sparse event-based operations. However, NCL performance can be undermined by transient faults in the hardware platforms, which may come from high-energy particle strikes at any time. Currently, NCL reliability under transient faults has not been studied, and hence the corresponding fault-tolerance techniques remain unexplored. To address this, we propose a novel RobustNCL framework to improve NCL reliability in the presence of transient faults in the DRAM-based off-chip memory of hardware platforms through a lightweight detect-and-cure strategy. Specifically, it first monitors the presence of faults during weight data access from off-chip memory, and then cures the accessed weights if anomalous signatures are detected. It provides three curing variants: replacement with zero, min/max value, and most-probable value from the original/clean weight distribution. To support this, the weight curing values are stored in the radiation-hardened memory. Experimental results show that, in the presence of high fault rates (e.g., 5x10^{-4} for memory replay), RobustNCL maintains high accuracy close to the accuracy of fault-free models (i.e., within -0.5% accuracy for the best RobustNCL variant) and significantly improves accuracy from the baseline without fault mitigation across different NCL methods and datasets (i.e., Split MNIST, Split Fashion-MNIST, Split CIFAR-10, and Split CIFAR-100), while incurring negligible latency and energy overheads. These results highlight that our RobustNCL framework is a promising approach for enabling reliable and energy-efficient NCL systems.