Functional task networks improve learning without forgetting in neural nets

Autonomous Continual Learning and Knowledge Transfer via Cortex-Inspired Neural Assemblies

Machine Learning

Summary

Artificial neural networks often forget old skills when learning new ones, unlike the human brain. The authors created Functional Task Networks (FTNs), inspired by the brain's neocortex, to help networks remember previous tasks while learning new ones. FTNs organize small subnetworks that can overlap for related tasks and separate for unrelated ones, improving memory and knowledge transfer. This method helps networks adapt better to changing tasks without needing large balanced datasets all the time.

What this means in practice

Authors

Kevin L. McKee

Abstract

Unlike the brain, artificial neural networks (ANNs) suffer from "catastrophic forgetting": complete overwriting of solutions when re-training on new functions ("concept shift") or on a disjoint domain of the current function ("domain shift"). ANNs require each batch of data to be roughly representative of the complete distribution, a typically expensive and impractical requirement. In this paper, we introduce Functional Task Networks (FTNs), a method of continual learning and knowledge transfer modeled after several properties of the mammalian neocortex. FTN is formulated as a distributed, stochastic mixture of experts in which a sparse, binary routing mask is computed at inference time using a small support sample of input-output pairs. Per-batch reconfiguration of the router during training, together with mask-overlap-filtered replay, shapes a basis of overlapping, partially trained subnetworks. Unrelated tasks route through mostly separate assemblies, related tasks overlap on shared components. On block-sequentially trained continual learning and knowledge transfer tasks FTN retains solutions nearly as well as disjoint-mask isolation and attains the lowest pre-update head-start loss among matched-architecture comparators. The learned mask-overlap geometry tracks the known concept-sharing structure where available. We show experimentally that under correlated concept shift, support-set mask reconfiguration is necessary even for retention. Under domain shift, the distributed bank with replay is sufficient to handle retention without the configurer. Forward transfer, or head-start, and backward transfer, are also contributed by support-set mask configuration.