Federated learning adapts channels for better edge device accuracy
FedSAP: Federated Learning with Structured Adaptive Partitioning for Multi-Domain Heterogeneous Edge Devices
Machine Learning
Summary
Many devices that learn from data have different abilities and unique local information, which makes training a shared model tricky. The authors propose FedSAP, a method that decides how much each part of a model is kept or shared across devices based on what is useful globally or only for some device groups. This way, widely useful knowledge is shared, while device-specific details stay separated, improving overall accuracy. They tested this on image recognition tasks and saw better results even with heavily pruned models on uneven devices.
What this means in practice
- •For edge device engineers: Optimize training of shared models across resource-limited and varied edge devices by selectively pruning and sharing model parts based on domain similarity.
- •For mobile app developers: Improve on-device machine learning by balancing model size and accuracy when users have diverse environments and device capabilities.
Authors
Wentao Yue, Tianyou Lai, Hongji Li, Qingyu Mao, Qilei Li
Abstract
Federated learning (FL) on heterogeneous edge devices must jointly accommodate unequal resource budgets and domain-shifted local data. Existing resource-adaptive methods decide how much of a model each client trains but not where retained capacity should reside or how it should be shared, whereas federated domain-generalization methods usually assume a shared full architecture. Uniform compression can therefore discard high-utility channels, and a single aggregation path can mix transferable features with domain-sensitive updates. We propose FedSAP, a domain-aware heterogeneous FL framework that casts structured pruning as budget-constrained tri-state channel allocation. FedSAP converts each keep ratio into non-uniform layer budgets, assigns stable channels to a Global pool, useful domain-sensitive channels to pseudo-domain-specific Private pools, and low-utility channels to a Dropped state. This partition lets broadly useful features benefit from cross-client pooling while isolating domain-sensitive updates from incompatible clients. Domain-Guided Assignment infers pseudo-domains from shallow-gradient similarity, while Type-Matched Aggregation restricts each channel to its intended sharing scope. Across three random seeds, FedSAP reaches 76.00% and 72.67% mean global accuracy on Digits and Office-Caltech, exceeding the strongest baseline by 1.70 and 4.92 percentage points while supporting client pruning ratios of up to 80% across heterogeneous clients.