Backend
From Last-Layer to Cross-Layer: One-Shot Joint Classifier Reconstruction for Federated Learning
arXiv cs.DC0 views
arXiv:2610.26953v1 Announce Type: new Abstract: Federated learning (FL) enables collaborative model training while preserving data privacy. However, non-independent and identically distributed (non-IID) data inevitably introduces classifier bias, leading to significant performance degradation. Existing studies primarily focus on calibrating or reconstructing the classifier after FL training to alleviate this bias. We find that the last-layer representations of the global model are often suboptimal for establishing a global decision boundary. Instead, classifiers constructed based on intermediate-layer representations can achieve superior performance. This finding provides a critical insight into overcoming the performance bottleneck inherent in existing paradigms. Nevertheless, identifying the optimal layer without auxiliary datasets or prior knowledge remains a formidable challenge. In this paper, we propose FLARE (Federated Cross-Layer Joint ClAssifier REconstruction) which rethinks classifier reconstruction from a cross-layer perspective and generalizes ridge regression to jointly exploit cross-layer representations, thereby surpassing the performance of any individual layer. Specifically, after FL training, clients perform only a single forward pass to extract class-conditional statistics from predefined layers. The server aggregates these statistics to construct a joint cross-layer ridge classifier, where an adaptive coupling coefficient regulates cross-layer correlations, thereby facilitating the integration of complementary discriminative information. Extensive experiments across 11 datasets, 8 model architectures, and diverse data heterogeneity scenarios demonstrate that FLARE, as a plug-and-play post-processing method, improves accuracy by 11.35% with only one additional communication round.
Source:https://arxiv.org/abs/2610.26953PreviousUniAVC: Unified Audio-Video Creation via Progressive Training and Asymmetric SchedulingNextConstrained Federated Reinforcement Learning for Secure Offloading in Vehicular Edge Computing
Related posts
SV-WAM: An Efficient Surround-View World-Action Model for End-to-End Autonomous Driving
0arXiv cs.RO
LOGIV: Graph-Verified Execution with Causal Local Repair for Long-Horizon Robot Tasks
0arXiv cs.RO
Staff Augmentation Companies in Canada: How to Choose a Resource Augmentation Partner
0dev.to AI

Harness : quand l'agent améliore lui-même le harness qui l'entoure
0dev.to AI
Google Opens Connected Apps Preview for AI Mode and Gemini
0dev.to AI
San Francisco’s Startup Map Is Missing Something: A Map of How Innovation Actually Works
0dev.to AI