Backend
A Large-Dimensional Analysis of Least-Squares Federated Learning via Generalized Total Variation Minimization
arXiv stat.ML0 views
arXiv:2610.20075v1 Announce Type: cross Abstract: Federated learning over decentralized networks inherently trades off the suppression of local finite-sample noise through collaboration against the bias that collaboration introduces between heterogeneous nodes. We study this tension by performing a large-dimensional analysis of Generalized Total Variation Minimization with least-squares models. Using tools from random matrix theory, we show that Lipschitz observations of the global GTVMin solution concentrate in large dimensions, universally for any underlying network structure. We provide exact analytic expressions for the asymptotically precise performance under both i.i.d. and non-i.i.d. Gaussian mixture distributions on a fixed network. For the latter, these expressions quantify how regularization balances local adaptation against collaboration. Our theoretical results are confirmed by experiments on synthetic and real-world data.
Source:https://arxiv.org/abs/2610.20075PreviousOutperforming 1000 Euclidean Layers With Hyperbolic Goal-Conditioned RLNextOptimizing Sparse Boolean Rule Networks using Mixed Integer Linear Programming
Related posts
Building a Robust Prop Trading Execution Engine for Gold (XAUUSD) Using Python and MetaTrader 5 (MQL5)
0dev.to
Node.js SMS Alerts Pricing and Features: Marketplace Evidence in 4 Stages
0dev.to
Reading Argentina's crypto register in Python: 81 firms, a lying dimension tag and a new monthly clock
0dev.to

The garbage collector never looks for garbage
0dev.to
Batch Rename Files in the Browser: The Preview Before the ZIP
0dev.to
WhatsApp automation in n8n in 5 minutes (community node)
0dev.to