AI & ML
Optimal Last-Iterate Bounds for Nonexpansive Stochastic Approximation
arXiv eess.SY0 views
arXiv:2611.13846v1 Announce Type: cross Abstract: We establish last-iterate mean-square residual bounds for nonexpansive stochastic approximation (SA), or stochastic Krasnoselskii-Mann (KM) iterations. In particular, we consider fixed-point mappings that are nonexpansive with respect to the Euclidean norm, and focus on polynomially decaying stepsizes. We study three conditions on the conditional second moment of the noise, and obtain bounds that are optimal up to logarithmic factors in each case. When it scales linearly with the squared residual, the best rate is $O(1/k^{1-\epsilon})$ for any $\epsilon>0$. In this case, for all considered stepsizes, our bounds match those of the noiseless KM iteration. When it is bounded by a constant, the best rate is $O(\log^2 k/\sqrt{k})$. When it scales affinely with the squared norm of the iterate, the best rate is $O(1/k^{1/2-\epsilon})$, and the mean-square residual can diverge if the stepsizes are not square-summable. Thus, unlike for contractive SA, square-summable stepsizes are necessary for nonexpansive SA. We demonstrate how various algorithms with cocoercive maps, such as stochastic gradient descent, linear SA, and learning in cocoercive games, fit into our framework, and how the different noise conditions arise in each of them.
Source:https://arxiv.org/abs/2611.13846PreviousNeuromodulation Through Intrinsic NoiseNextLearn-To-Propagate: Distributionally Robust Motion Planning for Nonlinear Uncertain Systems
Related posts
From Bias to Positionality: A critical grammar for Large Language Models
0arXiv cs.HC
Variance reduction with probing and Multilevel Monte Carlo in Lattice QCD
0arXiv cs.NA
GAIA: Geometry-Adaptive Operator Learning for Forward and Inverse Problems
0arXiv cs.NA
Agentic Symbolic Search: Approximating Solutions of PDEs Beyond Hand-crafted Expressions, Meshes, and Neural Networks
0arXiv cs.NA
MC$^2$: Monte Carlo Correction for Fast Elliptic PDE Solving
0arXiv cs.NA
Low-rank cross approximation of function-valued tensors for reduced-order modeling of parametric PDEs
0arXiv cs.NA