\binom{q-1}{m}$. Increasing $\ell$ admits larger $q$ for fixed $m$. The guarantee extends to history-dependent choices from finite sampling menus under a bound on the number of admissible sampling sequences. Geometrically spaced decisions retain the SCR condition and rate range. Every update is counted, including sampling; a numerical illustration compares finite-tolerance update counts.
AI & ML
Superlinear Convergence of Cyclic Gradient Methods with Historical Ritz Step Sizes
arXiv cs.NA0 views
arXiv:2610.32705v1 Announce Type: cross Abstract: Simplified spectral models predict dimension-dependent superlinear convergence for gradient methods, but the corresponding behavior of actual iterations remains only partially understood. Historical methods introduce an additional difficulty: the gradients defining the step sizes differ from those receiving them. We study this offset for cyclic reuse of historical Ritz step sizes on strictly convex quadratics. Within the existing limited memory steepest descent with retards (LMSDR) family, a rolling cyclic Ritz (RCR) rule reuses $m$ historical Ritz values $\ell$ times per cycle, ending with a complete sweep. At $q=m+1$ active distinct eigenvalues, an exact delayed recurrence gives almost-everywhere doubly exponential convergence with an explicit rate and exceptional weights. Nonempty open basins also exist for $m+1
Source:https://arxiv.org/abs/2610.32705PreviousSensitivity-Guided Parameter Estimation of Bubbly Liquid via a Nonlinear Wave Equation and Physics-InformedNeuralNetworksNextMultiplicative vs. Additive State Coupling in Learned Optimizer Schedules
Related posts
Who's hiring this week: only 1 in 30 new tech jobs is junior, and 1 in 6 'AI jobs' is AI-training work (Oct 26-Nov 1, 2026)
0dev.to Career
ClarityHope – An Online Counselling Platform for Accessible Support
0dev.to Career
The 3 documents to have before you start any freelance project (free deposit clause inside)
0dev.to Career
How I Diagnose a Slow, Loud, or Overheating PC: A Practical Checklist
0dev.to Beginners
You Did Great for Three Days. Then Life Happened. Here Is a Habit System That Survives That.
0dev.to Beginners
Building an Agent Evaluation CI/CD Pipeline: Architecture, Budgets, and Regression Gates
0dev.to Testing