AI & ML
Enhanced randomized Douglas-Rachford method for linear systems: Improved probabilities and adaptive momentum
arXiv cs.NA0 views
arXiv:2506.10261v2 Announce Type: replace Abstract: Randomized iterative methods have gained recent interest in machine learning and signal processing for solving large-scale linear systems. One such example is the randomized Douglas-Rachford (RDR) method, which updates the iterate by reflecting it through two randomly selected hyperplanes and taking a convex combination with the current point. In this work, we enhance RDR by introducing improved sampling strategies and an adaptive heavy-ball momentum scheme. Specifically, we incorporate without-replacement sampling and volume sampling into RDR and establish linear convergence in expectation for both schemes. For without-replacement sampling, we further establish a larger one-step descent than that of conventional RDR. For volume sampling, the convergence rate explicitly incorporates geometric information, and a tighter comparison with RDR is obtained under additional structural assumptions. Furthermore, we develop an adaptive momentum mechanism that determines the relaxation and momentum parameters directly from the iteration information without manual tuning. We establish linear convergence in expectation for the resulting method. Numerical experiments demonstrate the effectiveness of the proposed methods across a range of problem settings.
Source:https://arxiv.org/abs/2506.10261PreviousHigh-dimensional sparse recovery from function samples - Decoders, guarantees and instance optimalityNextOn maximal curves of $n$-correct sets
Related posts

Could data center backlash flip Florida?
0The Verge

Vivo’s first Pro Max phone proves its Ultra is still in a league of its own
0The Verge

Why Peacock is making a huge bet on YouTube
0The Verge
Ninja’s first-ever microwave just replaced two of my kitchen appliances at once
0TechCrunch
Marvell and Lumentum sign definitive 115 billion dollars all-stock merger to build an AI-connectivity leader
0dev.to
OpenAI merges ChatGPT Chat and Work tabs into one workspace with a shared usage budget
0dev.to