AI & ML
Proximal Adam algorithm for nonsmooth composite optimization and linear convergence under proximal PL geometry
arXiv cs.NA0 views
arXiv:2611.17727v1 Announce Type: cross Abstract: We analyze Adam-type methods for nonsmooth composite optimization problems $\min_x\Phi(x)=f(x)+h(x)$, where $f$ is smooth and $h$ is convex, proper, and lower semicontinuous. The nonsmooth term is treated by a metric-weighted proximal map, while the smooth term is preconditioned by the Adam second-moment matrix. We prove a composite descent lemma whose constants depend explicitly on the spectral bounds of the adaptive metric and a residual--step equivalence that converts proximal step decay into subgradient stationarity. These yield an $O(1/N)$ bound on the minimum proximal stationarity residual for the deterministic proximal normalized gradient method without convexity of $f$, and the same $O(1/N)$ rate for proximal Adam under quantitative momentum-alignment and residual-coherence conditions together with a metric-compatibility condition. By estimating the momentum error directly, the same $O(1/N)$ rate is also obtained without the momentum-alignment and residual-coherence assumptions. When the composite objective satisfies a proximal Polyak--{\L}ojasiewicz inequality, both algorithms and the relaxed proximal Adam scheme converge linearly with explicit contraction factors. Numerical experiments on a diagonal Lasso problem, two-dimensional image TV denoising, and two-dimensional elastic parameter identification illustrate the predicted stationarity and linear rates.
Source:https://arxiv.org/abs/2611.17727PreviousA graph discretization of the Steklov and Neumann problems on domains in complete Riemannian manifoldsNextHigh-probability convergence of adaptive, proximal, and clipped Adam-type methods for nonconvex stochastic optimization
Related posts

94% of Singapore Small Business Owners Surveyed Say More AI Guidance Is Needed
0Meta Newsroom
Nashville, Tennessee Real Estate Dataset: 7,436 Listings, Excel File (Nov 10, 2026)
0dev.to Data
A Hundred and Eighty Six Thousand Pounds of Stock Had Left One Branch and Never Arrived at Another
0dev.to Data
Đánh giá thông số 20 tiền đạo xuất sắc nhất bóng đá châu Âu thế kỷ 21 từ BBC Sport
0dev.to Data
Thống Kê SHB Đà Nẵng: Bài Toán Phòng Ngự Chờ HLV Lee Young-jin Hóa Giải
0dev.to Data
Alibaba's Qwen4-Max Is Here — and It's Gunning for Claude's Coding Crown
0dev.to News