AI & ML
Hybrid Newton-BFGS high-index saddle dynamics for accelerating saddle-point searches
arXiv cs.NA0 views
arXiv:2611.07692v1 Announce Type: new Abstract: We propose a hybrid Newton-BFGS high-index saddle dynamics (HiSD) method for accelerating saddle-point searches. The method constructs a Newton correction on the unstable subspace from the available negative eigenpairs, while BFGS updates based on projected secant information approximate the inverse Hessian on the stable subspace. By combining Newton and quasi-Newton corrections, the method incorporates curvature information in both subspaces while preserving the ascent-descent structure of HiSD. Accounting for the evolving stable subspaces, we establish local $Q$-superlinear convergence of the full-memory version near nondegenerate saddle points under suitable assumptions. We further develop a limited-memory version for large-scale problems and provide fixed-step and line search strategies. Numerical experiments show local convergence behavior consistent with the theory and demonstrate acceleration on ill-conditioned problems and degenerate saddle manifolds in neural-network loss landscapes. The method also supports efficient upward and downward saddle searches for a liquid crystal model, further illustrating its broad applicability to saddle-point computation.
Source:https://arxiv.org/abs/2611.07692PreviousRandomly shifted lattice rules for SDEs with constant diffusion: error bounds uniform in time discretization and dimensionNextA stability order barrier and SSP bound for Runge--Kutta methods with non-negative coefficients: AI-assisted proofs
Related posts
Megaspeed exec was recruited to spy on Nvidia CEO, according to US intelligence memo
0TechCrunch
Wie holt sich ein Claude-Chat osFoundry-Tasks per MCP ohne Push-Events?
0dev.to

From Zero to Edge AI: Engineering TinyTB-Net from Scratch
0dev.to
OS Release: OpenIndiana 2026.10
0DistroWatch
GitHub Copilot's Agentic Workflow: Orchestration Primitives for Multi-Stage Agent Tasks
0dev.to GitHub
Hiệu suất hủy diệt của Khadija Shaw đưa Man City vươn lên đỉnh bảng Women's Super League
0dev.to Data