AI & ML
Nonlinear compressive reduced basis approximation : when Taylor meets Kolmogorov
arXiv cs.NA0 views
arXiv:2601.13712v2 Announce Type: replace Abstract: This paper investigates model reduction methods for efficiently approximating the solution of parameter-dependent PDEs with a multi-parameter vector $\vec{\mu} \in \mathbb{R}^p$. In cases where the Kolmogorov $N$-width decays fast enough, it is effective to approximate the solution as a sum of $N$ separable terms, each being the product of a parameter-dependent coefficient and a space-dependent function. This leads to reduced-order models with $N$ degrees of freedom and complexity of order ${\mathcal O}(N^3)$. However, when the $N$-width decays slowly, $N$ must be large to achieve acceptable accuracy, making cubic complexity prohibitive. The linear complexity measure in terms of Kolmogorov width must be replaced by the Gelfand width, with its associated sensing number. Recent nonlinear approaches based on this notion decompose the $N$ coordinates into two groups: $n$ free variables and $\overline{n}$ dependent variables, where the latter are nonlinear functions of the former ($N= n+\overline n$). Several works have focused on cases where these $\overline{n}$ functions are homogeneous quadratic forms of the $n$ variables, with optimization strategies for choosing $n$ given a target accuracy. A rigorous analysis of the local sensing number is carried out, showing that $n = p$ is optimal and appropriate, at least locally, around a reference point. In practical scenarios involving wide parameter ranges, the condition $p\le n \le p + k$ (with $k$ small) is valid and more robust from continuity arguments. Additionally, the assumption of a quadratic mapping, while justified in a local sense, becomes insufficient. More expressive nonlinear mappings-including those using machine learning-become necessary. This work contributes a theoretical foundation for such strategies and highlights the need for further investigations to push back the Kolmogorov Barrier.
Source:https://arxiv.org/abs/2601.13712PreviousOvercoming Spectral Bias via Cross-AttentionNextEfficient construction and explicit dimensionality of Lie group-equivariant and permutation-invariant spaces
Related posts
Google Play Custom Store Listings: Targeting by Country the Right Way
0dev.to
NHSの630億円AIと、僕らがQuestで作った「遊べる弱視訓練」の距離感 #医療DX #弱視治療 #VR療法 #AmblyoPunch #デジタルヘルス
0dev.to
복셀 지도가 내 눈을 다시 보게 만들었다 — 개발자의 약시 극복기, 그리고 Amblyotube의 이분시 아키텍처에 대한 단상 얼마 전 Hacker News에서 258표를 받은 'Warsaw in voxels'를 열었다.…
0dev.to Programming
Do the math: How we took over ChatGPT accounts
0dev.to Programming

AI Now Writes Lean Proofs Faster Than Lean Can Check Them
0dev.to Programming
The Half-Life Layer — Or, "It Passed in March" Is Not the Same as "It Passes Now"
0dev.to AI