AI & ML
Fully Deterministic Shallow Neural Networks with Localized Activations. Part II: Condition Number Estimates
arXiv cs.NA0 views
arXiv:2610.09357v1 Announce Type: new Abstract: We prove positive definiteness and quantitative condition-number bounds for continuous Sobolev Gram matrices of deterministic shallow networks with Gaussian and tanh-difference activations. The prescribed feature families include the optimal Sobolev approximation constructions of Part I. On every fixed nonempty bounded Lipschitz domain in $\R^d$, $d\ge2$, and for every fixed integer $m\ge0$, the raw and column-normalized Gram matrices in the full $H^m$ inner product have spectral condition numbers bounded by $\exp(CN^{2/d}/\log(N+2))$ for sufficiently large $N$, where $N$ is the feature count and $C>0$ is independent of $N$. The upper bounds hold for midpoint and Gauss-Legendre offsets. For midpoint offsets and a suitable angular sequence, matching lower bounds on fixed ellipsoids establish sharpness of this exponent over the stated domain class for raw Gaussian matrices and both raw and normalized tanh-difference matrices. The proof combines homogeneous differential operators that isolate direction groups with one-dimensional coefficient-recovery estimates. Two-dimensional $L^2$ experiments on a square illustrate condition-number growth and normalization effects.
Source:https://arxiv.org/abs/2610.09357PreviousFully Deterministic Shallow Neural Networks with Localized Activations. Part I: Construction and Optimal Sobolev ApproximationNextStructure-preserving full- and low-rank exponential methods for the optimal control of Lindblad equations
Related posts
OpenAI is finally merging ChatGPT’s chat and Work tabs
0TechCrunch

10 Open-Source Robotics Repositories for 3D Perception, VLA Policies, and Sensor Calibration
0dev.to
My self-modifying system tried to wire a gate-passing module into its own protection enforcer. It was refused three times.
0dev.to
Last night an AI agent performed brain surgery on a mouse
0Hacker News
The Card-Update Page Gets One Visit. Design for That Visit.
0dev.to UX
SaaS Partner Scout: A Script for Identifying GitHub SaaS Project Contributors
0dev.to GitHub