AI & ML
LAIR-Net: Leaky Alignment-Impulse Residual Networks for Tabular Regression
arXiv stat.ML0 views
arXiv:2610.11538v1 Announce Type: new Abstract: Deep randomized models fix hidden-layer parameters through random initialization and learn only closed-form readouts, typically adding depth by stacking random trans formations without target-aware control of hidden-state evolution. We propose LAIR Net, the Leaky Alignment-Impulse Residual Network, which mixes a shallow learned anchor into each hidden state through a leaky residual transition. We derive a depth uniform bound on input-perturbation sensitivity and use controlled simulations to attribute gains over a randomized baseline to the anchor rather than recursion or added capacity. Benefits emerge when a nonlinear target structure is learnable at the available noise level and diminish for nearly linear targets or dominant noise. Across 23 benchmark datasets, LAIR-Net achieves the best average rank among eight randomized networks and twelve conventional models, with relative performance associated with the same nonlinear-structure and noise quantities identified in simulation.
Source:https://arxiv.org/abs/2610.11538PreviousPSI-SINDy: Post-Selection Inference for Sparse Identification of Nonlinear DynamicsNextEmbedding-Bias in Conditional Independence Testing
Related posts
Supermarket Freezers Across Europe Hit By Second Suspected Cyberattack
0Slashdot

Apple 'HomeView Ultra' With 9-Inch 360º Screen Detailed in New Report
0MacRumors

Apple Isn't Done With 2026: Here's What's Still Coming
0MacRumors

Mark Gurman: Apple Initially Aimed to Release iPhone Duo in November
0MacRumors

iOS 27.2.1 Coming Soon, iOS 27.3 Beta Likely Available Tomorrow
0MacRumors
Grokipedia offers lessons in how AI can help Wikipedia
0Hacker News New