Open Source
Oracle high-dimensional $M$-estimation using smooth reparameterization for sparsity
arXiv stat.TH0 views
arXiv:2609.19558v3 Announce Type: replace-cross Abstract: This paper establishes a unified non-linear regularization framework for high-dimensional $M$-estimation, encompassing both linear regression and Cox's proportional hazards models. Rather than relying on traditional additive non-convex penalties, the proposed paradigm embeds sparsity directly into the parameter mapping using a smooth ($C^2$) component-wise ReParametrization map for Sparsity (RePS). This geometric formulation dynamically adapts to local parameter scales, successfully suppressing high-dimensional noise and recovering unbiased oracle asymptotic normality under the large-sample limit. Through the Primal-Dual Witness method, we establish a unified oracle equivalence for both model classes under a liberated micro-penalty scaling regime $\lambda \ll n^{-1/2}$, effectively accommodating model-specific structures such as the shift-invariance in survival analysis. Extensive Monte Carlo simulations demonstrate that the RePS framework consistently achieves near-perfect false-positive control and optimal 95\% confidence interval coverage, outperforming conventional non-convex regularizers (SCAD and MCP) which suffer from severe variance inflation and under-coverage due to post-selection noise leakage.
Source:https://arxiv.org/abs/2609.19558PreviousRobust Model Order Selection via Dithered Differential Step-Down ThresholdingNextSharp spectral norm concentration and regularization of sparse random tensors
Related posts

MagSafe Monday: Pelican’s MagSafe Battery Pack is the battery built to go anywhere
09to5Mac
Your Product Is Copyable. Your Distribution Isn't: A 24-Channel Map for Solo Builders
0dev.to
Astra can read and write weights to improve Qwen
0Hacker News
Distillation didn't help our small model until we took the labels away
0dev.to Machine Learning

462. Minimum Moves to Equal Array Elements II
0dev.to PHP
MUSBRIC: LEGO-Compatible Pneumatic Muscle Bricks for Reconfigurable Musculoskeletal Robots
0arXiv cs.RO