AI & ML
Score-Preserving Continual Lasso under Task Shift
arXiv stat.TH0 views
arXiv:2610.32708v1 Announce Type: cross Abstract: Continual learning (CL) aims to learn from sequential tasks while mitigating catastrophic forgetting when historical data are no longer accessible. We study continual learning for high-dimensional sparse linear regression, where $\ell_1$ regularization creates a difficulty absent from continual ridge regression: that recursively reusing an $\ell_1$-penalized estimator can propagate earlier shrinkage and accumulate regularization bias across tasks. We propose score-preserving continual Lasso (SP-CL), which separates sparse estimation from state transmission by preserving the historical squared-loss score. Under squared loss, its cumulative estimator exactly recovers a full-history Lasso minimizer. When task coefficients coincide, it inherits the full-history sparse rate. For related task-specific coefficients, SP-CL uses a regularized current-task correction that leaves the transmitted state unchanged and attains the offline source-assisted rate under an oracle related-task condition. We also derive Overall/BWT/FWT decompositions that distinguish historical information loss, task conflict, and current-task specialization, and validate the resulting regimes in simulation.
Source:https://arxiv.org/abs/2610.32708PreviousExact Global Minimax Risk near NonidentificationNextOn Orthogonal Recurrent Neural Networks Quantization
Related posts
How to Write a CV That Gets You Hired in 2026
0dev.to

A Model That Rewrites Weights by Hand, and Stolen Keys That Cost $1 Million
0dev.to
Amazon Alexa for Shopping tools detailed ahead of Black Friday on November 27
0dev.to News
O cliente pediu desconto no pastel artesanal de R$ 15, mas pagou R$ 40 num hambúrguer sem reclamar
0dev.to Design
How do you actually track profit on your online store?
0dev.to Discuss
Google Tests Gemini 4 Carbon In Secret To See If People Like It
0dev.to Machine Learning