AI & ML
LoBoost: Model-Native Local Conformal Prediction for Gradient-Boosted Trees
arXiv stat.ML0 views
arXiv:2602.22432v3 Announce Type: replace Abstract: Gradient-boosted decision trees are among the strongest off-the-shelf predictors for tabular regression, but point predictions alone do not quantify uncertainty. Conformal prediction provides distribution-free marginal coverage, yet standard split conformal uses a single global residual quantile and can adapt poorly to heteroscedasticity. We propose LoBoost, a model-native local conformal method that reuses the fitted ensemble's leaf structure to define a multiscale partition of the feature space. Each input is represented by the sequence of leaves it visits along the boosting path, and matching leaf prefixes define nested groups in which residual quantiles are estimated locally. By reusing the predictive structure already learned by the model, LoBoost requires no auxiliary partition or nuisance model, no retraining, and no additional data split beyond standard conformal calibration. Our theory connects the stability of the fitted ensemble and the geometry of its induced cells to local residual-score homogeneity, providing finite-sample coverage-error control and asymptotic pointwise validity as the local calibration size grows and the cells become sufficiently homogeneous. Experiments show a transparent quality-cost trade-off: LoBoost improves over global split conformal on several heterogeneous datasets, but it is not uniformly superior to the adaptive baselines and is not uniformly Pareto-optimal.
Source:https://arxiv.org/abs/2602.22432PreviousLow-degree lower bounds via almost orthonormal basesNextProportional Neuro-Impulsive Control of SISO LTI Systems
Related posts
Australia considers criminal penalties for rogue AI in wake of OpenAI hack
0Hacker News New
Show HN: Kodelyth ECC – 71 AI agents and MCP and 55% token cuts for Claude Code
0Hacker News New
TSMC Approves $1B AI Investment
0Hacker News New
.web domain registration expected to open on April 6, 2027
0Hacker News New
Show HN: Outlier, AI without the data center, private and offline on your Mac
0Hacker News New
Modernizing NetHack's C engine with .NET MAUI, Avalonia and a 31-tool AI advisor
0Hacker News New