AI & ML
Generalised Robust Bayes for Joint Inference of Model and Contamination
arXiv stat.ML0 views
arXiv:2607.25665v2 Announce Type: replace-cross Abstract: Robust generalised Bayesian methods protect parameter inference from contamination but do not generally infer its proportion or identify individual outliers. We propose H\"older--Bayes, which applies the H\"older divergence to a scaled model to construct a joint generalised posterior over model parameters and the contamination proportion, without specifying an outlier distribution. Each posterior draw flags a corresponding number of observations least compatible with the fitted model; averaging selections propagates joint uncertainty to outlier-detection scores. Under fixed, non-negligible contamination, we establish uniform boundedness of the posterior influence function, a finite-sample $n^{-1/2}$ bound on posterior-averaged excess risk, and a Bernstein--von Mises theorem. Tail overlap between the outlier distribution and the fitted model controls the population risk minimiser's bias and the associated change in limiting posterior covariance. Interpreting the posterior temperature as an affine volume scaling yields a closed-form, data-driven choice. Simulations and real-data experiments demonstrate robust estimation, contamination-proportion recovery, and posterior-guided data cleaning.
Source:https://arxiv.org/abs/2607.25665PreviousSequential sparse Gaussian process quantile regressionNextLearning reshapes power-law anisotropy in internal representations
Related posts

Copilot Fusion's Local Model Preview: Only One of Three Stages Runs on Your Machine
0dev.to AI

Meituan shipped LongCat-2.5
0dev.to AI
Standard bf16 Rounding Discards 99% of Your RL Policy Updates
0dev.to AI
Why Are Startups Choosing Coworking Space in Pune in 2026?
0dev.to AI
What a 32GB GPU actually lets you run locally
0dev.to AI

LLM weak random number generator detection test
0dev.to Security