Open Source
Verdict Instability of OOD Scores under Reference Resampling
arXiv stat.ML0 views
arXiv:2609.00691v2 Announce Type: replace-cross Abstract: Post-hoc out-of-distribution detectors are fitted on a finite reference set, so every score they produce is an estimate. If we had chosen a different set, some verdicts would have moved. We measure that movement by resampling the reference set and recording the bootstrap standard deviation of the score, which we call verdict instability. It admits a closed form with no fitted parameters. The instability of a verdict is the within-class dispersion of the assigned class along the query's direction, divided by the square root of that class's reference count. That count is what separates verdict instability from the geometry of the score distribution, and it is identifiable only under class imbalance. Instability grows with the local dispersion. Far-OOD queries lie along the low-variance directions of an anisotropic embedding, so the distance-based scores in common use assign their highest values to the verdicts that are most reproducible. Only estimators of local dispersion carry the sign a practitioner expects. We give a rule that predicts this sign for any score from a single label-free correlation, and abstention driven by a wrong-signed score turns out worse than abstention at random on every dataset we test.
Source:https://arxiv.org/abs/2609.00691PreviousDiscretization and Statistical Consistency of Functional Flow MatchingNextBandits with Probing: Optimal Coverage and the Role of Feedback
Related posts
MUSBRIC: LEGO-Compatible Pneumatic Muscle Bricks for Reconfigurable Musculoskeletal Robots
0arXiv cs.RO
OpenFlyV2: An onboard vision-language-action model for aerial perception and navigation
0arXiv cs.RO
Show HN: Open Bot Avatars – a spec and renderer for interactive bot avatars
0Hacker News New
Show HN: Elections Archive: every election in the US, citable and open source
0Hacker News New
Show HN: Relaynet – open-source relay that gives browser tabs a real network
0Hacker News Show

My uninstaller refuses to delete anything it can't prove belongs to the app. Poke holes in my safety rules
0dev.to C#