AI & ML
VIBRA: Backward-Compatible Cross-Modal Retrieval with Consensus Barycenters
arXiv cs.IR0 views
arXiv:2611.23606v1 Announce Type: cross Abstract: Backward-compatible retrieval enables a new encoder to query the gallery that an old model has already encoded, so that a cross-modal retrieval system can be upgraded without re-encoding billions of items. Existing compatible methods either fit the old query and stay near the accuracy of the old model, or run the old and the new encoder for every query. We propose VIBRA, which matches relevance on the old gallery, corrects the errors of a single model with the barycenter of several views, which is itself a query in the old space, and trains the new encoder to inherit this consensus, so that models absent at deployment still shape every query. We show that the barycenter gains margin over the average of its views exactly when their hardest irrelevant items differ, and we characterize the share of this gain that one encoder can reach. On five benchmarks with five upgrades among six CLIP, MetaCLIP and SigLIP2 backbones, VIBRA is the best compatible method in all 50 settings, improving Recall@1 by up to 5.6 points over the strongest baseline and by up to 18.0 points over the old model, while adding less than 1 ms to the latency of the new encoder.
Source:https://arxiv.org/abs/2611.23606PreviousLusoClin: A Synthetic Clinical Note Dataset for Medical Information Retrieval in European PortugueseNextKnowMe Paper Radar: Lightweight Discovery of Promising Papers in the Age of Autoresearch
Related posts
The Heater Room So Far, in Seven Posts
0dev.to TypeScript
How I Built a Zero-Signup, Ad-Free Image Host on Cloudflare R2 (and Stopped Fighting Cluttered Image Sites)
0dev.to JavaScript
Why the link box is a plain input, not a drag-and-drop zone
0dev.to JavaScript
Re-Testing LLM-Based C-to-Rust Translations Against Their Original C
0arXiv cs.SE
Reliability is a user-specific property of large language models
0arXiv cs.SE
Safe Personal RSI: Evaluating and Repairing Personal-Agent Updates
0arXiv cs.SE