Backend
Beyond Overlap: Hierarchical Graph Abstraction for Out-of-Core Vector Search
arXiv cs.IR0 views
arXiv:2512.22838v3 Announce Type: replace-cross Abstract: At billion scale, approximate nearest neighbor search (ANNS) often becomes an out-of-core problem: the full vector collection and index structures exceed memory capacity, making query performance dominated by SSD accesses and DRAM-SSD data movement. Existing systems struggle to strike a balance between accuracy and efficiency: physical-overlap methods replicate vectors or index entries across partitions, enlarging the SSD-resident index and incurring extra I/O; quantization-based methods reduce memory usage, but their approximate distances are less reliable and often require costly raw-vector reranking from SSD to preserve recall. We present GANNS (Graph-Abstraction ANNS), a hierarchical out-of-core ANNS engine that improves accuracy and I/O efficiency simultaneously. GANNS stores each cluster as a disjoint SSD partition with scale-aware indexes, while a memory-resident graph abstraction provides logical overlap before SSD access. During serving, GANNS uses query hotness and cluster priorities from the graph abstraction to prune low-value clusters and improve access locality. Across five datasets under strict memory constraints, GANNS delivers representative QPS improvements of 2.0--4.7x over state-of-the-art baselines, while preserving accuracy.
Source:https://arxiv.org/abs/2512.22838PreviousKnowledge Graph-based Retrieval-Augmented Generation for Schema MatchingNextRACORN: Robust Predicate-Agnostic Filtered Vector Search under Extreme Selectivity
Related posts
How do AI agents stay logged in between runs?
0dev.to AI
The AI Didn't Break In. It Knocked on Every Door: What the BOSSAI Mesh Actually Tells Us
0dev.to AI
Attacker used artificial intelligence to steal data from 11 countries
0dev.to AI
HTML Can Open Dialogs Without JavaScript- Here's How command and commandfor Work
0dev.to WebDev

Announcing LightningChart JS v9.1.0
0dev.to WebDev
Building Introworth: Recurring Payments Are a Net-Worth Story in Slow Motion — What Worked, What Broke
0dev.to WebDev