Backend
ConStore: Search-Overlapped Prefetch and Co-Retrieval-Aware Content Storage for Disk-Based ANNS
arXiv cs.DB0 views
arXiv:2610.21676v1 Announce Type: new Abstract: Disk-based approximate nearest-neighbor search (ANNS) supports retrieval-augmented generation (RAG), search, recommendation, and advertising over corpora that exceed memory capacity. Existing ANNS research often focuses on vector search at small top-K, whereas industrial-scale applications require larger retrieval sets. Fetching the corresponding content from storage remains comparatively underexplored. Our profiling across million- to billion-vector corpora shows that, at large K, content fetch latency can match or exceed vector-search latency and cannot be ignored in end-to-end retrieval. We present ConStore, a content storage engine combining two complementary techniques to reduce end-to-end retrieval latency. Speculative Inline Content Prefetch (SICP) commonly abstracts graph-based and cluster-based ANNS as progressive SSD I/O that refines an in-flight candidate queue. It prefetches content for stable leading candidates under a bounded I/O budget, overlapping content reads with search without changing the final top-K results. Co-Retrieval-Pattern-Aware Grouping (RPAG) uses query logs to place frequently co-retrieved documents in contiguous segments. Workload-Adaptive Segment Reorganization (WASR) adapts this layout to workload shifts by selectively regrouping segments under a bounded rewrite budget. Group Content Fetch (GCF) exploits this layout to coalesce per-document random reads into batched, page-aware I/O requests. SICP works independently of the content layout, while RPAG and GCF reduce fetch cost even without prefetching. Across three multi-hop QA workloads with K from 10 to 1600, ConStore reduces end-to-end retrieval latency over the best per-document-read baseline by up to 48% on DiskANN and 25% on SPANN. Separate experiments on 100M- and billion-vector indexes demonstrate SICP's applicability at larger scales.
Source:https://arxiv.org/abs/2610.21676PreviousAdaBool: Sparse Boolean Matrix Processing with Adaptive Data RepresentationNextReflective Compositional Grounding for Natural-Language-to-SPARQL
Related posts
AWS Weekly Roundup: GPT-6.1 Terra on Bedrock, Step Functions as agent tools, and more (November 2, 2026)
0AWS Blog
How to Build Durable Chat Memory for RAG Using ScyllaDB and LangChain
0HackerNoon
SpaceX reportedly wants to buy Boost Mobile to compete with AT&T, T-Mobile, and Verizon
0TechCrunch
Laravel API Security Checklist 2026 for Mobile Apps
0dev.to

Part 2: From Five Stars to One Sentence: Semantics for Custom Compose Controls
0dev.to
A Four-Line Fix for a 9.8: Anatomy of Linux's TCP Handshake Use-After-Free
0dev.to