Backend
VS-Flash: Harnessing Vector Search with Computational Memory-Semantic Flash
arXiv cs.DC0 views
arXiv:2610.26960v1 Announce Type: cross Abstract: As generative AI continues to evolve, retrieval-augmented generation (RAG) systems are driving rapid growth in vector database capacity requirements. As datasets outgrow host DRAM, vector databases rely on MMap-based serving over SSDs to extend capacity. However, high-fan-out ANN searches generate concurrent irregular accesses that contend for host memory and storage resources, degrading bulk throughput and inflating tail latency under mixed workloads. In this paper, we address these challenges through memory-semantic capacity and workload-aware compute placement. VS-Flash exposes flash as a large-capacity memory-semantic space and dynamically selects the execution engine according to runtime query and workload characteristics. It offloads throughput-oriented large-batch queries to a Computational Memory-Semantic Flash (CMS-Flash) device, while executing latency-sensitive small-batch queries on the host CPU. Both paths access the same resident segments, avoiding a separate host-DRAM replica. Across three billion-scale datasets, VS-Flash improves bulk-search throughput over vanilla Milvus by 36.8X on average, with up to a 57.4X improvement. Under mixed workloads, VS-Flash reduces the p99 latency of latency-sensitive requests by up to 24.8X while sustaining device-side bulk search. These results show that VS-Flash delivers scalable vector search beyond host DRAM capacity while jointly improving bulk throughput and small-request tail latency.
Source:https://arxiv.org/abs/2610.26960PreviousWeight Placement Is Not Enough: Synchronization in Multi-Node CPU Decoding of Ternary LLMsNext3D-MoE: Complementarity-Guided Hardware-Software Co-Design for MoE Decode on 3D-Stacked NMP
Related posts

Nibnib says 4bpp. The file still has a header.
0dev.to Rust
I counted words in the same 100 MiB file with ten programs: straightforward and tuned versions in Rust, Go, Node and Python, plus two-thread Rust and Go. Read the full article : https://medium.com/git
0dev.to Rust
Redis 8.12 RC2's SEXPIRE command cuts a set membership check from two round trips to one
0dev.to Database
Does AbortSignal Cancel a Node.js Database Query? 4 Drivers Tested
0dev.to Database
I read all 308 open jobs at xAI: 54% are in its data center team, and most of them are in Memphis
0dev.to AI
Claude Code marketing analytics with an app-scoped key
0dev.to AI