AI & ML
EMA: Approximate Nearest Neighbor Search with General Attribute Filtering and Dynamic Updates
arXiv cs.DB0 views
arXiv:2606.00734v2 Announce Type: replace Abstract: Filtering approximate nearest neighbor search (Filtering ANNS) retrieves approximate nearest neighbors subject to attribute constraints in applications such as recommendation, retrieval-augmented generation (RAG), and LLM agent memory. However, predicate-specialized methods target either range or label filtering and can incur substantial index construction time, whereas predicate-agnostic methods support arbitrary predicates but struggle to sustain throughput and recall across a wide range of selectivities. In this paper, we propose EMA, a Filtering ANNS algorithm that supports multi-predicate queries over mixed numerical and categorical attributes as well as efficient dynamic updates. EMA attaches compact summaries, called Markers, to graph edges to record the attributes of candidates removed by geometric pruning. During query processing, EMA performs Marker-guided joint search with bounded edge recovery, enabling efficient filtering while preserving graph navigability. On multi-predicate workloads, EMA achieves 1.20x-28.18x the query throughput of the best competing baseline at comparable recall. In our complete-record replacement experiment, EMA retains approximately 98% of its initial query throughput without rebuilding the graph.
Source:https://arxiv.org/abs/2606.00734PreviousExample-Driven Intent Synthesis for Constrained Data Bundle Retrieval: Focused Text Snippet Extraction and BeyondNextEigenius: A Typed Knowledge-Graph DBMS with Epistemic Stratification and Institution-Mediated Reasoning
Related posts
Speed limits for information acquisition in stochastic learning dynamics
0arXiv stat.ML
Deep Barycentric Regression for Optimal Transport Map Estimation and Its Statistical Optimality
0arXiv stat.ML
Geometry-Constrained Kolmogorov-Arnold Networks: Learning Edge Geometry via Banach Duality
0arXiv stat.ML
Designing Reinforcement Learning for Diffusion Models: A Unified Path-Space View
0arXiv stat.ML
Empirical Bayes Rebiasing
0arXiv stat.ML
Almost Sure Convergence Rates of Stochastic Approximation and Reinforcement Learning via a Poisson-Moreau Drift
0arXiv stat.ML