AI & ML
Generative Retrieval under Real-Time Supply Constraints in Local Commerce
arXiv cs.IR0 views
arXiv:2611.06323v1 Announce Type: new Abstract: Generative retrieval predicts semantic identifiers for candidate entities. In local retail and food delivery, candidates must also be serviceable for a particular user at a particular time. Location, weather, and traffic reshape merchant and product supply, so a catalog-valid identifier may be infeasible for the current request. Post-generation filtering removes such candidates only after beam capacity and inference computation have been spent. We study retrieval over an explicitly materialized, request-time supply snapshot, where short output sequences leave little opportunity to amortize online constraint preparation. Our RTP-LLM pipeline compiles eligible residual-quantization identifiers into a compressed sparse row prefix index, overlaps CPU compilation with model prefill, and shares the uploaded index across beams. Legal expansions retain original-model log probabilities, and constraint states follow selected beam parents. We formalize snapshot-relative identifier validity and distinguish it from entity-level eligibility and freshness. The implementation generates three-token merchant identifiers. Historical evidence covers daily catalog constraints and subsequent request-scoped serving evaluations. In one matched-beam daily-constraint case, filtered merchants decrease from 170 of 299 candidates to 29 of 299; residual distance filtering motivates request-specific constraints. A different-host comparison with 30,000 supplied entries reports a 0.6 ms service-side latency increment, while client measurements expose additional request costs. Captured requests from three geographic settings characterize behavior across supply sizes and output widths. These observations span development stages and measurement boundaries. They establish a practical implementation and identify bottlenecks, but do not establish compute savings at matched retrieval quality.
Source:https://arxiv.org/abs/2611.06323PreviousDo Search-Augmented Recommenders Use the Latest Search Episode?NextPMRecBench: A Benchmark for Personalization in Recommendation Agents under Multimodal Queries
Related posts

Chain of Recall คืออะไร? Stable IDs ช่วยให้ AI Agent มีความจำได้อย่างไร
0dev.to AI
CMS Migration Without Losing Your Traffic
0dev.to WebDev

Shopify GEO: From Product Data to Checking What AI Actually Cites
0dev.to WebDev
![[Brainstorm] Live Claude Context Debugger – Edit Claude's Context While It's Running](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fkzn32ybtbykj6aul8gxf.png)
[Brainstorm] Live Claude Context Debugger – Edit Claude's Context While It's Running
0dev.to Security
SSH: How It Works and Basic Best Practices
0dev.to Security

Sources: China's export curbs on critical metals have disrupted supplies of micro drill bits made mainly from tungsten carbide, used in PCBs and chip substrates (Cheng Ting-Fang/Nikkei Asia)
0Techmeme