AI & ML
SLIDE: Search-to-List Item Distillation for Single-Rollout Generative Retrieval
arXiv cs.IR0 views
arXiv:2610.34764v1 Announce Type: new Abstract: Generative retrieval (GR) typically relies on item-level beam search to retrieve candidates, leaving cross-item dependencies unmodeled and limiting direct optimization of list-level objectives. A natural alternative is to generate the entire list within a single autoregressive trajectory. However, greedy decoding with directly trained list-wise models substantially underperforms beam search. We identify two contributing factors: the broader search space explored by beam search and the positional bias of scarce positive signals, which deprives later positions of adequate supervision. To address these challenges, we propose $\textbf{SLIDE}$, a search-to-list item distillation framework that decouples offline search from online list generation. A teacher model retrieves high-quality candidates through offline item-level beam search, providing additional conversion-relevant supervision beyond sparse behavioral labels. Their Semantic IDs (SIDs) are then concatenated in beam-score order to form list-wise distillation targets. This search-to-list conversion transforms candidates retrieved along separate search paths into sequential item-generation targets within a single trajectory. Trained on these targets, the student generates the Top-$K$ list in a single greedy pass, also decoupling teacher scaling from online deployment. Experiments on FORGE and Taobao Search show that SLIDE substantially improves retrieval quality under single greedy decoding and, with stronger offline teachers, surpasses the beam-search reference. Supplementary RL experiments support the effectiveness of list-level generation.
Source:https://arxiv.org/abs/2610.34764PreviousDiscovering Topics from Linear AutoencodersNextCA-HNM: Constraint-Aware Hard Negative Mining for Dense Retrieval with Structured Domain Models
Related posts

Apple 'HomeView Ultra' With 9-Inch 360º Screen Detailed in New Report
0MacRumors

Apple Isn't Done With 2026: Here's What's Still Coming
0MacRumors

Mark Gurman: Apple Initially Aimed to Release iPhone Duo in November
0MacRumors

iOS 27.2.1 Coming Soon, iOS 27.3 Beta Likely Available Tomorrow
0MacRumors
Grokipedia offers lessons in how AI can help Wikipedia
0Hacker News New
Are Prediction Markets Missing the Voters Who Could Decide the 2026 Midterms?
0Hacker News New