Backend
Generative Recommenders Forget the Long Tail: Restoring Memorization in Retrieval and Ranking
arXiv cs.IR0 views
arXiv:2610.29298v1 Announce Type: new Abstract: Generative recommenders replace the retrieve-then-rank cascade with a single model: beam search over semantic item identifiers performs retrieval, and the same likelihood performs ranking. We show that this shared score makes them forget long-tail items twice. In retrieval, beam search keeps identifier prefixes by the probability mass of their subtrees, so tail items are pruned early, and a wider beam admits few more of them. In ranking, the likelihood places tail items below head items even when they are admitted, so expanding retrieval alone brings little or no gain. Both failures reflect missing item-level memorization (i.e., direct recall of which items co-occur), which collaborative filtering provides and shared-prefix generation lacks. To this end, we propose CAPE (Co-occurrence-Aware Pool Expansion), a training-free plug-in that restores memorization at both stages: (i) a memorization channel retrieves co-occurrence-supported tail items outside the beam and scores them with the frozen generator, and (ii) memorization-calibrated ranking fuses the generator likelihood with co-occurrence evidence while keeping the generator's first item. Experiments with two generative backbones on product and music domains show that CAPE significantly improves long-tail accuracy over the backbones and over re-ranking baselines that share its candidates, preserves or improves overall accuracy, and adds a small fraction of the latency.
Source:https://arxiv.org/abs/2610.29298PreviousLearning Marginal Viewpoint Utility for Budgeted Evidence Selection in RAGNextDirectional Posterior Feedback Fusion for Query Reformulation in Dense Retrieval
Related posts

Dr Amr Eloufy: How to Save Our Hair in This Fast-Moving World
0dev.to Watercooler
Only 6 of 45 Odds APIs Cover All 8 Big US Sportsbooks
0dev.to Data
Hadoop Ecosystem Overview
0dev.to Data
From One Chargeback to a Fraud Ring: Building Link Analysis That Works
0dev.to Data

Choosing the right AI web scraper depends on your needs, budget, and technical skills. This guide makes comparing the top tools easier and helps you find the right fit for your next project.
0dev.to Discuss

Choosing the right AI web scraper depends on your needs, budget, and technical skills. This comparison makes it easier to understand which tools are worth trying, from no-code options to developer-foc
0dev.to Discuss