AI & ML
BRIDGE: Bridging the Semantic Quantization Gap for Generative Recommendation
arXiv cs.IR0 views
arXiv:2611.07425v1 Announce Type: new Abstract: Generative recommendation retrieves items by autoregressively generating Semantic IDs(SIDs), where an RQ-VAE quantizes each item into a hierarchical SID sequence that the decoder generates level by level. We identify an overlooked bottleneck in this paradigm: the Semantic Quantization Gap(SQG). Quantization derives SIDs from rich continuous signals, including codebook centroids, local neighborhood geometry, and level-wise entropy. However, the decoder receives only discrete identifiers and loses the semantic structure that shaped them. This mismatch manifests in three ways: a grounding gap, where the decoder lacks semantic anchors when target-side information is limited; a neighborhood gap, where token-level supervision discards inter-item similarity and exacerbates exposure bias; and a difficulty gap, where computation is allocated uniformly despite generation difficulty diminishing with depth. To bridge the SQG, we propose BRIDGE. Codebook-grounded latent reasoning injects frozen quantizer centroids as semantic anchors before SID generation. Privileged EMA self-distillation transfers neighborhood-aware knowledge from a teacher to an on-policy student, preserving inter-item geometry while mitigating exposure bias. Effort-aware recurrence allocates more computation to the challenging early levels and progressively reduces it with depth. Across three Amazon benchmarks, BRIDGE improves Recall@10 and NDCG@10 by 10.9% and 9.7% on average over the strongest baseline (up to 12.6% and 10.7%). In a one-week online A/B experiment on a large-scale e-commerce advertising platform with 5% traffic, BRIDGE improves eCPM by 0.65%.
Source:https://arxiv.org/abs/2611.07425PreviousCacheGraft: Enhancing Retrieval-Augmented Generation via Latent-Space Document EnrichmentNextOptST: Optimizing Semantic Tokenization for LLM-Enhanced Recommendation
Related posts
XDR - Experience Decision Records
0dev.to UX
VR에서 YouTube를 본다는 것: 약시(amblyopia) 사용자에게 몰입형 뷰 개편이 의미하는 것
0dev.to UX
Mercedes Put Depth in the Windshield. Depth Was Never Guaranteed for Everyone.
0dev.to UX
유나이티드 항공 좌석 등받이의 Spotify가 시각 훈련에 던지는 힌트
0dev.to UX
SteamVR's Image Quality Beta Is Really a Legibility Story — And That Matters If You Render Science
0dev.to UX
Meta beendet die Quest-2-Ära — und warum genau das für Sehtraining interessant ist
0dev.to Watercooler