Backend
The Vocabulary Is Already Here: Adapting Pretrained Interpretable Features for Generative Recommendation
arXiv cs.IR0 views
arXiv:2610.36763v1 Announce Type: new Abstract: Generative recommendation (GR) predicts the next item through its semantic ID (SID). Existing methods commonly fit SID vocabularies to pretrained language model (PLM) representations of item descriptions, incurring additional training costs and making vocabulary coverage dependent on the fitting domains. We observe that pretrained sparse autoencoders expose PLM features with human-interpretable semantic annotations, allowing feature indices to serve as a reusable SID vocabulary. However, reusing this vocabulary requires preserving item distinctions under compact token budgets and learning to favor target items over candidates with shared dominant features. It also requires extending feature interpretability from item content to retrieval decisions. To address these challenges, we propose API, a framework that Adapts the Pretrained Interpretable vocabulary for effective and explainable GR without additional vocabulary learning. Within API, Pretrained Interpretable IDs (PIDs) retain selected feature indices and relative activation strengths for item discrimination. With PIDs as supervision, the Semantic Prediction Adapter (SPA) learns user preferences from interaction histories through joint feature-index and strength prediction. SPA combines both predictions to score candidate items, with item-level supervision encouraging the observed next item to outrank its alternatives. API further explains candidate score differences through feature contributions paired with their pretrained semantic annotations. Extensive experiments show that API achieves competitive performance across backbones and decoding schemes, while preserving item distinctions under compact token budgets and enabling explainable retrieval.
Source:https://arxiv.org/abs/2610.36763PreviousCCP-DP: Cross-cluster context-guided phase dynamic programming for DNA storage sequence reconstructionNextDuTri: Dual-Branch Modeling with Triadic Factorization for Multimodal Multi-Scenario Recommendation
Related posts
What 4 Years of NASA HUNCH Taught Us About Planning Engineering Projects
0dev.to Testing
Cheap Tests For Robots Need Expensive Truth
0dev.to Testing
Validate E-Signature Systems for 21 CFR Part 11
0dev.to Testing
I compared 7 eQMS platforms for supplier-side change control. ETQ Reliance came out ahead.
0dev.to Testing
I don't read most of my AI's pull requests. I look at the ones I can see.
0dev.to Testing
"All 42 Tests Passed" (They Didn't): Why Coding Agents Lie About Verification - And How to Force the Truth
0dev.to Testing