AI & ML
IMFuse: Instance-Aware Multi-Layer Fusion for LLM-Enhanced Sequential Recommendation
arXiv cs.IR0 views
arXiv:2607.27002v2 Announce Type: replace Abstract: Leveraging large language models (LLMs) to enrich item embeddings with textual semantics has become a prevailing paradigm for enhancing sequential recommendation (SR). However, existing methods typically rely solely on the final-layer LLM embeddings, leaving the semantics encoded in other layers largely unexploited. Through an empirical analysis, we uncover three key findings: 1) item embeddings from deeper LLM layers suffer from increasingly severe spectral collapse, which reduces their information richness and hinders the optimization; 2) intermediate LLM layers encode complementary item semantics beyond the final layer; 3) different items exhibit heterogeneous layer-wise semantic patterns. These findings suggest that the final layer alone is insufficient and that multi-layer LLM semantics should be exploited adaptively for each item. To this end, we propose IMFuse, a novel Instance-Aware MultiLayer Fusion strategy for LLM-enhanced SR. IMFuse adaptively aggregates embeddings from all LLM layers with learnable layerwise fusion weights, and further customizes the fusion for each item via an instance-aware Mixture-of-Experts (MoE) module. As a plugand-play strategy, IMFuse can be seamlessly integrated into various SR backbones and LLM-based enhancement methods. Extensive experiments on four real-world datasets demonstrate that IMFuse consistently improves state-of-the-art methods, achieving an average relative improvement of 6.72% with limited computational overhead.
Source:https://arxiv.org/abs/2607.27002PreviousWhen Reviews Are Scarce: Structure-Aware Review Imputation for Recommendation in Realistic Sparse Review SettingsNextWhen Is Complex Chunking Worth It? A Multi-Objective Evaluation of Chunking Methods at Scale
Related posts

GPT-Image-2.6 Outputs SVG and GIFs. Unlike 2.5, You Can't Run It Through Batch
0dev.to

Designing a Form That Asks for Birth Date, Time and Place (No Code, Just the Tricky Parts)
0dev.to UX
메타 Quest 2 OS 업데이트 종료, 약시 훈련 루틴에는 무슨 일이 생기나
0dev.to News
How to Put a Logo in a QR Code (and Make Sure It Still Scans)
0dev.to Design
Why Luxury Fine Jewelry Brands Are Ditching Physical Video Shoots for 3D CAD Commercials in 2026
0dev.to Design

How AI Is Changing Healthcare in 2026 - And Why Developers Should Pay Attention
0dev.to Productivity