AI & ML
Theoretically Sound Item Similarity Measures for Recommender Systems
arXiv cs.IR0 views
arXiv:2610.34402v1 Announce Type: new Abstract: Quantifying the similarity between items is fundamental to neighborhood-based collaborative filtering, yet many commonly used similarity measures are heuristics that lack theoretical justification. The use of heuristics forces practitioners to rely on empirical trial-and-error, offering little insight into why certain measures outperform others or how they might be improved. In this paper, we present a principled approach for designing item similarity measures grounded in probabilistic modeling and parameter estimation. By adopting this formal perspective, we derive two previously overlooked similarity measures based on the Bernoulli and multinomial distributions. Through an extensive ablation study we highlight the critical role of bias, probabilistic smoothing, treating the unknowns correctly, and choosing appropriate probability distributions. Finally, we show that the commonly used cosine similarity can be interpreted as the solution to a specific optimization problem, thereby providing a novel perspective on this decades-old heuristic.
Source:https://arxiv.org/abs/2610.34402PreviousA Domain-Aware Pipeline for Structured Extraction and Retrieval-Augmented Question Answering over arXiv Superconductivity LiteratureNextAgent Memory as Recommendation: Recommender-System Design for Long-Term Memory of LLM Agents
Related posts

'Demand is already well ahead of what we can build': This US factory claims its 'one large robot' can build circuit boards faster than its Chinese competition
0TechRadar

Garmin explains the process behind the Fenix 9 Pro and Marq Gen 3's new titanium case
0TechRadar

Proton apologizes to community after internal memo shows force behind proposed AI use in building its privacy products
0TechRadar

The Microsoft Surface Laptop Ultra releases a patch to fix 'reliability and performance' issues found by reviewers — so should you save your money for now?
0TechRadar

Apple spent a record $45.77 billion on R&D in fiscal 2026, up 32%
09to5Mac

What’s new in Android Nov. 2026 Google System Updates: Android photo backup with Quick Share for Windows
09to5Google