Open Source
SciToT: Multimodal Tip-of-the-Tongue Retrieval for Scientific Papers
arXiv cs.IR0 views
arXiv:2611.05829v1 Announce Type: new Abstract: Researchers frequently encounter difficulties re-finding scientific papers when they remember aspects of the content but cannot recall reliable identifiers, such as titles or author names. This type of re-finding task, known as tip-of-the-tongue (ToT) retrieval, is particularly challenging for scientific documents, where recollections may involve textual information and visual elements, including figures, diagrams, and plots. Existing ToT retrieval benchmarks do not address scientific search. We introduce a multimodal benchmark for scientific ToT retrieval, comprising 108,512 open-access scientific documents across five domains and 11,499 synthetically generated queries. To construct the benchmark, we propose a scalable query elicitation pipeline that independently extracts textual and visual memory cues from source documents and uses large language models to generate queries resembling incomplete human recollections. We characterize scientific ToT information needs through an empirical analysis of publicly available re-finding requests and use the outcomes to assess the generated queries using human annotations and automated quality control. The benchmark includes lexical, dense, late-interaction, and visually grounded retrieval baselines. We release the dataset, extracted document representations, generated memory cues, evaluation splits, and accompanying generation and retrieval pipelines under an MIT license to facilitate research on multimodal scientific paper re-finding.
Source:https://arxiv.org/abs/2611.05829PreviousItem Representations Matter: Bridging Hard Semantic IDs and Soft Prototype Mixtures for Generative RetrievalNextWeaver: Weaving Preference Evidence through Incremental Reasoning for Personalized Retrieval-Augmented Generation
Related posts

Best Free AI Image Generators That Run on Your Own Computer or Phone in 2026 (No Credits, No Uploads)
0dev.to OpenSource
The Dangers of Non-Self-Fixed Architecture Technical Debt and Its Impact on Time-to-Fix
0arXiv cs.SE
ViBench 2.0: A Benchmark for Long-Horizon Software Building
0arXiv cs.SE
AI-Driven SaaS Platform Integration: AI Express for Unified Generative AI Services with Pay-As-You-Go Credit Systems and Scalable Microservice Architecture
0arXiv cs.SE
Online Draft Co-Training for Speculative Decoding in Large-Scale, Long-Context RL Post-Training
0arXiv cs.DC
On solid angles and simplex shape measures
0arXiv cs.NA