Open Source
SciToT: Multimodal Tip-of-the-Tongue Retrieval for Scientific Papers
arXiv cs.IR0 views
arXiv:2611.05829v1 Announce Type: new Abstract: Researchers frequently encounter difficulties re-finding scientific papers when they remember aspects of the content but cannot recall reliable identifiers, such as titles or author names. This type of re-finding task, known as tip-of-the-tongue (ToT) retrieval, is particularly challenging for scientific documents, where recollections may involve textual information and visual elements, including figures, diagrams, and plots. Existing ToT retrieval benchmarks do not address scientific search. We introduce a multimodal benchmark for scientific ToT retrieval, comprising 108,512 open-access scientific documents across five domains and 11,499 synthetically generated queries. To construct the benchmark, we propose a scalable query elicitation pipeline that independently extracts textual and visual memory cues from source documents and uses large language models to generate queries resembling incomplete human recollections. We characterize scientific ToT information needs through an empirical analysis of publicly available re-finding requests and use the outcomes to assess the generated queries using human annotations and automated quality control. The benchmark includes lexical, dense, late-interaction, and visually grounded retrieval baselines. We release the dataset, extracted document representations, generated memory cues, evaluation splits, and accompanying generation and retrieval pipelines under an MIT license to facilitate research on multimodal scientific paper re-finding.
Source:https://arxiv.org/abs/2611.05829PreviousItem Representations Matter: Bridging Hard Semantic IDs and Soft Prototype Mixtures for Generative RetrievalNextWeaver: Weaving Preference Evidence through Incremental Reasoning for Personalized Retrieval-Augmented Generation
Related posts
Data-Driven Likelihood-Ratio Construction for Radar Detection via Bernstein Induction Operators
0arXiv eess.SP
Continuous Wideband Multicarrier Rydberg Atomic Quantum Receiver
0arXiv eess.SP
Space efficient implementation of hypergraph dualization in the D-basis algorithm
0arXiv cs.IR
GH-AWTrace: A Large-Scale Dataset of GitHub Agentic Workflow Execution Logs
0arXiv cs.SE
Confucius4-R2T2: A Stable-Prefix Streaming ASR Model for Real Real-Time Transcription
0arXiv cs.SD
CAST-Bench: Tracing Every Sound to Its Source in Multi-Shot Audio-Video Generation
0arXiv cs.SD