AI & ML
Ontology-Guided Knowledge Graph Construction and Robust Evidence Retrieval for Indian Knowledge Systems
arXiv cs.IR0 views
arXiv:2611.14050v1 Announce Type: new Abstract: Retrieving evidence from Indian Knowledge Systems is complicated by transliteration variants, ambiguous names, and relations distributed across passages. We present an ontology-guided knowledge graph (KG) pipeline that links typed entities and relations extracted with Qwen3-32B to original textual evidence. Retrieval combines sense-aware grounding, bounded graph traversal, lexical anchors, relationship-vector search, and passage reranking. We evaluate KG alone, single-vector retrieval (SV), and KG unions with SV and Entity Notes on 320 questions from Dhara Bench, matching the per-question candidate count across internal systems under BGE and Qwen rerankers. Standalone KG has the highest Precision@5 under both rerankers and the highest MRR@20 in Counting, Composite, and Multi-hop among the evaluated internal configurations. With Qwen, KG achieves Multi-hop MRR@20 of 0.8722, compared with 0.7622 for the fully reranked KG + SV union. The KG + SV + Entity Notes union instead provides the highest overall Recall@20 (0.5134), compared with 0.4347 for KG. On the 15 Multi-hop questions, Qwen KG achieves complete-evidence MRR@20 of 0.4651 versus 0.3372 for SV, while both full unions complete ten questions within twenty results compared with nine for KG. Gemini 3.7 Flash, evaluated through manually reviewed source mappings, re mains stronger on overall MRR and nDCG, while internal systems have category-specific advantages. All comparisons are descriptive. A separate deployment timing study measures mean retrieval times of 20.374 s for KG and 0.646 s for SV. The findings support selecting KG or its unions according to the required balance of early relevance, evidence completeness, and retrieval cost.
Source:https://arxiv.org/abs/2611.14050PreviousFrom Show Programs to Linked DataNextFrom Search to Decision: How Post-Training Shapes Information-Seeking Capabilities in Large Language Models
Related posts
EEG-X: Toward Device-Agnostic and Noise-Robust Foundation Model for EEG
0arXiv cs.HC
Minority Reports: Balancing Cost and Quality in Ground Truth Data Annotation
0arXiv cs.HC
Whose Guardrail? User Identity Shapes the Effectiveness of Model Disclaimers in Mitigating LLM Political Persuasion
0arXiv cs.HC
Art2Song: Enhancing Visual Art Appreciation with Contextual Music Generation
0arXiv cs.HC
Characterising divergence between heuristic and language-model ratings of mobile user interface quality
0arXiv cs.HC
Exploring Cross-Reality Transitions between Projections and Head-Mounted Displays for Immersive Digital Art
0arXiv cs.HC