AI & ML
Locate, Judge, Read: Role-Specialized Tool Agents over a Knowledge-Point Index for Open-Domain Multimodal Document QA
arXiv cs.IR0 views
arXiv:2610.13128v1 Announce Type: cross Abstract: Question answering over large heterogeneous document collections requires first finding the right passages and then reading them, yet current retrieval-augmented agents give one model both kinds of tools and let it schedule itself. We present KnowForge, a pipeline separated by job: a hybrid-retrieval knowledge-point index; a Locator agent that can only search; a code-scheduled bridge judge that forces the missing second hop; a typed, size-bounded evidence pool that merges every search's ranking; a Deep Reader agent that can only read text, images and tables; and a synthesizer with a format checker. With a self-hosted Qwen3.6-35B-A3B (3B active), KnowForge reaches F1 47.5 on the full open-domain M3DocVQA (2,441 questions, 3,368 PDFs), +11.0 over the published M3DocRAG system and +7.1 over one-shot retrieve-and-answer on the same index and model, and 53.5 with DeepSeek-V4-Flash. On MultiHop-RAG it reaches 73.5 accuracy, above the strongest published RAG and GraphRAG results (71.2); on the single-document MMLongBench-Doc it lifts the same model from 34.8 to 47.0, level with GPT-4o reading page images (46.3). Per-job ablations on the full benchmarks attribute the gain: the Deep Reader is worth 3.8, 9.8 and 0 points on the three corpora, tracking how visual each is; merging both agents into one with all tools and twice the rounds loses 1.9 F1 because it keeps searching instead of reading; a round-budget sweep shows a step at four Locator rounds and a plateau beyond; query latency scales with model calls rather than corpus size. We serve the three indexed benchmarks as read-only knowledge bases (free registration) and release all prompts and the runner code: https://github.com/metask-ai/knowforge-bench
Source:https://arxiv.org/abs/2610.13128PreviousGeopoliticalQA: Benchmarking Retrieval and Generation over Intelligence ReportsNextWeb$hell: A Unified Interface for Agentic Web Access
Related posts

'Demand is already well ahead of what we can build': This US factory claims its 'one large robot' can build circuit boards faster than its Chinese competition
0TechRadar

Garmin explains the process behind the Fenix 9 Pro and Marq Gen 3's new titanium case
0TechRadar

Proton apologizes to community after internal memo shows force behind proposed AI use in building its privacy products
0TechRadar

The Microsoft Surface Laptop Ultra releases a patch to fix 'reliability and performance' issues found by reviewers — so should you save your money for now?
0TechRadar

Apple spent a record $45.77 billion on R&D in fiscal 2026, up 32%
09to5Mac

What’s new in Android Nov. 2026 Google System Updates: Android photo backup with Quick Share for Windows
09to5Google