AI & ML
SWE-PolyVision: Benchmarking Cross-Image Abductive Reasoning for Repository-Level Software Engineering
arXiv cs.SE0 views
arXiv:2609.29754v3 Announce Type: replace Abstract: Current multimodal software-engineering benchmarks expose images as additional context, but do not test whether an agent can integrate evidence distributed across images into a verified repository-level repair. We present SWE-PolyVision, an executable benchmark of 92 real tasks from 36 open-source organizations, with 48 public tasks and 44 private holdouts. The release contains 402 static images and 6 videos, with at least two visual inputs per task. Each task pairs a fixed pre-fix repository with an isolated verifier and is evaluated under the supported conditions among three access modes: Text-only, Native Vision, and Tool-mediated Vision. Across eleven coding models, visual access changes which tasks are solved, but effects depend on both model and task. Two trace-linked Native Vision cases illustrate how complementary visual and textual clues can lead to source-localized, verified repairs; controlled interventions show that this conversion is not yet stable across inputs. SWE-PolyVision thus separates the availability of multi-image evidence from its successful use in repository-level repair, without treating patch success alone as proof of explicit reasoning.
Source:https://arxiv.org/abs/2609.29754PreviousRobustness of quantum spectrum estimation: weak Schur sampling under noisy inputsNextTesting and Verification of Quantum Compilers through Assurance Contracts and Evidence
Related posts
Qodo builds context into AI code review with Codex
0OpenAI Blog

Ford promises not to sell your driving habits to data brokers
0The Verge
Snap settles lawsuit accusing platform of fueling teen depression and eating disorders
0TechCrunch
Scrape LinkedIn job postings without logging in (Python + Google Sheets)
0dev.to
Same model, same defences: 7 document attacks down to 0, chat attacks barely moved
0dev.to
Skill to Create Product Videos
0Hacker News