General
Measuring the collaboration, not the agent
arXiv cs.HC0 views
arXiv:2611.06487v1 Announce Type: new Abstract: Benchmarks for visualization agents score the agent alone; the human only supplies reference answers. For high-dimensional data this misses what matters: the knowledge of which variables count is held by on-site experts, not by the model, so the useful question is how well an analyst and an agent do together. We study one specific form of collaboration, the agent proposes a view, the analyst accepts, rejects, or modifies it, and those judgments are kept for later sessions, and propose five measures for it: complementarity, intervention efficiency, appropriate reliance, knowledge retention, and agency. The first four are computed from interaction logs alone. We test the measures, not people: in a testbed for parallel-coordinates design on public manufacturing data (UCI SECOM), with a simulated analyst whose behavior we control, all four are computable and respond to the controlled differences. Whether they reveal anything about real analysts is the next step; we release the testbed for it.
Source:https://arxiv.org/abs/2611.06487PreviousToday's Work, Tomorrow's Workforce: Incentivizing Learning in AI-Assisted WorkNextPerceived Trust and Transparency in AI-Altered vs. Human-Written LinkedIn Posts
Related posts
Zoro Coupon Codes: 20% Off November 2026
0Wired
Ray-Ban Promo Codes: Save 50% in November 2026
0Wired
Generalized and Scalable Deep Gaussian Process Emulation
0arXiv stat.CO
観測の解像度が分野を変える——Neuropixels のニュースから、分子可視化の次の窓口を考える
0dev.to Data
Joint Association and Beamforming Design for Cooperative ISAC Systems
0arXiv eess.SP
Ambiguity Elimination via Successive Estimation in ISAC Systems with Reference Signals
0arXiv eess.SP