Backend
When the World Is the Test Suite: Agentic Intelligence for the Physical World
arXiv cs.SE0 views
arXiv:2611.22291v1 Announce Type: cross Abstract: Coding agents built to repair software now write, test, and repair programs for robots, laboratories, and industrial controllers. Unlike in software engineering, no test suite comes with the code. Whether a program works must be established by running it on a robot, in a physics simulator, or through the policies it helps to train, and such evidence is costly to obtain and can itself be wrong. As these agents take on more physical tasks, how their programs are judged matters as much as how they are written. This paper examines this emerging area, agentic intelligence for the physical world, by treating the world as the program's test suite. We organize the discussion around three questions: how agents write programs for the physical world, how these programs are tested, and how agents learn from the results. We first trace how language models for robots and software engineering agents came together, ask which software testing practices carry over to physical tests, and describe each program by where it sits relative to the actuator and by what judges it. For writing, we cover programs that act as robot policies and programs that support policy learning by producing rewards, tasks, and training worlds. For testing, we examine what physical trials cost, what traces, learned judges, simulators, and formal checks can establish in their place, and what safety requires beyond task success. For learning, we discuss how tested programs are retained as experience, in skill libraries and in model weights. Finally, we turn to benchmarks and evaluation practice and outline open challenges. Writing programs is becoming cheap, while trustworthy evidence about what they do remains costly. Progress will therefore depend on a physical counterpart of continuous integration: verification cheap enough to run often, reliable enough to trust under search, and maintained alongside the experience it validates.
Source:https://arxiv.org/abs/2611.22291PreviousOfficePrism: Benchmarking Agents on Single-Domain Operations Across Enterprise Business FunctionsNextRyBench: Runtime Verification Benchmarking Framework over Publish/Subscribe Networks
Related posts
AI-Generated Code Can Look Correct and Still Be Wrong
0dev.to
How Website Speed Affects SEO and User Experience
0dev.to
Building a Client Portal on the Retell API: The Eight Line Items Nobody Estimates
0dev.to
Why Azure for SAP Workloads Is Becoming an Important Skill for Cloud Engineers
0dev.to
Lessons from Building a Privacy-First AST & Hot-Path Code Review Assistant in Rust (and Supporting Open Source)
0dev.to
The Security+ PKI Chain of Trust, Link by Link
0dev.to