Backend
Beyond Task Reward: A Controller-Restriction Protocol for Evaluating Embodiment-Dependent Competence
arXiv cs.RO0 views
arXiv:2610.07629v1 Announce Type: new Abstract: Co-design methods optimize a robot's body and controller jointly and judge the result by one number, the task reward of the fully optimized pair. That number cannot separate morphologies whose competence depends on the controller to very different degrees. We evaluate a morphology by restricting its controller instead, recording the task competence it retains under an explicitly declared, low-complexity controller family, environment, task and search budget. On three EvoGym locomotion tasks, task reward explains only $39\%$, $33\%$ and $10\%$ of the variance in this quantity, and geometric descriptors do not predict it under run-grouped cross-validation. The measurement is reliable across optimizer restarts (ICC$(2,k) = 0.956$--$0.986$) but depends on the declared family: phasing the drive by actuator index instead of position ranks the same morphologies at Spearman $0.50$--$0.63$ and reverses reward-matched pairs. As a second search objective the axis improved competence at matched task reward in $3$ of $5$ paired runs, short of a pre-registered bar of $4$. Used after an ordinary reward-only search instead, to choose within its top task-reward band, it selected a different body in all $8$ runs offering a choice, at a cost of at most $0.10$ reward units, and in $6$ of $8$ that body also scored higher under a held-out family. Restricted-control competence is therefore a reportable property of a co-designed morphology, interpretable only with the controller family that defines it.
Source:https://arxiv.org/abs/2610.07629PreviousTacZero: Training-Free Peg Insertion Using a General-Purpose Vision-Language Model with Tactile FeedbackNextOntoPlan: An Ontology-Grounded Scene Representation and Agentic Framework for Scalable Robot Task Planning
Related posts

The Roofline Model for LLM Inference
0dev.to Machine Learning
Deduplicate Your RAG Corpus Without Losing Its Citations
0dev.to Machine Learning

scm2cpp-learn: 44 scikit-learn estimators, same results, up to ~1000x faster
0dev.to Machine Learning
Marvell is buying Lumentum for $115B: what the optical bet means for AI cluster power, and what a fixed 4.5x exchange ratio really locks in
0dev.to Machine Learning
Terminal-Bench 2.0 vs 2.1 on Hugging Face: A 2.1 Score Is Ranked First on the 2.0 Board
0dev.to Machine Learning
How to read a failed CI log: find the first real cause in under a minute
0dev.to Tutorial