AI & ML
Efficient control of multi-agent robust MDPs through tensor trees
arXiv cs.SY0 views
arXiv:2611.13672v1 Announce Type: new Abstract: This paper introduces a tensor-based framework for controller synthesis of stochastic multi-agent systems under temporal logic specifications that couple the agents, such as one agent reaching its goal only after another agent has reached its own. The agents are modeled as robust Markov decision processes (RMDPs), whose transition probabilities are only known to lie in an ambiguity set, for instance due to abstraction errors, learned models, or uncertain parameters. We show that the decoupled nature of the ambiguity sets allows one to decompose the computation of a lower bound on the satisfaction probabilities into per-agent factors, so that only the per-agent ambiguity sets need to be stored. This leads to improved memory complexity compared to monolithic approaches. We compare our approach with state-of-the-art approaches based on approximate simulation relations and with interval MDP abstractions. On a four-agent ordered reach-avoid benchmark, our approach certifies a lower bound twice as high as the simulation relation- based approach with 20 times less memory, and needs about 200 times less memory than the interval MDP abstraction, even at a resolution with about a million times more joint cells.
Source:https://arxiv.org/abs/2611.13672PreviousAn Accurate Modulation-Assisted Method for Phasor Estimation Under Decaying DC OffsetsNextPriority-Aware Firm and Flexible Capacity Quantification for Large-Load Interconnection
Related posts

Don't eyeball AI-generated product images. Test the text like CI.
0dev.to

An Updated Image Needs a Cache Plan, Not Another Upload
0dev.to
I got tired of breaking my LLM app with "one small prompt change", so I built a 450-line eval harness
0dev.to

Constraint Engineering
0dev.to
Sixteen AI graders, six synthetic answers: measuring rubric drift without touching live data
0dev.to
OSS projects banning AI-generated contributions
0Hacker News