AI & ML
More Agents, More Reliable? System-Level Reliability of Multi-Agent LLMs under Operational-Profile Uncertainty
arXiv cs.MA0 views
arXiv:2611.07140v1 Announce Type: new Abstract: Teams increasingly build software from cooperating large language model (LLM) agents, often assuming more agents mean more reliability. Yet the usual evidence, average benchmark accuracy, ignores the input mix a deployed system meets and the rule merging the agents' answers. Building on HIP-LLM, a hierarchical imprecise-probability assessment of single LLMs, we propose a framework combining it with a Bayesian network of the system's failure logic for multi-agent systems. Agent failure-probability intervals propagate through this network, where the combining rule can itself fail, into a reliability envelope showing which evidence limits it. In a pipeline extracting regulated chemical-hazard statements, majority voting over three models protected against the weakest but did not clearly exceed the best, and a voter failing on 5\% of demands would largely erase its advantage over the middle model. More agents yield a more defensible reliability claim, not automatically a more reliable system.
Source:https://arxiv.org/abs/2611.07140PreviousAuthorization Propagation in Agent2Agent Systems: An Experimental Security Evaluation of Multi-Hop DelegationNextDesign of Multi-UAV Cooperative Deep Semantic Autoencoders for Communication Networks
Related posts
CANMentor: A Large-Small Model Collaboration Framework for CAN Bus Intrusion Detection
0arXiv cs.CR
Beyond Instruction Override: Benchmarking Indirect Prompt Injection with Task-Tampering Attacks
0arXiv cs.CR
A Gingerbread House for LLM Agents: Source-Planned Honeypots That Lure Autonomous Attackers into an Isolated Shadow
0arXiv cs.CR
JailBound: FOL-Guided Jailbreak Evaluation for Exploring LLM Behavioral Boundaries
0arXiv cs.CR
Breaking $\mathsf{TraintoDefend}$ via Adaptive Neuron Clustering in Cryptanalytic Model Extraction
0arXiv cs.CR
What an LLM API Actually Costs Per Month (Real Numbers, Not List Prices)
0dev.to AI