AI & ML
More Agents, More Reliable? System-Level Reliability of Multi-Agent LLMs under Operational-Profile Uncertainty
arXiv cs.MA0 views
arXiv:2611.07140v1 Announce Type: new Abstract: Teams increasingly build software from cooperating large language model (LLM) agents, often assuming more agents mean more reliability. Yet the usual evidence, average benchmark accuracy, ignores the input mix a deployed system meets and the rule merging the agents' answers. Building on HIP-LLM, a hierarchical imprecise-probability assessment of single LLMs, we propose a framework combining it with a Bayesian network of the system's failure logic for multi-agent systems. Agent failure-probability intervals propagate through this network, where the combining rule can itself fail, into a reliability envelope showing which evidence limits it. In a pipeline extracting regulated chemical-hazard statements, majority voting over three models protected against the weakest but did not clearly exceed the best, and a voter failing on 5\% of demands would largely erase its advantage over the middle model. More agents yield a more defensible reliability claim, not automatically a more reliable system.
Source:https://arxiv.org/abs/2611.07140PreviousAuthorization Propagation in Agent2Agent Systems: An Experimental Security Evaluation of Multi-Hop DelegationNextDesign of Multi-UAV Cooperative Deep Semantic Autoencoders for Communication Networks
Related posts
Expanding Teen Account Protections to Teens Around the World
0Meta Newsroom
Tối ưu hóa hiệu suất đầu ra: Tiền vệ Njie vực dậy hàng công Fiorentina với 5 lần in dấu giày
0dev.to Data
Hiệu suất săn bàn ấn tượng của Gouiri thúc đẩy chuỗi toàn thắng của Marseille
0dev.to Data
Hiệu suất săn bàn vượt trội của Kylian Mbappé trong màu áo Real Madrid
0dev.to Data
Hiệu suất toàn diện đưa Harry Kane vượt mặt Kylian Mbappe và Lamine Yamal trên bình diện thế giới
0dev.to Data
How Many .com Names Appear and Disappear Each Day?
0dev.to Data