Backend
AgentTrustCI: Build-Time Policy, Grounding, and Trajectory Tests for Java LLM Agents
arXiv cs.SE0 views
arXiv:2611.06674v1 Announce Type: new Abstract: Infrastructure security does not establish whether an LLM agent selected an allowed tool, grounded its answer in tool output, or followed a required workflow. AgentTrustCI is a Java/JUnit 5 framework that expresses these application-layer expectations as policy, grounding, and trajectory checks over recorded traces. A deterministic replay implementation supports repeatable build-time tests; a judge interface provides an extension point for optional semantic evaluation. On 55 synthetic cases spanning seven enterprise domains, the full pipeline correctly classifies all 30 injected faults and 25 passing controls, including ten non-trivial controls, and misses none of 12 designated critical cases. Each single-layer configuration correctly classifies 35 cases because the corpus deliberately isolates ten faults per layer. A grounded answer obtained through a disallowed sequence illustrates the additional coverage of trajectory checks. Repeated measurements quantify validator execution separately from process startup and reporting. These results establish coverage of the authored regression suite, not production accuracy. We describe a production-trace validation protocol, optional LLM-judge integration, and maintenance of expectations as workflows evolve. The contribution is a practical pattern for expressing behavioral contracts within an existing Java release pipeline.
Source:https://arxiv.org/abs/2611.06674PreviousPatchCon: Patch-aware Weighted Supervised Contrastive Learning for Vulnerability DetectionNextRethinking Access Control for AI Agents: Recent Advances and Open Challenges
Related posts
How Shopify Store Optimization Helps Businesses Increase Sales and Build Customer Trust
0dev.to Design

How to Choose a Corian Mandir for a Modern Indian Home
0dev.to Productivity
Integrating AI Agents With Customer Systems: A Practical Guide
0dev.to Productivity

AI Agents for Singapore Healthcare: Build or Buy?
0dev.to Productivity

How to Build an AI-Powered eCommerce Website Using WooCommerce
0dev.to Productivity
C#: Your Code Compiled. That's Where the Good News Ends.
0dev.to C#