Backend
A Local Agentic AI Framework to Generate Edge Case Scenarios for Safety Assurance
arXiv cs.RO0 views
arXiv:2610.13479v1 Announce Type: cross Abstract: Generating edge case scenarios is crucial for training, testing and safety assuring autonomous systems. This identifies hazardous failures to increase system reliability and robustness, ensures the system can still function safely on the boundaries of its operational design domain and learns the expected system behaviour for these edge cases. The rapid advancement in the generation and analysis capabilities of language models (LMs) has expanded their applicability and recent work has investigated LM scenario generation. However, many recent approaches rely on human-in-the-loop or rule-based strategies. This restricts the LM's ability to generate diverse and edge case scenarios; the long tail of the distribution. Our work uses local LMs in a laptop-based agentic AI framework for adaptive scenario generation. This is cheap, fully-controlled, ensures data privacy and security. It uses think, act, observe, update, and continue loops with lightweight JSON encoding to generate scenarios. We use the system requirements, system description and environment description as knowledge bases in contextual prompts for an LM to ensure scenario realism. A second, independent LM critiques each scenario using domain specific criteria so it can be refined. The refined scenarios are run in simulation and evaluation metrics collected. These metric scores are analysed and similar scenarios are created for edge cases (exploitation) or novel scenarios are generated to explore the scenario space. Post-hoc clustering using metric scores and thematic-type analysis of the rich-text scenario descriptions produced by the LM pinpoints functional gaps and their triggering conditions. This creates traceable evidence for the safety assurance case. Our work highlights the potential of a flexible and adaptive local agentic AI framework for automating edge case generation and producing traceable safety assurance evidence.
Source:https://arxiv.org/abs/2610.13479PreviousAlphaNIST: Emergent Assembly Skills from Binary Task RewardsNextMAGMA-Bench: Evaluating Long-Horizon Embodied Agents under Dynamic Tasks and Execution Failures
Related posts

Your RAG Finds Some of the Answer. I Tested 5 Chunking Strategies From This Month's Papers to See Who Finds All of It.
0dev.to
Goravel routing, route groups and controllers
0dev.to
Find and Replace in the Browser: Regex, Case Sensitivity and a Result You Can Check
0dev.to

I counted every subreddit since 2005, and "how many" depends on one definition
0dev.to
Remove EXIF Metadata in the Browser: How to Verify the Result Byte by Byte
0dev.to
I Built My Own Compiled Programming Language. Here's What I Learned.
0dev.to