AI & ML
Worst-Case Discovery and Runtime Protection for RL-Based Network Controllers
arXiv eess.SY0 views
arXiv:2605.04373v2 Announce Type: replace-cross Abstract: RL-based controllers achieve strong average-case performance in networking tasks such as congestion control and adaptive bitrate streaming. Yet their performance can degrade severely under network conditions where strong performance is still achievable. Identifying such conditions and quantifying the resulting performance gap is intractable by enumeration, while the sequential and closed-loop nature of RL controllers makes formal verification methods impractical. We present ReGuard, a framework that discovers worst-case scenarios for a given RL controller and protects it against them at inference time without retraining. ReGuard formulates scenario discovery as a bilevel regret-maximization problem, certifying a lower bound on the controller's worst-case performance gap. ReGuard then analyzes the discovered counterfactual trajectories and compiles them into lightweight logic rules that intervene only when a risky state is detected, leaving the controller's behavior unchanged otherwise. We evaluate ReGuard across three RL-based network controllers: Pensieve, Sage, and Park. ReGuard discovers scenarios in which each controller suffers a 43-64% performance loss relative to what is achievable under the same conditions. ReGuard exposes performance gaps 57% to 6 times larger than those found by the strongest baselines and shrinks those gaps by 79-85% in its first iteration via lightweight rule-based protection, iteratively driving the remaining gap toward nominal levels. ReGuard's protection extends beyond the scenarios it discovers, improving performance across a wide range of network conditions.
Source:https://arxiv.org/abs/2605.04373PreviousDirection-Dependent Path Loss Modeling in Olive Orchards for Precision AgricultureNextThermoLLM: LLM-Based Multi-Zone HVAC Control with a Spatiotemporal Context
Related posts
From Backtest to Funded Account: The Validation Checklist Prop Traders Need Before Paying
0dev.to Python
Crypto AI Vaults: 3 of 6 Beat Bitcoin, 1 Fell 30% — What That Actually Proves
0dev.to Python
AI Agents Are Trading Real Money Now — Here Is the Verified Record, Not the Hype
0dev.to Python
We recomputed 5 viral trading claims. 4 fail the baseline test.
0dev.to Python
I Built a Trading Bot with AI. It Lost 2.2%.
0dev.to Python
What to Do Before Claude Sonnet 4.5 Shuts Down on November 30, 2026
0dev.to DevOps