AI & ML
NestRL: A Nested Training Regime for Mutual Adaptation in Human-AI Teaming
arXiv cs.RO0 views
arXiv:2602.17737v3 Announce Type: replace Abstract: Mutual adaptation is a central challenge in human-AI teaming, as humans naturally adjust their strategies in response to an AI agent's behavior. Existing approaches attempt to approximate human behavior by diversifying training partners; however, these partners are typically static and fail to capture the adaptive nature of human teammates. When agents are trained jointly in standard multi-agent settings, they often converge to opaque coordination strategies that work only with their co-trained partners, leading to poor generalization. To model adaptive human behavior, we formulate human-AI teaming as an Interactive Partially Observable Markov Decision Process (I-POMDP). We propose NestRL, a nested training regime that learns the solution to a finite-level I-POMDP by training agents at each level against adaptive agents from the level below. This exposes agents to adaptive behavior while preventing emergence of opaque coordination strategies. We provide theoretical analysis showing that NestRL agents avoid convergence to partner-specific strategies, and validate this empirically in the Overcooked domain against state-of-the-art baselines. NestRL achieves higher task performance with both unseen adaptive agents and real human teammates, while exhibiting significantly greater adaptability over the course of interaction.
Source:https://arxiv.org/abs/2602.17737PreviousIllumination-Robust Localization around Unknown Space Objects using Multispectral Image FusionNextGait Generation Balancing Joint Load and Mobility for Legged Modular Robots with Easily Detachable Joints
Related posts
BEVCast: Path-Adaptive BEV for Efficient End-to-End Autonomous Driving
0arXiv cs.RO
World-Model Gradient Refinement in CEM: An Empirical Study
0arXiv cs.RO
PRIME: Perception Feedback with Situational Memory Embeddings in VLA Models
0arXiv cs.RO
Rollback the World, Keep the Reflection: Rollback-Induced Reflection for Long-Horizon LLM Agents
0arXiv cs.RO
ToM-2 Understanding Statements for Teacher-Guided Preference Learning
0arXiv cs.RO
Orbis 2: A Hierarchical World Model for Driving
0arXiv cs.RO