AI & ML
Active Inference via Incentive Design: Eliciting Divergent Behaviors under Partial Observability
arXiv cs.SY0 views
arXiv:2502.07065v2 Announce Type: replace Abstract: We introduce Active Inference through Incentive Design, a framework in which a leader offers strategic incentive to elicit diverging behaviors from followers of different types, thereby improving intent inference under imperfect observations. We analyze two settings: Case 1: a perfectly observable leader with two homogeneous followers with different original/unmodified reward functions, under the assumption that followers' best responses induce Gibbs trajectory distributions in their respective Markov decision processes, we show that this inference problem can be reformulated as maximizing the difference in expected cumulative return, under a modified reward for one follower, between the best-response policies of the two followers; Case 2 considers a partially observable leader who aims to distinguish among heterogeneous followers differing in dynamics and/or rewards. The leader balances incentive cost against information gain, measured by the posterior entropy over follower types, consider the follower's best responses to the incentive design. We develop an efficient first-order gradient-based algorithm to optimize the information-theoretic inference objective. Experiments in stochastic gridworld environments demonstrate significant improvements in both inference accuracy and efficiency over unincentivized baselines.
Source:https://arxiv.org/abs/2502.07065PreviousGeneral-Sum Markov Games with Borel Spaces: Existence of Approximate Nash Equilibria via Finite Model Approximations under Setwise or Weak ContinuityNextEstimating Density Functions for Probabilistic Power Flow Using Invertible Neural Networks
Related posts

The Download: the agentic web arrives and the drive for safer roads
0MIT Technology Review

Stop counting tokens, start counting what ships
0MIT Technology Review
OpenAI is finally merging ChatGPT’s chat and Work tabs
0TechCrunch

10 Open-Source Robotics Repositories for 3D Perception, VLA Policies, and Sensor Calibration
0dev.to
My self-modifying system tried to wire a gate-passing module into its own protection enforcer. It was refused three times.
0dev.to
Last night an AI agent performed brain surgery on a mouse
0Hacker News