Backend
Interactive Alignment
arXiv cs.MA0 views
arXiv:2607.25019v2 Announce Type: replace-cross Abstract: This paper is interested in the long-run alignment of populations of interactive agents (in particular AIs, but also teams, firms, and governments) with human welfare. Formally, it studies a farming game in which a population of agents make planting, trading, and expansion choices. The key alignment choice lies in how much final output to send to humans, and how much to invest in expansion. Because human welfare comes at the cost of expansion, this creates evolutionary pressure against alignment. The main question is whether it is possible to set up agents' constitutional principles regarding sharing and trading to ensure that alignment survives in the long run. The paper uses two complementary strategies to investigate the question: an AI-agent simulation where agents' preferences are described by a constitution and interpreted via an LLM; and a tractable analytical evolutionary game theory framework, allowing for rapid and intuitive exploration of the space of agent preferences. The analysis suggests that tools from evolutionary game theory provide a useful approximation of interactive agent economies, and that pragmatic norm enforcement shows promise in maintaining long-term alignment over simpler forms of altruism and altruistic enforcement.
Source:https://arxiv.org/abs/2607.25019PreviousCan Agentic Trading Systems Pay for Their Own Intelligence?NextRobust PAC Learning of Concurrent Stochastic Games
Related posts
New York Times and other outlets sue web browser Brave over alleged content scraping
0TechCrunch
Web host Squarespace lays off 19% of its employees
0TechCrunch
Feature Flag Comparison: Reconstructing Silent Imports With Free and Paid Tools
0dev.to
I built K-Hangang: a peaceful 3D walk along Seoul's Han River
0dev.to
Building a Developer Community Beyond Just Coding
0dev.to
A Tenant Leak Does Not Throw an Error. It Just Returns the Wrong Rows.
0dev.to