AI & ML
Emergent Discrimination and Polarization in Multi-Agent Systems
arXiv cs.MA0 views
arXiv:2610.22701v1 Announce Type: new Abstract: We study theoretically how discrimination and polarization can emerge in a population of learning agents. Each agent uses an adaptive linear decision layer to map a language-model embedding of an issue to a binary opinion and maintains an evolving estimate of how much it trusts every other agent. Through pairwise interactions, agents update both their decision weights and trust estimates using an online Bayesian rule derived from teacher-student learning over a noisy channel. In-context-learning experiments with large language models qualitatively reproduce the predicted opinion and trust updates. We then assign each agent one of two arbitrary group labels, A or B, and model group bias by allowing a fraction $f_b$ of agents to shift its perceived agreement with each message by a strength $b$, a bias steering prejudice, depending on whether the sender and receiver share a label. We use order parameters from statistical mechanics to connect these local dynamics to collective states and transitions. Starting from uniformly random initial conditions, simulations reveal a rich phase diagram in the $(b,f_b)$ plane, comprising four collective states: spin-glass frustrated out-group favoritism, nondiscriminatory polarization, discrimination with opinion alignment, and discrimination without opinion alignment. Which state emerges depends on both the strength and prevalence of the bias. These results show how simple local learning dynamics can generate qualitatively distinct forms of polarization and discrimination, underscoring the need for population-level safety analysis of multi-agent systems. They also suggest measurable order parameters for characterizing analogous collective states in human societies.
Source:https://arxiv.org/abs/2610.22701PreviousGossip Agents: Reputation through Opinion Dynamics over Evolving NetworksNextThought Blocks: Non-Autoregressive Latent Communication for Multi-Agent Systems via Trajectory-to-State Compilation
Related posts

This 'SMS of Death' exploit can remotely crash unpatched Android phones — without the user interacting with it in any way
0TechRadar

OpenAI wants to rebrand data centers as 'compute campuses' to try and win people over
0TechRadar

Putin demands Russian data centers supply capacity to the state in wake of Ukraine drone attacks
0Tom's Hardware

OpenAI considers rebranding data centers to 'AI compute campuses" as data center backlash intensifies
0Tom's Hardware
What tech entrepreneurs can teach scientists about failure
0Nature News

X for iPhone and iPad just added over a dozen new app icon options
09to5Mac