AI & ML
Alignment Myopia in Generative AI
arXiv stat.ML0 views
arXiv:2611.06830v1 Announce Type: new Abstract: Current generative AI alignment relies on a myopic paradigm that prioritizes immediate conversational satisfaction. By relying on short-horizon feedback, this approach ignores the profound, longitudinal externalities of persistent human-AI interaction, which can lead to adverse outcomes such as cognitive atrophy, social erosion, and diminished human agency. To address this, we propose a paradigm shift toward long-horizon alignment that accounts for how AI reshapes human experience over time. To this end, we map the tensions between near-term utility and long-term costs of AI use across four facets of human well-being to reveal outcomes that current reward models fail to capture. Ultimately, we advocate for moving beyond simple preference optimization toward alignment strategies that actively foster long-term human well-being by navigating these complex temporal scales.
Source:https://arxiv.org/abs/2611.06830PreviousTestBED: An Open-Source Toolkit for Bayesian Experimental DesignNextTight Lower Bounds under Matched High-Order H\"older Smoothness and Uniform Convexity
Related posts
A Graph-Based Conceptual Modeling Framework to Design for Human-Robot Coordination
0arXiv cs.RO
Learning Soft Robotic Dynamics with Active Exploration
0arXiv cs.RO
MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation
0arXiv cs.RO
Reinforcement Learning Enables Scaling Generalist Robot Policy Improvement
0arXiv cs.RO
WayPOP: A Panoramic Open-Set Panoptic Tracking Benchmark
0arXiv cs.RO
Beyond Accuracy: Information-Theoretic Decoder Evaluation Under Latent Intent
0arXiv cs.RO