AI & ML
The Metagame of Interpretability and Meta-Attributions
arXiv stat.ML0 views
arXiv:2605.06295v2 Announce Type: replace-cross Abstract: How can an arbitrary attribution method be generalized from first principles to capture interactions? We answer this with the metagame, a conceptual framework for quantifying second-order interaction effects of model explanations. We cast the attribution value $\phi_i$ of feature $i$ as a cooperative game among the other features and compute its Shapley value, which measures how much feature $j$ influences the attribution of $i$, yielding the directional meta-attribution $\varphi_{j \to i}$. By decomposing attribution itself rather than the model directly, meta-attributions extend any gradient- or attention-based method to interactions, uniting removal-based perturbations with model internals. Theoretically, we prove that meta-attributions sum to the first-order attribution they explain, a hierarchical decomposition that Shapley interactions and integrated Hessians turn out to perform implicitly. Empirically, we demonstrate that meta-attributions deliver insights across diverse interpretability applications: (i) quantifying token interactions in instruction-tuned language models, (ii) explaining cross-modal similarity in vision-language encoders, and (iii) interpreting text-to-image concepts in multimodal diffusion transformers.
Source:https://arxiv.org/abs/2605.06295PreviousBONSAI: Bayesian Optimization with Natural Simplicity and InterpretabilityNextA prism hierarchy of learning regimes in large linear autoencoders
Related posts
Stopping Is a Capability: What Two Governance Talks at Google DevFest Atlanta 2026 Had in Common
0dev.to
Criei uma plataforma para desenvolvedores brasileiros. Agora vem a parte mais difícil: fazer ela crescer.
0dev.to
Agentic backdoors via pretraining poisoning
0Hacker News
Anthropic reveals $900B AI spending commitments ahead of IPO
0Hacker News
What is AI?
0dev.to AI
Cara Mengelola Grup Telegram dengan Bot AI Gratis: Solusi Lengkap untuk Pengembang & Pemilik Grup
0dev.to AI