AI & ML
FoundCause: A Foundation Model for Causal Discovery with Latent Confounders from Observational Data
arXiv stat.ML0 views
arXiv:2606.17516v2 Announce Type: replace-cross Abstract: Causal discovery from observational data requires recovering directed relations and latent confounding without interventions. We propose FoundCause, an {\em amortized causal discovery foundation model} trained only on synthetic structural causal models that maps datasets to causal graphs in a single forward pass. A permutation-equivariant transformer alternates attention over samples and variables to model cross-variable dependence and per-variable distributions. Pairwise dependence and asymmetry statistics guide its attention, edge decoder and confounder module. The decoder separates edge existence from direction, while triangular refinement incorporates evidence from chains and colliders. Learnable latent tokens predict which variable pairs share a hidden common cause, and a masked input representation handles missing data. To our knowledge, FoundCause is the first amortized causal discovery approach for i.i.d. observational data to predict latent confounding as a separate, explicit output. On 14 real-world and semi-synthetic datasets, FoundCause leads 11 classical and 7 amortized baselines in average AUROC, $F_1$, skeleton $F_1$, and normalized structural Hamming distance ($\mathrm{SHD}/d$): clearly in $\mathrm{SHD}/d$ ($0.875$ vs.\ $0.956$), narrowly in $F_1$ ($0.531$ vs.\ $0.516$). It also has the highest accuracy among amortized methods on bivariate cause--effect pairs.
Source:https://arxiv.org/abs/2606.17516PreviousGraph Cascades: Contagion-Based Mesoscopic Rewiring for Structure-Aware Graph Machine LearningNextRepresentation Learning with Quantum Signal Processing
Related posts
Le Groupe Figaro and OpenAI partner to bring Le Figaro journalism to ChatGPT
0OpenAI Blog
Web 上已经有 GPT-6.2,本地 Codex 却没有?先对入口,再更新客户端
0dev.to
영지식 증명 프라이버시와 규제 준수: 우리는 정말 두 마리 토끼를 다 잡을 수 있을까?
0dev.to
My context grew 6x in three months. That decides the cache question
0dev.to AI
How to connect Joist to any MCP client: Claude, ChatGPT, Cursor
0dev.to AI
Gemini Notebook cria sites interativos a partir de anotações
0dev.to AI