AI & ML
Embedding-Bias in Conditional Independence Testing
arXiv stat.ML0 views
arXiv:2610.11584v1 Announce Type: new Abstract: To test conditional independence of $X$ and $Y$ given a text or an image $Z$, one conditions on an embedding $\psi(Z)$ in place of $Z$. The embedded test is valid if $Z$ is independent of $X$ or of $Y$ given $\psi(Z)$, which cannot be confirmed from data, and when this fails, the rejection probability under the null hypothesis can tend to one. We study this failure, and show that focusing on a specific form of dependence relaxes what the embedding must retain. For a residual correlation test inspired by the Generalised Covariance Measure, validity only requires that the parts of $\mathbb{E}[X \mid Z]$ and $\mathbb{E}[Y \mid Z]$ missed by $\mathbb{E}[X \mid \psi(Z)]$ and $\mathbb{E}[Y \mid \psi(Z)]$ are uncorrelated. Otherwise, we treat the discarded information as an omitted variable. Under the null hypothesis, the bias equals the absolute correlation of the missed parts times the geometric mean of two partial $R^2$ values. This identity yields a robust test valid under a declared tolerance for the geometric mean, which, like a sensitivity parameter, is not identified from the data. On synthetic data and text embeddings, the robust test holds its level approximately. On text generated by a language model, under an exact null hypothesis, every embedding, even the generator's own states, biases the embedded test.
Source:https://arxiv.org/abs/2610.11584PreviousLAIR-Net: Leaky Alignment-Impulse Residual Networks for Tabular RegressionNextMinimax Gaussian Mechanisms for Continual Machine Unlearning
Related posts

Always-on Apple Watch display showing the wrong time? Here’s the fix
09to5Mac

Affinity for iPad all-in-one design app now available, free for individuals
09to5Mac

Affinity’s creative studio is now available on iPad for free
0The Verge

SpaceX could buy Boost Mobile as part of its big mobile carrier plans
0The Verge
Northwood Space raises $375M Series C at a $2B valuation from a16z and DFJ growth
0TechCrunch

The Download: the agentic web arrives and the drive for safer roads
0MIT Technology Review