AI & ML
A Unified Framework for Inference with General Missingness Patterns and Machine Learning Imputation
arXiv stat.ML0 views
arXiv:2508.15162v4 Announce Type: replace-cross Abstract: Predictions from machine learning (ML) models are increasingly used to impute missing data, but their naive use risks biased inference. Existing methods provide valid inference with ML imputations regardless of prediction quality to enhance efficiency, while they are limited to either simple missing data structures or a missing-completely-at-random assumption. We develop a novel framework for valid statistical inference in Z-estimation problems using ML imputations under a missing-at-random assumption and for general missingness patterns. The method stratifies data by distinct missingness patterns and constructs an estimator by aggregating pattern-specific observed and prediction information. Theoretically, we establish the asymptotic properties and globally optimal aggregation that guarantees efficiency dominance over weighted complete-case analyses (WCCA). Practically, the method affords simple implementations by leveraging existing WCCA software. Extensive simulations validate theoretical results and show clear competitiveness in various scenarios. An analysis of All of Us data further demonstrates the utility of the method. The paper concludes with a brief discussion on practical implications and potential future directions.
Source:https://arxiv.org/abs/2508.15162PreviousDiagonally-Weighted Generalized Method of Moments Estimation for Gaussian Mixture ModelingNextFantastic Pretraining Optimizers and Where to Find Them
Related posts
Cloudflare DNS Zone Builder cuts peak memory 85% and halves build delay
0dev.to News
O dia em que a cliente pediu desconto num bolo de pistache (e pagou R$ 30 num cafe)
0dev.to Design
O telefone tocou as 19h: Por que cancelam seu contrato primeiro na crise?
0dev.to Design
Which Cursor model is best for everyday work?
0dev.to Productivity
Is AI going to get cheaper or more expensive?
0dev.to Machine Learning
Điểm tin Trí tuệ Nhân tạo & Mô hình Ngôn ngữ lớn (LLMs) tại Việt Nam (03/11/2026)
0dev.to Machine Learning