AI & ML
Certified Decisions
arXiv stat.TH0 views
arXiv:2502.17830v2 Announce Type: replace-cross Abstract: Hypothesis tests and confidence sets are ubiquitous in empirical research, yet their connection to subsequent decision-making is often unclear. We view statistical inference as pairing recommended decisions with guarantees of their quality---or certificates---and develop a theory of certified decisions. Specifically, we attach P-certificates---upper bounds on loss that hold with probability at least $1-\alpha$---to recommended actions. We prove that it is without loss to limit attention to P-certificates generated by minimax decisions over confidence sets, or what Manski (2021) terms "as-if decisions with a set estimate." We further show that such certificates allow safe adoption decisions for ambiguity-averse downstream decision-makers. A parallel argument applies to E-certified decisions obtained from e-values in settings with unbounded loss. We illustrate this view of statistical inference through an application to economic mobility and one to AI model routing.
Source:https://arxiv.org/abs/2502.17830PreviousThe maximum distance covariance of bounded random vectorsNextCorrelation of divergency: c_delta. Being different in a similar way or not
Related posts
Qodo builds context into AI code review with Codex
0OpenAI Blog

Ford promises not to sell your driving habits to data brokers
0The Verge
Snap settles lawsuit accusing platform of fueling teen depression and eating disorders
0TechCrunch
Scrape LinkedIn job postings without logging in (Python + Google Sheets)
0dev.to
Same model, same defences: 7 document attacks down to 0, chat attacks barely moved
0dev.to
Skill to Create Product Videos
0Hacker News