AI & ML
Inconsistency between Frequentist and Bayesian inference, approximation of improper priors and permissible priors
arXiv stat.TH0 views
arXiv:2610.26422v1 Announce Type: new Abstract: Improper priors are widely used in objective Bayesian inference, although posterior propriety does not by itself guarantee coherence between Bayesian and frequentist assessments. We investigate this issue by approximating improper priors with proper priors and examining the convergence of the resulting posterior distributions. We introduce monotone $q$-vague convergence, which ensures pointwise Kullback-Leibler (KL) convergence of the posteriors, and study expected KL (EKL) convergence together with its total variation counterpart (ETV). Through continuous and discrete examples, we show that EKL convergence can depend on the sequence of compact sets used for approximation. In particular, convergence along one compact exhaustion need not extend to others. Our main result connects posterior approximation to inconsistency: strong inconsistency prevents both ETV and EKL convergence for any proper-prior approximation. Consequently, KL-permissible and TV permissible priors cannot be strongly inconsistent. We also introduce weak inconsistency and show that it may persist despite EKL convergence. Finally, a unified discrete framework covering the Flatland and Fraser-Monette-Ng paradoxes illustrates the distinction between these notions. In particular, ETV convergence need not imply EKL convergence, while the absence of weak inconsistency does not guarantee an EKL convergent compact approximation.
Source:https://arxiv.org/abs/2610.26422PreviousSingularities of Multidimensional Item Response Models and the Rank of the Fisher Information MatrixNextA Central Limit Theorem for Intrinsic Fr\'echet Means on Real Grassmannians
Related posts

LLM weak random number generator detection test
0dev.to Security

Filings: Oracle is selling $10B in common stock and $10B in bonds, as it rushes to get financing for its data center buildout and chip purchases; ORCL falls 5%+ (Kelly Cloonan/Wall Street Journal)
0Techmeme

Sources detail Anthropic's compute deal spree: 3.5GW+ of expected capacity in 2026, diversifying beyond Nvidia's AI chips to Amazon, Google, and AMD, and more (New York Times)
0Techmeme

A profile of OpenAI VP Charles Porch, an ex-Instagram executive who is rehabilitating AI's image across Hollywood and the media, including via celebrity dinners (Charlotte Klein/New York Magazine)
0Techmeme

Putin orders owners of non-state data centers to reserve 10% of capacity for Russia's IT infrastructure after Ukrainian drone attacks on Russian facilities (Reuters)
0Techmeme
Supermarket Freezers Across Europe Hit By Second Suspected Cyberattack
0Slashdot