AI & ML
Approximation of differential entropy in Bayesian optimal experimental design
arXiv stat.CO0 views
arXiv:2510.00734v2 Announce Type: replace-cross Abstract: Bayesian optimal experimental design provides a principled framework for selecting experimental configurations that maximize obtained information. In this work, we consider settings where the likelihood entropy is independent of the design or can be evaluated explicitly, which applies, e.g. to additive noise models with design-independent or explicitly computable noise entropy. This reduces the problem to maximum entropy estimation, where the nested integral defining the expected information gain collapses into a single integral. Our study is motivated by large-scale inference problems, such as inverse problems, where the computational cost is dominated by expensive likelihood evaluations. Under additive Gaussian noise model, we propose a computational approach in which the evidence density is approximated by a Monte Carlo or quasi-Monte Carlo surrogate, while the differential entropy is evaluated using standard methods without additional likelihood evaluations. We prove that this strategy achieves convergence rates that are comparable to, or better than, state-of-the-art methods for full expected information gain estimation, particularly when the cost of entropy evaluation is negligible. Our approach relies only on mild smoothness of the forward map and avoids stronger technical assumptions required in earlier work. We also present numerical experiments, which confirm some of our theoretical findings.
Source:https://arxiv.org/abs/2510.00734Previousbayprior: Structured Bayesian Prior Elicitation, Conflict Diagnostics, and Regulatory ReportingNextSAT-sampling for statistical significance testing in sparse contingency tables
Related posts

The cassette player renaissance continues with this Bluetooth-toting high-tech Kickstarter model
0TechRadar

FBI confirms it thinks North Korean hackers hit Binance in record cryptocurrency heist
0TechRadar

These 3 hand-cranked radios are affordable and offer extra features
0TechRadar

This new Windows malware steals all your data, then uses AI to rank how valuable you are as a victim
0TechRadar

Musk's AI Odyssey fails to rival Christopher Nolan
0TechRadar

How to watch Tall Tales & Murder for free — Watch online from anywhere
0TechRadar