AI & ML
Provably Reliable Classifier Guidance via Cross-Entropy Control
arXiv stat.ML0 views
arXiv:2601.21200v3 Announce Type: replace Abstract: Classifier-guided diffusion models generate conditional samples by augmenting the reverse-time score with the gradient of the log-probability predicted by a probabilistic classifier. In practice, this classifier is usually obtained by minimizing an empirical loss function. While existing statistical theory guarantees good generalization performance when the sample size is sufficiently large, it remains unclear whether such training yields an effective guidance mechanism. We study this question in the context of cross-entropy loss, which is widely used for classifier training. Under mild smoothness assumptions on the classifier, we show that controlling the cross-entropy at each diffusion model step is sufficient to control the corresponding guidance error. In particular, probabilistic classifiers achieving conditional KL divergence $\varepsilon^2$ induce guidance vectors with mean squared error $\widetilde O(d \varepsilon )$, up to constant and logarithmic factors. Our result yields an upper bound on the sampling error of classifier-guided diffusion models and bears resemblance to a reverse log-Sobolev--type inequality. To the best of our knowledge, this is the first result that quantitatively links classifier training to guidance alignment in diffusion models, providing both a theoretical explanation for the empirical success of classifier guidance, and principled guidelines for selecting classifiers that induce effective guidance.
Source:https://arxiv.org/abs/2601.21200PreviousThe Impact of Anisotropic Covariance Structure on the Training Dynamics and Generalization Error of Linear NetworksNextOn Generation in Metric Spaces
Related posts
Heated mirror reveals hidden 3D patterns in rising air near a wall
0Phys.org Tech
Infrared-transparent aerogel boosts performance of subambient daytime radiative cooling materials by up to 5.2°C
0Phys.org Tech
Tracing the online networks behind AI-generated nude images
0Phys.org Tech
Microsoft's AI Risk Report Misses This Key Detail
0Dark Reading
Introducing the Grid Protectors Program
0OpenAI Blog
The world has a new plan to save nature, but it still needs the money
0Ars Technica