AI & ML
Birthday Estimators Are Uniformly Optimal for Renyi Entropy
arXiv math.IT0 views
arXiv:2610.28581v1 Announce Type: new Abstract: Collisions are a basic probe of unknown distributions, used for testing and for counting substructures in graphs, and they underlie R\'enyi entropy, a fundamental measure of uncertainty with applications in cryptography, machine learning, physics, and biology. Motivated by this, we study the natural birthday estimator. We prove Bernstein-type concentration for it and show that it is minimax optimal, uniformly and jointly in alphabet size, order, accuracy, and confidence, with no sample splitting, clipping, or median aggregation. This, in particular, settles the sample complexity of integer-order R\'enyi entropy estimation up to absolute constants in all regimes, closing the gap between the best known upper and lower bounds. Our concentration bound rests on a sensitivity analysis of collision count, and the matching lower bound on a sharp analysis of detecting a hidden spike in a plateau distribution.
Source:https://arxiv.org/abs/2610.28581PreviousGenerative Diffusion Models for Secure UAV-ISAC with Real-Time Target TrackingNextEntanglement Distribution in Quantum Switch Networks: Memory Limits and Achievability
Related posts

The Download: the agentic web arrives and the drive for safer roads
0MIT Technology Review

Stop counting tokens, start counting what ships
0MIT Technology Review
OpenAI is finally merging ChatGPT’s chat and Work tabs
0TechCrunch

10 Open-Source Robotics Repositories for 3D Perception, VLA Policies, and Sensor Calibration
0dev.to
My self-modifying system tried to wire a gate-passing module into its own protection enforcer. It was refused three times.
0dev.to
Last night an AI agent performed brain surgery on a mouse
0Hacker News