AI & ML
Deterministic Causal Quantization with Representative States and Bounded Error
arXiv math.IT0 views
arXiv:2610.35933v1 Announce Type: new Abstract: We study deterministic causal quantization with pathwise error at most $\varepsilon$, using $\omega$ shared representatives updated from transmitted addresses alone. For a midpoint realization with first-in, first-out replacement, we compare address entropy rates with process $\varepsilon$-entropy, the least entropy rate of any block quantizer meeting the same constraint. From $\varepsilon$-separated initialization, the gap is at most two bits per sample for every stationary source with finite scalar $\varepsilon$-entropy, without density, independence or mixing assumptions. A causal address-tree argument extends this comparison to any synchronized quantizer with cell overlap $m$, giving $\log_2 m$ bits. Lattice initialization with consistent boundary ownership realizes uniform grids with sharp one-bit scalar and process comparisons. Under an entropy condition and finite Fisher information rate $J$, the gap is at most $2J\varepsilon^2/(\pi^2\ln 2)$; general initializations add a term of order $\omega\varepsilon\sqrt{J}$. The scalar grid estimate gives a nonasymptotic form of R\'enyi's theorem. Since a grid is causal, the price of causality is at most $\min\{1,2J\varepsilon^2/(\pi^2\ln 2)\}$ bits per sample, versus the high-resolution squared-error loss $\tfrac12\log_2(\pi e/6)$. These bounds certify $\varepsilon$-entropy brackets for autoregressive Laplace and Gaussian sources. For memoryless sources, the optimal causal rate equals the scalar $\varepsilon$-entropy. For a stationary process on finitely many $2\varepsilon$-separated centers, adding independent uniform noise of width $2\varepsilon$ gives exact Shannon lower-bound equality at every block length, attained by storing those centers. This includes histograms with finitely many bins. Storing two non-lattice centers beats every uniform grid of the same cell width by half a bit per sample.
Source:https://arxiv.org/abs/2610.35933PreviousCost-based variable selection for prediction modelsNextStructured Time-Frequency Representation for Channel Prediction
Related posts

Affinity’s creative studio is now available on iPad for free
0The Verge

SpaceX could buy Boost Mobile as part of its big mobile carrier plans
0The Verge
Northwood Space raises $375M Series C at a $2B valuation from a16z and DFJ growth
0TechCrunch

The Download: the agentic web arrives and the drive for safer roads
0MIT Technology Review

Stop counting tokens, start counting what ships
0MIT Technology Review
OpenAI is finally merging ChatGPT’s chat and Work tabs
0TechCrunch