AI & ML
Orders between channels and implications for partial information decomposition
arXiv math.IT0 views
arXiv:2305.06021v4 Announce Type: replace Abstract: The partial information decomposition (PID) framework is concerned with decomposing the information that a set of random variables has with respect to a target variable into three types of components: redundant, synergistic, and unique. Classical information theory alone does not provide a unique way to decompose information in this manner and additional assumptions have to be made. Recently, Kolchinsky proposed a new general axiomatic approach to obtain measures of redundant information, based on choosing a preorder relation between information sources (equivalently, a preorder between communication channels). In this paper, we exploit this approach to introduce three new measures of redundant information (and the resulting decompositions) based on well-known preorders between channels, thus contributing to the enrichment of the PID landscape. We relate the new decompositions to existing ones, study some of their properties, and provide examples illustrating their novelty. As a side result, we prove that any preorder that satisfies Kolchinsky's axioms yields a decomposition that meets the axioms originally introduced by Williams and Beer when they first propose the PID.
Source:https://arxiv.org/abs/2305.06021PreviousOn derandomizing the line-point low-degree testNextA Two-Term Ziv-Zakai Bound for Multitarget DoA Estimation in MIMO Radar
Related posts
Nvidia investigating reports that CEO Jensen Huang was targeted by Chinese intelligence
0Phys.org Tech
Under fire over AI, effective altruism wants to tell its own story
0Phys.org Tech

'I am deeply sorry': Jensen Huang affair with suspected Chinese spy sees Nvidia open investigation into its CEO — but what happens next?
0TechRadar
What free AI training in Nepal can teach you before you pay for a class
0dev.to

Agents draft. People decide.
0dev.to UX

โค้ดเพิ่ม 400% แต่คุณไม่ได้เร็วขึ้น 400%: GitHub ชี้คอขวดใหม่อยู่ที่การรีวิว
0dev.to GitHub