Abstract
The principal inertia components of the joint distribution of two random variables and are inherently connected to how an observation of is statistically related to a hidden variable . In this paper, we explore this connection within an information theoretic framework. We show that, under certain symmetry conditions, the principal inertia components play an important role in estimating one-bit functions of , namely , given an observation of . In particular, the principal inertia components bear an interpretation as filter coefficients in the linear transformation of into . This interpretation naturally leads to the conjecture that the mutual information between and is maximized when all the principal inertia components have equal value. We also study the role of the principal inertia components in the Markov chain , where and are binary random variables. We illustrate our results for the setting where and are binary strings and is the result of sending through an additive noise binary channel.
Connections
Explore this paper’s authors, topics and related work.
Building this map preview
BZPEER is loading the nearby papers, people, topics and institutions for this page.
Reviews 0
Write a review
No reviews yet.
Discussion 0
Add a comment
No comments yet.