Generalization of the de Bruijn's identity to general ϕϕ-entropies and ϕϕ-Fisher informations

preprint2016arXivOpen access

Abstract

In this paper, we propose generalizations of the de Bruijn's identities based on extensions of the Shannon entropy, Fisher information and their associated divergences or relative measures. The foundation of these generalizations are the ϕϕ-entropies and divergences of the Csiszá's class (or Salicrú's class) considered within a multidimensional context, included the monodimensional case, and for several type of noisy channels characterized by a more general probability distribution beyond the well-known Gaussian noise. It is found that the gradient and/or the hessian of these entropies or divergences with respect to the noise parameters give naturally rise to generalized versions of the Fisher information or divergence, which are named as the ϕϕ-Fisher information (divergence). The obtained identities can be viewed as further extensions of the classical de Bruijn's identity. Analogously, it is shown that a similar relation holds between the ϕϕ-divergence and a extended mean-square error, named ϕϕ-mean square error, for the Gaussian channel.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.