A Short Proof of a Convex Representation for Stationary Distributions of Markov Chains with an Application to State Space Truncation

preprint2022arXivOpen access

Abstract

In an influential paper, Courtois and Semal (1984) establish that when GG is an irreducible substochastic matrix for which ∑n=0∞Gn<∞\sum_{n=0}^{\infty}G^n <\infty, then the stationary distribution of any stochastic matrix P≥GP\ge G can be expressed as a convex combination of the normalized rows of (I−G)−1=∑n=0∞Gn(I-G)^{-1} = \sum_{n=0}^{\infty} G^n. In this note, we give a short proof of this result that extends the theory to the countably infinite and continuous state space settings. This result plays an important role in obtaining error bounds in algorithms involving nearly decomposable Markov chains, and also in state truncations for Markov chains. We also use the representation to establish a new total variation distance error bound for truncated Markov chains.

Explore this paper’s authors, topics and related work.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Reviews 0

Write a reviewWrite

No reviews yet.

Discussion 0

Add a commentWrite

No comments yet.