# Information Geometry of Reversible Markov Chains

@article{Wolfer2021InformationGO, title={Information Geometry of Reversible Markov Chains}, author={Geoffrey Wolfer and Shun Watanabe}, journal={ArXiv}, year={2021}, volume={abs/2106.05669} }

We analyze the information geometric structure of time reversibility for parametric families of irreducible transition kernels of Markov chains. We define and characterize reversible exponential families of Markov kernels, and show that irreducible and reversible Markov kernels form both a mixture family and, perhaps surprisingly, an exponential family in the set of all stochastic kernels. We propose a parametrization of the entire manifold of reversible kernels, and inspect reversible…

## One Citation

Geometric Aspects of Data-Processing of Markov Chains

- MathematicsArXiv
- 2022

We consider data-processing of Markov chains through the lens of information geometry. We ﬁrst develop a theory of congruent Markov morphisms in the context of Markov kernels that we show to…

## References

SHOWING 1-10 OF 56 REFERENCES

On Asymptotic Exponential Family of Markov Sources and Exponential Family of Markov Kernels

- Mathematics
- 2017

The notion of exponential family [2] was extended for families of Markov chains in an asymptotic manner by Ito & Amari [10], and some variants have been proposed. The notion of exponential family…

The exponential family of Markov chains and its information geometry

- Mathematics, Computer ScienceArXiv
- 2017

The method of information geometry is effectively applied to the framework, which enables us to characterize the divergence rate of Markov chain from a differential geometric viewpoint.

Information geometry of the family of Markov kernels defined by a context tree

- Computer Science, Mathematics2017 IEEE Information Theory Workshop (ITW)
- 2017

It is proved that a tree model is an exponential family (e-family) of Markov kernels, if and only if it is an FSMX model, which is equivalent to the asymptotic e-family, which was introduced by Takeuchi & Barron ('98).

Explicit Limit Results for Minimal Sufficient Statistics and Maximum Likelihood Estimators in Some Markov Processes: Exponential Families Approach

- Mathematics
- 1995

Finite-state Markov chains with either a discrete or continuous time parameter, Markov renewal processes and Markov-additive processes are considered. We prove that their likelihood functions, in the…

Computing the nearest reversible Markov chain

- MathematicsNumer. Linear Algebra Appl.
- 2015

This paper shows how to find the closest reversible Markov chain to a given transition matrix and turns out that this matrix can be computed by solving a convex minimization problem.

A Convexity Property in the Theory of Random Variables Defined on a Finite Markov Chain

- Mathematics
- 1961

1. Summary. Let P = (pjk) be the transition matrix of an ergodic, finite Markov chain with no cyclically moving sub-classes. For each possible transition (j, k), let Hj,k(x) be a distribution…

Local equivalence problem in hidden Markov model

- MathematicsInformation Geometry
- 2019

This work addresses the equivalence problem of hidden Markov process in a local neighborhood by using the geometrical structure of hiddenMarkov process, and derives several concrete parametrizations in several natural cases.

Information geometry approach to parameter estimation in Markov chains

- Mathematics2014 IEEE International Symposium on Information Theory
- 2014

Using a transition matrix version of the Pythagorean theorem, an asymptotically efficient estimator is given for a curved exponential family of transition matrices.

Optimal Chernoff and Hoeffding Bounds for Finite State Markov Chains

- Mathematics
- 2019

This paper develops an optimal Chernoff type bound for the probabilities of large deviations of sums $\sum_{k=1}^n f (X_k)$ where $f$ is a real-valued function and $(X_k)_{k \in \mathbb{Z}_{\ge 0}}$…