# Information Geometry of Reversible Markov Chains

@article{Wolfer2021InformationGO,
title={Information Geometry of Reversible Markov Chains},
author={Geoffrey Wolfer and Shun Watanabe},
journal={ArXiv},
year={2021},
volume={abs/2106.05669}
}
• Published 10 June 2021
• Mathematics, Computer Science
• ArXiv
We analyze the information geometric structure of time reversibility for parametric families of irreducible transition kernels of Markov chains. We define and characterize reversible exponential families of Markov kernels, and show that irreducible and reversible Markov kernels form both a mixture family and, perhaps surprisingly, an exponential family in the set of all stochastic kernels. We propose a parametrization of the entire manifold of reversible kernels, and inspect reversible…
1 Citations
Geometric Aspects of Data-Processing of Markov Chains
• Mathematics
ArXiv
• 2022
We consider data-processing of Markov chains through the lens of information geometry. We ﬁrst develop a theory of congruent Markov morphisms in the context of Markov kernels that we show to

## References

SHOWING 1-10 OF 56 REFERENCES
On Asymptotic Exponential Family of Markov Sources and Exponential Family of Markov Kernels
• Mathematics
• 2017
The notion of exponential family [2] was extended for families of Markov chains in an asymptotic manner by Ito & Amari [10], and some variants have been proposed. The notion of exponential family
The exponential family of Markov chains and its information geometry
The method of information geometry is effectively applied to the framework, which enables us to characterize the divergence rate of Markov chain from a differential geometric viewpoint.
Information geometry of the family of Markov kernels defined by a context tree
• Computer Science, Mathematics
2017 IEEE Information Theory Workshop (ITW)
• 2017
It is proved that a tree model is an exponential family (e-family) of Markov kernels, if and only if it is an FSMX model, which is equivalent to the asymptotic e-family, which was introduced by Takeuchi & Barron ('98).
Explicit Limit Results for Minimal Sufficient Statistics and Maximum Likelihood Estimators in Some Markov Processes: Exponential Families Approach
Finite-state Markov chains with either a discrete or continuous time parameter, Markov renewal processes and Markov-additive processes are considered. We prove that their likelihood functions, in the
Computing the nearest reversible Markov chain
• Mathematics
Numer. Linear Algebra Appl.
• 2015
This paper shows how to find the closest reversible Markov chain to a given transition matrix and turns out that this matrix can be computed by solving a convex minimization problem.
A Convexity Property in the Theory of Random Variables Defined on a Finite Markov Chain
1. Summary. Let P = (pjk) be the transition matrix of an ergodic, finite Markov chain with no cyclically moving sub-classes. For each possible transition (j, k), let Hj,k(x) be a distribution
Local equivalence problem in hidden Markov model
This work addresses the equivalence problem of hidden Markov process in a local neighborhood by using the geometrical structure of hiddenMarkov process, and derives several concrete parametrizations in several natural cases.
Information geometry approach to parameter estimation in Markov chains
• Mathematics
2014 IEEE International Symposium on Information Theory
• 2014
Using a transition matrix version of the Pythagorean theorem, an asymptotically efficient estimator is given for a curved exponential family of transition matrices.
Optimal Chernoff and Hoeffding Bounds for Finite State Markov Chains
• Mathematics
• 2019
This paper develops an optimal Chernoff type bound for the probabilities of large deviations of sums $\sum_{k=1}^n f (X_k)$ where $f$ is a real-valued function and $(X_k)_{k \in \mathbb{Z}_{\ge 0}}$