Open Markov Processes: A Compositional Perspective on Non-Equilibrium Steady States in Biology

  title={Open Markov Processes: A Compositional Perspective on Non-Equilibrium Steady States in Biology},
  author={Blake S. Pollard},
In recent work, Baez, Fong and the author introduced a framework for describing Markov processes equipped with a detailed balanced equilibrium as open systems of a certain type. These `open Markov processes' serve as the building blocks for more complicated processes. In this paper, we describe the potential application of this framework in the modeling of biological systems as open systems maintained away from equilibrium. We show that non-equilibrium steady states emerge in open systems of… 

Figures from this paper

Open Markov Processes and Reaction Networks

We define the concept of an `open' Markov process, a continuous-time Markov chain equipped with specified boundary states through which probability can flow in and out of the system. External

Open Markov Chains: Cumulant Dynamics, Fluctuations and Correlations

This work proposes a model for open Markov chains that can be interpreted as a system of non-interacting particles evolving according to the rules of a Markov chain and shows that it is possible to describe the distribution of particles over the state space through the corresponding moment generating function.

Large Deviations Properties of Maximum Entropy Markov Chains from Spike Trains

This work provides an accessible introduction to the maximum entropy Markov chain inference problem and large deviations theory to the community of computational neuroscience, avoiding some technicalities while preserving the core ideas and intuitions.

The algebra of open and interconnected systems

This thesis develops the theory of hypergraph categories and introduces the tools of decorated cospans and corelations, a more powerful version that permits construction of all hyper graph categories and hypergraph functors.

Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains

The thermodynamic formalism is used to build a framework in the context maximum entropy models to quantify the degree of time irreversibility, providing an explicit formula for the information entropy production of the inferred maximum entropy Markov chain.

Deconstructing UML, Part 1: Modeling Classes with Categories

This paper focuses on modeling UML’s structural component, as exemplified by the class diagram using CT models, and argues that the use of CT in information modeling could make the authors' models less ambiguous, more precise, and more formal.

A bicategory of decorated cospans

If $\mathbf{C}$ is a category with pullbacks then there is a bicategory with the same objects as $\mathbf{C}$, spans as morphisms, and maps of spans as 2-morphisms, as shown by Benabou. Fong has

Entropy-Based Method for Evaluating Contact Strain-Energy Distribution for Assembly Accuracy Prediction

An entropy-based evaluation method, in which the uniformity of the contact strain-energy distribution is evaluated in three levels based on entropy, is developed to predict the assembly accuracy, and a comprehensive index is proposed.

Operads for complex system design specification, analysis and synthesis

It is argued that operads provide an effective knowledge representation to address scalability challenges for complex system design and recent progress in effective modelling is described.

Categorifying the zx-calculus

We build a symmetric monoidal and compact closed bicategory by combining spans and cospans inside a topos. This can be used as a framework in which to study open networks and diagrammatic languages.



A compositional framework for Markov processes

It is proved that black boxing gives a symmetric monoidal dagger functor sending open detailed balanced Markov processes to open circuits made of linear resistors, and described how to “black box” an open Markov process.

Irreversible thermodynamics of open chemical networks. I. Emergent cycles and broken conservation laws.

The steady state entropy production rate is decompose in terms of fundamental fluxes and affinities in the spirit of Schnakenberg's theory of network thermodynamics, paving the way for the forthcoming treatment of the linear regime, of efficiency and tight coupling, of free energy transduction, and of thermodynamic constraints for network reconstruction.

A Second Law for Open Markov Processes

It is shown that the rate of change ofrelative entropy in an open Markov process is less than or equal to the flow of relative entropy through its boundary states, which can be viewed as a generalization of the Second Law.

The Chemical Master Equation Approach to Nonequilibrium Steady-State of Open Biochemical Systems: Linear Single-Molecule Enzyme Kinetics and Nonlinear Biochemical Reaction Networks

The stochastic, chemical master equation is developed as a unifying approach to the dynamics of biochemical reaction systems in a mesoscopic volume under a living environment and it is suggested that the (c) is most relevant to major cellular biochemical processes such as epi-genetic regulation, apoptosis, and cancer immunoediting.

Thermodynamics of stoichiometric biochemical networks in living systems far from equilibrium.

Open-system nonequilibrium steady state: statistical thermodynamics, fluctuations, and chemical oscillations.

  • H. Qian
  • Physics, Chemistry
    The journal of physical chemistry. B
  • 2006
A nonequilibrium statistical thermodynamic theory based on stochastic kinetics is introduced, mainly through a series of examples: single-molecule enzyme kinetics, nonlinear chemical oscillation, molecular motor, biochemical switch, and specificity amplification.

On the Validity of Entropy Production Principles for Linear Electrical Circuits

Abstract We explain the (non-)validity of close-to-equilibrium entropy production principles in the context of linear electrical circuits. Both the minimum and the maximum entropy production

Network theory of microscopic and macroscopic behavior of master equation systems

A general microscopic and macroscopic theory is developed for systems which are governed by a (linear) master equation. The theory is based on a network representation of the master equation, and the

Ètude thermodynamique des phénomènes irréversibles

SINCE 1934, the present reviewer has advanced the conception of the organism as an 'open system'. So far, physical chemistry has been concerned almost exclusively with reactions and equilibria in

Inadequacy of entropy and entropy derivatives in characterizing the steady state

In bistable systems the transition kinetics between the two locally stable states can be altered without changing the behavior in the immediate vicinity of the two favored steady states. It follows