Hybrid pathwise sensitivity methods for discrete stochastic models of chemical reaction systems.

  title={Hybrid pathwise sensitivity methods for discrete stochastic models of chemical reaction systems.},
  author={Elizabeth Skubak Wolf and David F. Anderson},
  journal={The Journal of chemical physics},
  volume={142 3},
Stochastic models are often used to help understand the behavior of intracellular biochemical processes. The most common such models are continuous time Markov chains (CTMCs). Parametric sensitivities, which are derivatives of expectations of model output quantities with respect to model parameters, are useful in this setting for a variety of applications. In this paper, we introduce a class of hybrid pathwise differentiation methods for the numerical estimation of parametric sensitivities. The… 

Figures and Tables from this paper

Sensitivity estimation for stochastic models of biochemical reaction networks in the presence of extrinsic variability.

A novel estimation algorithm is proposed that makes use of a marginalization of the path distribution of stochasticreaction networks and leads to Rao-Blackwellized estimators with reduced variance.

Variance of finite difference methods for reaction networks with non-Lipschitz rate functions

Binary systems with or without time-dependent rate parameters, a class of models that accounts for the vast majority of systems considered in the literature, satisfy the assumptions of the theory.

An efficient and unbiased method for sensitivity analysis of stochastic reaction networks

This paper proposes a new method for sensitivity estimation, which combines the computational efficiency of finite-difference methods with the accuracy of unbiased schemes, and relies on an exact representation of parameter sensitivity that was recently proved elsewhere.

Variance decomposition in stochastic simulators.

By judiciously exploiting the inherent stochasticity of the system, one is able to quantify the variance-based sensitivities associated with individual reaction channels, as well as the importance of channel interactions.

Efficiency of the Girsanov Transformation Approach for Parametric Sensitivity Analysis of Stochastic Chemical Kinetics

Theoretical justification for observations in terms of system size asymptotic analysis under what is known as the classical scaling is provided and the order estimates are sharp and that the variance of the RPD method scales similarly to the FD methods.

Uncertainty quantification for generalized Langevin dynamics.

The optimality of the common random path coupling is demonstrated in the sense that it produces a minimal variance surrogate for the difference estimator relative to sampling dynamics driven by independent paths.

Stochastic averaging and sensitivity analysis for two scale reaction networks.

This work presents stochastic averaging techniques to accelerate computations for obtaining estimates of expected values and sensitivities with respect to the steady state distribution and proposes the use of a centered ergodic likelihood ratio method for steady state estimation.

Efficient estimators for likelihood ratio sensitivity indices of complex stochastic dynamics.

We demonstrate that centered likelihood ratio estimators for the sensitivity indices of complex stochastic dynamics are highly efficient with low, constant in time variance and consequently they are

Global sensitivity analysis in stochastic simulators of uncertain reaction networks.

This work proposes an original global sensitivity analysis method where the parametric and inherent variability sources are both treated through Sobol's decomposition of the variance into contributions from arbitrary subset of uncertain parameters and stochastic reaction channels.



A pathwise derivative approach to the computation of parameter sensitivities in discrete stochastic chemical systems.

The new regularized pathwise derivative method is shown to be able to accurately estimate the sensitivities for many realistic problems and path functionals, and in many cases outperforms alternative sensitivity methods, including the Girsanov likelihood ratio estimator and common reaction path finite difference method.

Sensitivity analysis for stochastic chemical reaction networks with multiple time-scales

It is proved that under some conditions, the sensitivity values for the reduced model can be used to approximately recover the sensitivityvalues for the original model.

An Efficient Finite Difference Method for Parameter Sensitivities of Continuous Time Markov Chains

An efficient finite difference method for the computation of parameter sensitivities that is applicable to a wide class of continuous time Markov chain models and produces an estimator with a lower variance than other methods, including the use of common random numbers, in most situations.

Comparison of finite difference based methods to obtain sensitivities of stochastic chemical kinetic models.

The superiority of the CFD estimator over the common random number (CRN) estimator in a number of scenarios not considered previously in the literature, including the sensitivity of a negative log likelihood function for parameter estimation, the of being in a rare state, and a sensitivity with fast fluctuating species are demonstrated.

A finite difference method for estimating second order parameter sensitivities of discrete stochastic chemical reaction networks.

We present an efficient finite difference method for the approximation of second derivatives, with respect to system parameters, of expectations for a class of discrete stochastic chemical reaction

An asymptotic relationship between coupling methods for stochastically modeled population processes

This paper elucidates a relationship between two common coupling methods for the continuous time Markov chain models utilized in the cell biology literature by showing a connection between the common reaction path (CRP) method and the split coupling (SC) method, which is termed coupled finite differences (CFD) in the parametric sensitivities literature.

Efficient computation of parameter sensitivities of discrete stochastic chemical reaction networks.

This paper introduces the common random number (CRN) method in conjunction with Gillespie's stochastic simulation algorithm, which exploits positive correlations obtained by using CRNs for nominal and perturbed parameters, and proposes a new method called the common reaction path (CRP) method, which uses CRNs together with the random time change representation of discrete state Markov processes due to Kurtz.

Multilevel Monte Carlo for Continuous Time Markov Chains, with Applications in Biochemical Kinetics

We show how to extend a recently proposed multi-level Monte Carlo approach to the continuous time Markov chain setting, thereby greatly lowering the computational complexity needed to compute

Efficient Exact Stochastic Simulation of Chemical Systems with Many Species and Many Channels

The Next Reaction Method is presented, an exact algorithm to simulate coupled chemical reactions that uses only a single random number per simulation event, and is also efficient.

Continuous Time Markov Chain Models for Chemical Reaction Networks

This chapter develops much of the mathematical machinery needed to describe the stochastic models of reaction networks and shows how to derive the deterministic law of mass action from the Markov chain model.