scholarly journals Stationary distributions via decomposition of stochastic reaction networks

2021 ◽  
Vol 82 (7) ◽  
Author(s):  
Linard Hoessly

AbstractWe examine reaction networks (CRNs) through their associated continuous-time Markov processes. Studying the dynamics of such networks is in general hard, both analytically and by simulation. In particular, stationary distributions of stochastic reaction networks are only known in some cases. We analyze class properties of the underlying continuous-time Markov chain of CRNs under the operation of join and examine conditions such that the form of the stationary distributions of a CRN is derived from the parts of the decomposed CRNs. The conditions can be easily checked in examples and allow recursive application. The theory developed enables sequential decomposition of the Markov processes and calculations of stationary distributions. Since the class of processes expressible through such networks is big and only few assumptions are made, the principle also applies to other stochastic models. We give examples of interest from CRN theory to highlight the decomposition.

2018 ◽  
Vol 26 (01) ◽  
pp. 87-106 ◽  
Author(s):  
T. MIHIRI M. DE SILVA ◽  
SOPHIA R.-J. JANG

We construct models of continuous-time Markov chain (CTMC) and Itô stochastic differential equations of population interactions based on a deterministic system of two phytoplankton and one zooplankton populations. The mechanisms of mutual interference among the predator zooplankton and the avoidance of toxin-producing phytoplankton (TPP) by zooplankton are incorporated. Sudden population extinctions occur in the stochastic models that cannot be captured in the deterministic systems. In addition, the effect of periodic toxin production by TPP is lessened when the birth and death of the populations are modeled randomly.


1994 ◽  
Vol 26 (01) ◽  
pp. 68-79
Author(s):  
P. K. Pollett ◽  
D. E. Stewart

We describe a computational procedure for evaluating the quasi-stationary distributions of a continuous-time Markov chain. Our method, which is an ‘iterative version' of Arnoldi's algorithm, is appropriate for dealing with cases where the matrix of transition rates is large and sparse, but does not exhibit a banded structure which might otherwise be usefully exploited. We illustrate the method with reference to an epidemic model and we compare the computed quasi-stationary distribution with an appropriate diffusion approximation.


1994 ◽  
Vol 26 (1) ◽  
pp. 68-79 ◽  
Author(s):  
P. K. Pollett ◽  
D. E. Stewart

We describe a computational procedure for evaluating the quasi-stationary distributions of a continuous-time Markov chain. Our method, which is an ‘iterative version' of Arnoldi's algorithm, is appropriate for dealing with cases where the matrix of transition rates is large and sparse, but does not exhibit a banded structure which might otherwise be usefully exploited. We illustrate the method with reference to an epidemic model and we compare the computed quasi-stationary distribution with an appropriate diffusion approximation.


1975 ◽  
Vol 12 (S1) ◽  
pp. 313-323
Author(s):  
J. Gani

This paper studies a Markov chain model for type counts {Xn} in a literary text. First, a homogeneous Markov chain in discrete time is considered. This is then embedded in a continuous time Poisson process; the probability generating function for the resulting continuous time Markov chain is obtained. Expectations and variances of type counts are found for different values of the token count and various sizes M of an author's vocabulary; these results are finally tested against known data for three of Shakespeare's plays.


Sign in / Sign up

Export Citation Format

Share Document