Transient study of Markov models with time-dependent transition rates

Author(s):  
Narayanan C. Viswanath
Test ◽  
2000 ◽  
Vol 9 (2) ◽  
pp. 353-370 ◽  
Author(s):  
Rafael Pérez-Ocón ◽  
J. Eloy Ruiz-Castro ◽  
M. Luz Gámiz-Pérez

1968 ◽  
Vol 5 (02) ◽  
pp. 334-349 ◽  
Author(s):  
Prem S. Puri

SummaryTwo cases of multiple linearly interconnected linear birth and death processes are considered. It is found that in general the solution of the Kolmogorov differential equations for the probability generating function (p.g.f)gof the random variables involved is not obtainable by standard methods, although one can obtain moments of the random variables from these equations. A method is considered for obtaining an approximate solution forg.This is based on the introduction of a sequence of stochastic processes such that the sequence {f(n)} of their p.g.f.'s tends togasn → ∞in an appropriate manner. The method is applied to the simple case of two birth and death processes with birth and death rates λiandμi, i =1,2, interconnected linearly with transition rates v andδ(see Figure 2). For this case some limit theorems are established and the probability of ultimate extinction of both the processes is considered. In addition, for the special cases (i) λ1=δ= 0, with the remaining rates time dependent and (ii) λ2=δ= 0, with the remaining rates constant, explicit solutions forgare obtained and studied.


1982 ◽  
Vol 14 (02) ◽  
pp. 295-308 ◽  
Author(s):  
G. Fayolle ◽  
P. J. B. King ◽  
I. Mitrani

A class of two-dimensional birth-and-death processes, with applications in many modelling problems, is defined and analysed in the steady state. These are processes whose instantaneous transition rates are state-dependent in a restricted way. Generating functions for the steady-state distribution are obtained by solving a functional equation in two variables. That solution method lends itself readily to numerical implementation. Some aspects of the numerical solution are discussed, using a particular model as an example.


2016 ◽  
Vol 48 (2) ◽  
pp. 423-442 ◽  
Author(s):  
Kristian Buchardt

Abstract Affine processes possess the property that expectations of exponential affine transformations are given by a set of Riccati differential equations, which is the main feature of this popular class of processes. In this paper we generalise these results for expectations of more general transformations. This is of interest in, e.g. doubly stochastic Markov models, in particular in life insurance. When using affine processes for modelling the transition rates and interest rate, the results presented allow for easy calculation of transition probabilities and expected present values.


1982 ◽  
Vol 14 (2) ◽  
pp. 295-308 ◽  
Author(s):  
G. Fayolle ◽  
P. J. B. King ◽  
I. Mitrani

A class of two-dimensional birth-and-death processes, with applications in many modelling problems, is defined and analysed in the steady state. These are processes whose instantaneous transition rates are state-dependent in a restricted way. Generating functions for the steady-state distribution are obtained by solving a functional equation in two variables. That solution method lends itself readily to numerical implementation. Some aspects of the numerical solution are discussed, using a particular model as an example.


Sign in / Sign up

Export Citation Format

Share Document