scholarly journals Structural classification of continuous time Markov chains with applications

Stochastics ◽  
2021 ◽  
pp. 1-28
Author(s):  
Chuang Xu ◽  
Mads Christian Hansen ◽  
Carsten Wiuf
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Structural Classification ◽  
Continuous Time Markov Chains

scholarly journals Trace Machines for Observing Continuous-Time Markov Chains

2006 ◽  
Vol 153 (2) ◽  
pp. 259-277 ◽  
Author(s):  
Verena Wolf ◽  
Christel Baier ◽  
Mila Majster-Cederbaum
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
Continuous Time Markov Chains

Bounds and Approximations for the Transient Behavior of Continuous-Time Markov Chains

1989 ◽  
Vol 3 (2) ◽  
pp. 175-198 ◽  
Author(s):  
Bok Sik Yoon ◽  
J. George Shanthikumar
Keyword(s):  
Markov Chains ◽  
Continuous Time ◽  
First Passage Time ◽  
Transient Behavior ◽  
Passage Time ◽  
Lower And Upper Bounds ◽  
Simple Method ◽  
Continuous Time Markov Chains ◽  
Recent Addition ◽  
Dependent Probability

Discretization is a simple, yet powerful tool in obtaining time-dependent probability distribution of continuous-time Markov chains. One of the most commonly used approaches is uniformization. A recent addition to such approaches is an external uniformization technique. In this paper, we briefly review these different approaches, propose some new approaches, and discuss their performances based on theoretical bounds and empirical computational results. A simple method to get lower and upper bounds for first passage time distribution is also proposed.

Sign in / Sign up

Export Citation Format

Share Document