Markov Processes and Discrete-Time Chains

2002 ◽  
pp. 140-158
Author(s):  
Olav Kallenberg
Keyword(s):  
Markov Processes ◽  
Discrete Time

Optimal control with partial interaction of two Markov processes in discrete time

Cybernetics ◽  
1976 ◽  
Vol 11 (6) ◽  
pp. 970-977
Author(s):  
N. V. Andreev ◽  
D. V. Karachenets ◽  
G. �. Massal'skii
Keyword(s):  
Optimal Control ◽  
Markov Processes ◽  
Discrete Time ◽  
Partial Interaction

Proportional intensities and strong ergodicity for Markov processes

1983 ◽  
Vol 20 (01) ◽  
pp. 185-190 ◽  
Author(s):  
Mark Scott ◽  
Dean L. Isaacson
Keyword(s):  
Markov Process ◽  
Markov Processes ◽  
Discrete Time ◽  
Continuous Time ◽  
Homogeneous Markov Process ◽  
Strong Ergodicity ◽  
Transition Functions ◽  
The Matrix ◽  
Intensity Functions ◽  
Time Point

By assuming the proportionality of the intensity functions at each time point for a continuous-time non-homogeneous Markov process, strong ergodicity for the process is determined through strong ergodicity of a related discrete-time Markov process. For processes having proportional intensities, strong ergodicity implies having the limiting matrix L satisfy L · P(s, t) = L, where P(s, t) is the matrix of transition functions.

Sign in / Sign up

Export Citation Format

Share Document