Block-Structured Markov Renewal Processes

2010 ◽  
pp. 288-330
Author(s):  
Quan-Lin Li
Keyword(s):  
Renewal Processes ◽  
Markov Renewal Processes ◽  
Block Structured

Duality results for block-structured transition matrices

1999 ◽  
Vol 36 (4) ◽  
pp. 1045-1057 ◽  
Author(s):  
Yiqiang Q. Zhao ◽  
Wei Li ◽  
Attahiru Sule Alfa
Keyword(s):  
Transition Matrix ◽  
Markov Renewal Process ◽  
Renewal Processes ◽  
Transition Kernel ◽  
Transition Matrices ◽  
Duality Results ◽  
Markov Renewal Processes ◽  
The Matrix ◽  
Probabilistic Measures ◽  
Block Structured

In this paper, we consider a certain class of Markov renewal processes where the matrix of the transition kernel governing the Markov renewal process possesses some block-structured property, including repeating rows. Duality conditions and properties are obtained on two probabilistic measures which often play a key role in the analysis and computations of such a block-structured process. The method used here unifies two different concepts of duality. Applications of duality are also provided, including a characteristic theorem concerning recurrence and transience of a transition matrix with repeating rows and a batch arrival queueing model.

Duality results for block-structured transition matrices

1999 ◽  
Vol 36 (04) ◽  
pp. 1045-1057 ◽  
Author(s):  
Yiqiang Q. Zhao ◽  
Wei Li ◽  
Attahiru Sule Alfa
Keyword(s):  
Transition Matrix ◽  
Markov Renewal Process ◽  
Renewal Processes ◽  
Transition Kernel ◽  
Transition Matrices ◽  
Duality Results ◽  
Markov Renewal Processes ◽  
The Matrix ◽  
Probabilistic Measures ◽  
Block Structured

In this paper, we consider a certain class of Markov renewal processes where the matrix of the transition kernel governing the Markov renewal process possesses some block-structured property, including repeating rows. Duality conditions and properties are obtained on two probabilistic measures which often play a key role in the analysis and computations of such a block-structured process. The method used here unifies two different concepts of duality. Applications of duality are also provided, including a characteristic theorem concerning recurrence and transience of a transition matrix with repeating rows and a batch arrival queueing model.

scholarly journals Non-Homogeneous Semi-Markov and Markov Renewal Processes and Change of Measure in Credit Risk

Mathematics ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 55
Author(s):  
P.-C.G. Vassiliou
Keyword(s):  
Markov Chain ◽  
Probability Measure ◽  
Renewal Process ◽  
Markov Chain Model ◽  
Markov Renewal Process ◽  
Renewal Processes ◽  
Chain Model ◽  
Markov Renewal Processes ◽  
Risky Bonds ◽  
Markov Structure

For a G-inhomogeneous semi-Markov chain and G-inhomogeneous Markov renewal processes, we study the change from real probability measure into a forward probability measure. We find the values of risky bonds using the forward probabilities that the bond will not default up to maturity time for both processes. It is established in the form of a theorem that the forward probability measure does not alter the semi Markov structure. In addition, foundation of a G-inhohomogeneous Markov renewal process is done and a theorem is provided where it is proved that the Markov renewal process is maintained under the forward probability measure. We show that for an inhomogeneous semi-Markov there are martingales that characterize it. We show that the same is true for a Markov renewal processes. We discuss in depth the calibration of the G-inhomogeneous semi-Markov chain model and propose an algorithm for it. We conclude with an application for risky bonds.

scholarly journals Limit Theorems for Markov Renewal Processes

1964 ◽  
Vol 35 (4) ◽  
pp. 1746-1764 ◽  
Author(s):  
Ronald Pyke ◽  
Ronald Schaufele
Keyword(s):  
Limit Theorems ◽  
Renewal Processes ◽  
Markov Renewal Processes

Analysis of an M/G/1 queue with two types of impatient units

1995 ◽  
Vol 27 (03) ◽  
pp. 840-861 ◽  
Author(s):  
M. Martin ◽  
J. R. Artalejo
Keyword(s):  
Markov Chain ◽  
Performance Measures ◽  
Mathematical Analysis ◽  
Service System ◽  
Probability Distributions ◽  
Embedded Markov Chain ◽  
Renewal Processes ◽  
Stationary Probability ◽  
Markov Renewal Processes ◽  
Specific Performance

This paper deals with a service system in which the processor must serve two types of impatient units. In the case of blocking, the first type units leave the system whereas the second type units enter a pool and wait to be processed later. We develop an exhaustive analysis of the system including embedded Markov chain, fundamental period and various classical stationary probability distributions. More specific performance measures, such as the number of lost customers and other quantities, are also considered. The mathematical analysis of the model is based on the theory of Markov renewal processes, in Markov chains of M/G/l type and in expressions of ‘Takács' equation' type.

On non-singular Markov renewal processes with an application to a growth–catastrophe model

1985 ◽  
Vol 22 (02) ◽  
pp. 253-266
Author(s):  
Seppo Niemi
Keyword(s):  
Markov Process ◽  
Total Variation ◽  
Population Model ◽  
Limit Theorems ◽  
Renewal Processes ◽  
Regenerative Processes ◽  
Catastrophe Model ◽  
Markov Renewal Processes ◽  
Harris Recurrence ◽  
Forward Process

The paper is concerned with Markov renewal processes satisfying a certain non-singularity condition. The relation of this condition to irreducibility, Harris recurrence and regularity of the associated forward Markov process is studied. This enables one to prove limit theorems of a total variation type for Markov renewal processes and semi-regenerative processes by applying Orey's theorem to the forward process. The results are applied to a GI/G/1 queue and a growth-catastrophe population model.

Sign in / Sign up

Export Citation Format

Share Document