Duality results for block-structured transition matrices

1999 ◽  
Vol 36 (4) ◽  
pp. 1045-1057 ◽  
Author(s):  
Yiqiang Q. Zhao ◽  
Wei Li ◽  
Attahiru Sule Alfa

In this paper, we consider a certain class of Markov renewal processes where the matrix of the transition kernel governing the Markov renewal process possesses some block-structured property, including repeating rows. Duality conditions and properties are obtained on two probabilistic measures which often play a key role in the analysis and computations of such a block-structured process. The method used here unifies two different concepts of duality. Applications of duality are also provided, including a characteristic theorem concerning recurrence and transience of a transition matrix with repeating rows and a batch arrival queueing model.

1999 ◽  
Vol 36 (04) ◽  
pp. 1045-1057 ◽  
Author(s):  
Yiqiang Q. Zhao ◽  
Wei Li ◽  
Attahiru Sule Alfa

In this paper, we consider a certain class of Markov renewal processes where the matrix of the transition kernel governing the Markov renewal process possesses some block-structured property, including repeating rows. Duality conditions and properties are obtained on two probabilistic measures which often play a key role in the analysis and computations of such a block-structured process. The method used here unifies two different concepts of duality. Applications of duality are also provided, including a characteristic theorem concerning recurrence and transience of a transition matrix with repeating rows and a batch arrival queueing model.


Mathematics ◽  
2020 ◽  
Vol 9 (1) ◽  
pp. 55
Author(s):  
P.-C.G. Vassiliou

For a G-inhomogeneous semi-Markov chain and G-inhomogeneous Markov renewal processes, we study the change from real probability measure into a forward probability measure. We find the values of risky bonds using the forward probabilities that the bond will not default up to maturity time for both processes. It is established in the form of a theorem that the forward probability measure does not alter the semi Markov structure. In addition, foundation of a G-inhohomogeneous Markov renewal process is done and a theorem is provided where it is proved that the Markov renewal process is maintained under the forward probability measure. We show that for an inhomogeneous semi-Markov there are martingales that characterize it. We show that the same is true for a Markov renewal processes. We discuss in depth the calibration of the G-inhomogeneous semi-Markov chain model and propose an algorithm for it. We conclude with an application for risky bonds.


2019 ◽  
Vol 71 (6) ◽  
pp. 1351-1366
Author(s):  
Daniel Bump ◽  
Maki Nakasuji

AbstractA problem in representation theory of $p$-adic groups is the computation of the Casselman basis of Iwahori fixed vectors in the spherical principal series representations, which are dual to the intertwining integrals. We shall express the transition matrix $(m_{u,v})$ of the Casselman basis to another natural basis in terms of certain polynomials that are deformations of the Kazhdan–Lusztig R-polynomials. As an application we will obtain certain new functional equations for these transition matrices under the algebraic involution sending the residue cardinality $q$ to $q^{-1}$. We will also obtain a new proof of a surprising result of Nakasuji and Naruse that relates the matrix $(m_{u,v})$ to its inverse.


1981 ◽  
Vol 18 (03) ◽  
pp. 752-756
Author(s):  
Per Kragh Andersen

A Markov renewal theorem necessary for the derivation of the moment formulas for a filtered Markov renewal process stated by Marcus (1974) is proved and its applications are outlined.


1992 ◽  
Vol 29 (01) ◽  
pp. 116-128 ◽  
Author(s):  
C. Y. Teresa Lam

In this paper, we study the new better than used in expectation (NBUE) and new worse than used in expectation (NWUE) properties of Markov renewal processes. We show that a Markov renewal process belongs to a more general class of stochastic processes encountered in reliability or maintenance applications. We present sufficient conditions such that the first-passage times of these processes are new better than used in expectation. The results are applied to the study of shock and repair models, random repair time processes, inventory, and queueing models.


1968 ◽  
Vol 5 (2) ◽  
pp. 387-400 ◽  
Author(s):  
Jozef L. Teugels

In [3], Kendall proved a solidarity theorem for irreducible denumerable discrete time Markov chains. Vere-Jones refined Kendall's theorem by obtaining uniform estimates [14], while Kingman proved analogous results for an irreducible continuous time Markov chain [4], [5].We derive similar solidarity theorems for an irreducible Markov renewal process. The transient case is discussed in Section 3, and Section 4 deals with the positive recurrent case. Recently Cheong also proved solidarity theorems for Semi-Markov processes [1]. His theorems use the Markovian structure, while our emphasis is on the renewal aspects of Markov renewal processes.An application to the M/G/1 queue is included in the last section.


1969 ◽  
Vol 1 (02) ◽  
pp. 188-210 ◽  
Author(s):  
Jeffrey J. Hunter

Recently Kshirsagar and Gupta [5] obtained expressions for the asymptotic values of the first two moments of a Markov renewal process. The method they employed involved formal inversion of matrices of Laplace-Stieltjes transforms. Their method also required the imposition of a non-singularity condition. In this paper we derive the asymptotic values using known renewal theoretic results. This method of approach utilises the fundamental matrix of the imbedded ergodic Markov chain and the theory of generalised matrix inverses. Although our results differ in form from those obtained by Kshirsagar and Gupta [5] we show that they reduce to their results under the added non-singularity condition. As a by-product of the derivation we find explicit expressions for the moments of the first passage time distributions in the associated semi-Markov process, generalising the results of Kemeny and Snell [4] obtained for Markov chains.


2007 ◽  
Vol 44 (02) ◽  
pp. 366-378
Author(s):  
Steven P. Clark ◽  
Peter C. Kiessler

For a Markov renewal process where the time parameter is discrete, we present a novel method for calculating the asymptotic variance. Our approach is based on the key renewal theorem and is applicable even when the state space of the Markov chain is countably infinite.


Sign in / Sign up

Export Citation Format

Share Document