A Time-Inhomogeneous Prendiville Model with Failures and Repairs

We consider a time-inhomogeneous Markov chain with a finite state-space which models a system in which failures and repairs can occur at random time instants. The system starts from any state j (operating, F, R). Due to a failure, a transition from an operating state to F occurs after which a repair is required, so that a transition leads to the state R. Subsequently, there is a restore phase, after which the system restarts from one of the operating states. In particular, we assume that the intensity functions of failures, repairs and restores are proportional and that the birth-death process that models the system is a time-inhomogeneous Prendiville process.

STATE ESTIMATION OF A DISCRETE INHOMOGENEOUS MARKOV CHAIN

The problem of constructing a state estimation of inhomogeneous finite Markov chain based on a Luenberger observer is solved. The conditions of existence of the observer are defined. An algorithm for synthesizing the observer is described.

Stability Estimates for Finite-Dimensional Distributions of Time-Inhomogeneous Markov Chains

This paper is devoted to the study of the stability of finite-dimensional distribution of time-inhomogeneous, discrete-time Markov chains on a general state space. The main result of the paper provides an estimate for the absolute difference of finite-dimensional distributions of a given time-inhomogeneous Markov chain and its perturbed version. By perturbation, we mean here small changes in the transition probabilities. Stability estimates are obtained using the coupling method.

A NOTE ON RÉNYI'S ENTROPY RATE FOR TIME-INHOMOGENEOUS MARKOV CHAINS

In this note, we use the Perron–Frobenius theorem to obtain the Rényi's entropy rate for a time-inhomogeneous Markov chain whose transition matrices converge to a primitive matrix. As direct corollaries, we also obtain the Rényi's entropy rate for asymptotic circular Markov chain and the Rényi's divergence rate between two time-inhomogeneous Markov chains.