Stabilité de la récurrence nulle pour certaines chaines de Markov perturbées

1983 ◽  
Vol 20 (3) ◽  
pp. 482-504 ◽  
Author(s):  
C. Cocozza-Thivent ◽  
C. Kipnis ◽  
M. Roussignol
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Transition Probability ◽  
The Other ◽  
Barrier Functions ◽  
One Step ◽  
Null Recurrence ◽  
Step Transition ◽  
The One ◽  
Taylor's Formula

We investigate how the property of null-recurrence is preserved for Markov chains under a perturbation of the transition probability. After recalling some useful criteria in terms of the one-step transition nucleus we present two methods to determine barrier functions, one in terms of taboo potentials for the unperturbed Markov chain, and the other based on Taylor's formula.

Stabilité de la récurrence nulle pour certaines chaines de Markov perturbées

1983 ◽  
Vol 20 (03) ◽  
pp. 482-504
Author(s):  
C. Cocozza-Thivent ◽  
C. Kipnis ◽  
M. Roussignol
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Transition Probability ◽  
The Other ◽  
Barrier Functions ◽  
One Step ◽  
Null Recurrence ◽  
Step Transition ◽  
The One ◽  
Taylor's Formula

We investigate how the property of null-recurrence is preserved for Markov chains under a perturbation of the transition probability. After recalling some useful criteria in terms of the one-step transition nucleus we present two methods to determine barrier functions, one in terms of taboo potentials for the unperturbed Markov chain, and the other based on Taylor's formula.

Single-shelf library-type Markov chains with infinitely many books

1977 ◽  
Vol 14 (02) ◽  
pp. 298-308 ◽  
Author(s):  
Peter R. Nelson
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Transition Probabilities ◽  
Natural Order ◽  
Order Book ◽  
Exit Boundary ◽  
One Step ◽  
Step Transition ◽  
The Right ◽  
Positive Recurrent

In a single-shelf library having infinitely many books B 1 , B 2 , …, the probability of selecting each book is assumed known. Books are removed one at a time and replaced in position k prior to the next removal. Books are moved either to the right or the left as is necessary to vacate position k. Those arrangements of books where after some finite position all the books are in natural order (book i occupies position i) are considered as states in an infinite Markov chain. When k > 1, we show that the chain can never be positive recurrent. When k = 1, we find the limits of ratios of one-step transition probabilities; and when k = 1 and the chain is transient, we find the Martin exit boundary.

The Reliability Analysis of Mechanical Leg (2UPS+UP) Based on a Discrete Time Repairable Markov Model

2015 ◽  
Vol 713-715 ◽  
pp. 760-763
Author(s):  
Jia Lei Zhang ◽  
Zhen Lin Jin ◽  
Dong Mei Zhao
Keyword(s):  
Steady State ◽  
Discrete Time ◽  
Transition Probability ◽  
Continuous Model ◽  
Transition Probability Matrix ◽  
State Equations ◽  
One Step ◽  
The Difference ◽  
Step Transition ◽  
The One

We have analyzed some reliability problems of the 2UPS+UP mechanism using continuous Markov repairable model in our previous work. According to the check and repair of the robot is periodic, the discrete time Markov repairable model should be more appropriate. Firstly we built up the discrete time repairable model and got the one step transition probability matrix. Secondly solved the steady state equations and got the steady state availability of the mechanical leg, by the solution of the difference equations the reliability and the mean time to first failure were obtained. In the end we compared the reliability indexes with the continuous model.

The departure process from the GI/G/1 Queue

1969 ◽  
Vol 6 (3) ◽  
pp. 704-707 ◽  
Author(s):  
Thomas L. Vlach ◽  
Ralph L. Disney
Keyword(s):  
Markov Chain ◽  
Markov Process ◽  
Transition Probabilities ◽  
Two Dimensional ◽  
Departure Process ◽  
Dimensional State Space ◽  
Semi Markov Process ◽  
One Step ◽  
Step Transition ◽  
The One

The departure process from the GI/G/1 queue is shown to be a semi-Markov process imbedded at departure points with a two-dimensional state space. Transition probabilities for this process are defined and derived from the distributions of the arrival and service processes. The one step transition probabilities and a stationary distribution are obtained for the imbedded two-dimensional Markov chain.

A Nonuniform Cell Partition for the Analysis of Nonlinear Stochastic Systems

1998 ◽  
Vol 65 (4) ◽  
pp. 867-869 ◽  
Author(s):  
J. Q. Sun
Keyword(s):  
Ad Hoc ◽  
Stochastic Systems ◽  
Transition Probability ◽  
Nonlinear Stochastic Systems ◽  
Transition Probability Density ◽  
Generalized Cell Mapping ◽  
One Step ◽  
Step Transition ◽  
The One ◽  
Cell Partition

This paper presents a study of nonuniform cell partition for analyzing the response of nonlinear stochastic systems by using the generalized cell mapping (GCM) method. The necessity of nonuniform cell partition for nonlinear systems is discussed first. An ad hoc scheme is then presented for determining optimal cell sizes based on the statistical analysis of the GCM method. The proposed nonuniform cell partition provides a roughly uniform accuracy for the estimate of the one-step transition probability density function over a large region in the state space where the system varies significantly from being linear to being strongly nonlinear. The nonuniform cell partition is shown to lead to more accurate steady-state solutions and enhance the computational efficiency of the GCM method.

Single-shelf library-type Markov chains with infinitely many books

1977 ◽  
Vol 14 (2) ◽  
pp. 298-308 ◽  
Author(s):  
Peter R. Nelson
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Transition Probabilities ◽  
Natural Order ◽  
Order Book ◽  
Exit Boundary ◽  
One Step ◽  
Step Transition ◽  
The Right ◽  
Positive Recurrent

In a single-shelf library having infinitely many books B1, B2, …, the probability of selecting each book is assumed known. Books are removed one at a time and replaced in position k prior to the next removal. Books are moved either to the right or the left as is necessary to vacate position k. Those arrangements of books where after some finite position all the books are in natural order (book i occupies position i) are considered as states in an infinite Markov chain. When k > 1, we show that the chain can never be positive recurrent. When k = 1, we find the limits of ratios of one-step transition probabilities; and when k = 1 and the chain is transient, we find the Martin exit boundary.

The departure process from the GI/G/1 Queue

1969 ◽  
Vol 6 (03) ◽  
pp. 704-707 ◽  
Author(s):  
Thomas L. Vlach ◽  
Ralph L. Disney
Keyword(s):  
Markov Chain ◽  
Markov Process ◽  
Transition Probabilities ◽  
Two Dimensional ◽  
Departure Process ◽  
Dimensional State Space ◽  
Semi Markov Process ◽  
One Step ◽  
Step Transition ◽  
The One

The departure process from the GI/G/1 queue is shown to be a semi-Markov process imbedded at departure points with a two-dimensional state space. Transition probabilities for this process are defined and derived from the distributions of the arrival and service processes. The one step transition probabilities and a stationary distribution are obtained for the imbedded two-dimensional Markov chain.

A Statistical Study of Generalized Cell Mapping

1988 ◽  
Vol 55 (3) ◽  
pp. 694-701 ◽  
Author(s):  
Jian-Qiao Sun ◽  
C. S. Hsu
Keyword(s):  
Stochastic Systems ◽  
Transition Probability ◽  
Transition Probability Matrix ◽  
Mapping Method ◽  
Cell Mapping ◽  
Generalized Cell Mapping ◽  
One Step ◽  
The Mean ◽  
Step Transition ◽  
The One

In this paper a statistical error analysis of the generalized cell mapping method for both deterministic and stochastic dynamical systems is examined, based upon the statistical analogy of the generalized cell mapping method to the density estimation. The convergence of the mean square error of the one step transition probability matrix of generalized cell mapping for deterministic and stochastic systems is studied. For stochastic systems, a well-known trade-off feature of the density estimation exists in the mean square error of the one step transition probability matrix, which leads to an optimal design of generalized cell mapping for stochastic systems. The conclusions of the study are illustrated with some examples.

scholarly journals The Markov Process as a Model of Migration Based on the Example of the Movement of Banknotes

2021 ◽  
Vol 2/2021 (35) ◽  
pp. 76-92
Author(s):  
Arkadiusz Manikowski ◽  
Keyword(s):  
Markov Chain ◽  
Gravity Model ◽  
Transition Probabilities ◽  
Markov Chain Model ◽  
Transition Probability ◽  
Empirical Models ◽  
Chain Model ◽  
National Bank ◽  
One Step ◽  
Step Transition

This paper presents a way of using the Markov chain model for the analysis of migration based on the example of banknote migration between regions in Poland. We have presented the application of the methodology for estimating one-step transition probabilities for the Markov chain based on macro-data gathered during the project conducted in the National Bank of Poland (NBP) in the period of December 2015–2018. We have shown the usefulness of state-aggregated Markov chain not only as a model of banknote migration but as migration in general. The banknotes are considered here as goods, so their migration is strictly related to, inter alia, the movement of people (commuting to work, business trips, etc.).Thus, the gravity-like properties of cash migration pointed to the gravity model as one of the most pervasive empirical models in regional science. Transition probability of the Markov chain expressing the attractive force between regions allows for estimating the gravity model for the identification of relevant reasons of note and, consequently, people migration.

On non-dissipative Markov chains

1957 ◽  
Vol 53 (4) ◽  
pp. 825-835 ◽  
Author(s):  
J. G. Mauldon
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
Transition Probabilities ◽  
Usual Convention ◽  
One Step ◽  
Step Transition ◽  
Image Position

Consider a Markov chain with an enumerable infinity of states, labelled 0, 1, 2, …, whose one-step transition probabilities pij are independent of time. ThenI write and, departing slightly from the usual convention,Then it is known ((1), pp. 324–34, or (6)) that the limits πij always exist, and that

Sign in / Sign up

Export Citation Format

Share Document