scholarly journals States recognition in random walk Markov chain via binary Entropy

2013 ◽  
Vol 2013 ◽  
pp. 1-6
Author(s):  
Morteza Khodabin
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Binary Entropy

On the absorption probabilities and mean time for absorption for discrete Markov chains

2021 ◽  
Vol 0 (0) ◽  
Author(s):  
Nikolaos Halidias
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Markov Chains ◽  
Generating Function ◽  
Discrete Time ◽  
Probability Generating Function ◽  
The Mean ◽  
Mean Time ◽  
Absorption Probabilities

Abstract In this note we study the probability and the mean time for absorption for discrete time Markov chains. In particular, we are interested in estimating the mean time for absorption when absorption is not certain and connect it with some other known results. Computing a suitable probability generating function, we are able to estimate the mean time for absorption when absorption is not certain giving some applications concerning the random walk. Furthermore, we investigate the probability for a Markov chain to reach a set A before reach B generalizing this result for a sequence of sets A 1 , A 2 , … , A k {A_{1},A_{2},\dots,A_{k}} .

On the age distribution of a Markov chain

1978 ◽  
Vol 15 (1) ◽  
pp. 65-77 ◽  
Author(s):  
Anthony G. Pakes
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Limit Theorems ◽  
Age Distribution ◽  
Weak Limit ◽  
Absorbing State ◽  
Absorbing Markov Chain ◽  
Continuous Random Walk ◽  
A Chain ◽  
Watson Process

This paper develops the notion of the limiting age of an absorbing Markov chain, conditional on the present state. Chains with a single absorbing state {0} are considered and with such a chain can be associated a return chain, obtained by restarting the original chain at a fixed state after each absorption. The limiting age, A(j), is the weak limit of the time given Xn = j (n → ∞).A criterion for the existence of this limit is given and this is shown to be fulfilled in the case of the return chains constructed from the Galton–Watson process and the left-continuous random walk. Limit theorems for A (J) (J → ∞) are given for these examples.

scholarly journals Limit theorems for some continuous-time random walks

2011 ◽  
Vol 43 (3) ◽  
pp. 782-813 ◽  
Author(s):  
M. Jara ◽  
T. Komorowski
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Quantum Transport ◽  
Continuous Time ◽  
Limit Theorems ◽  
Transport Theory ◽  
Sufficient Conditions ◽  
Continuous Time Random Walks ◽  
Quantum Transport Theory

In this paper we consider the scaled limit of a continuous-time random walk (CTRW) based on a Markov chain {Xn,n≥ 0} and two observables, τ(∙) andV(∙), corresponding to the renewal times and jump sizes. Assuming that these observables belong to the domains of attraction of some stable laws, we give sufficient conditions on the chain that guarantee the existence of the scaled limits for CTRWs. An application of the results to a process that arises in quantum transport theory is provided. The results obtained in this paper generalize earlier results contained in Becker-Kern, Meerschaert and Scheffler (2004) and Meerschaert and Scheffler (2008), and the recent results of Henry and Straka (2011) and Jurlewicz, Kern, Meerschaert and Scheffler (2010), where {Xn,n≥ 0} is a sequence of independent and identically distributed random variables.

scholarly journals One dimensional quantum walks with memory

2010 ◽  
Vol 10 (5&6) ◽  
pp. 509-524
Author(s):  
M. Mc Gettrick
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Quantum Walks ◽  
One Dimensional ◽  
With Memory ◽  
Previous Step

We investigate the quantum versions of a one-dimensional random walk, whose corresponding Markov Chain is of order 2. This corresponds to the walk having a memory of one previous step. We derive the amplitudes and probabilities for these walks, and point out how they differ from both classical random walks, and quantum walks without memory.

On the age distribution of a Markov chain

1978 ◽  
Vol 15 (01) ◽  
pp. 65-77 ◽  
Author(s):  
Anthony G. Pakes
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Limit Theorems ◽  
Age Distribution ◽  
Weak Limit ◽  
Absorbing State ◽  
Absorbing Markov Chain ◽  
Continuous Random Walk ◽  
A Chain ◽  
Watson Process

This paper develops the notion of the limiting age of an absorbing Markov chain, conditional on the present state. Chains with a single absorbing state {0} are considered and with such a chain can be associated a return chain,obtained by restarting the original chain at a fixed state after each absorption. The limiting age,A(j), is the weak limit of the timegivenXn=j(n → ∞).A criterion for the existence of this limit is given and this is shown to be fulfilled in the case of the return chains constructed from the Galton–Watson process and the left-continuous random walk. Limit theorems forA(J) (J →∞) are given for these examples.

Determining Equivalent Resistance and Nodal Potentials of a Resistive Circuit Using a Reduced Transition Matrix

2020 ◽  
Vol 02 (01) ◽  
pp. 2050004
Author(s):  
Je-Young Choi
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Random Walks ◽  
Transition Matrix ◽  
Present Approach ◽  
Voltage Source ◽  
Equivalent Resistance ◽  
Electrical Circuits ◽  
Electric Potentials ◽  
Dominant Eigenvector

Several methods have been developed in order to solve electrical circuits consisting of resistors and an ideal voltage source. A correspondence with random walks avoids difficulties caused by choosing directions of currents and signs in potential differences. Starting from the random-walk method, we introduce a reduced transition matrix of the associated Markov chain whose dominant eigenvector alone determines the electric potentials at all nodes of the circuit and the equivalent resistance between the nodes connected to the terminals of the voltage source. Various means to find the eigenvector are developed from its definition. A few example circuits are solved in order to show the usefulness of the present approach.

scholarly journals Random semigroup acts on a finite set

1977 ◽  
Vol 23 (4) ◽  
pp. 481-498 ◽  
Author(s):  
Göran Högnäs
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Finite Set ◽  
Semigroup Of Transformations

AbstractLet X be a finite set and S a semigroup of transformations of X. We investigate the trace on X of a random walk on S. We relate the structure of the trace process, which turns out to be a Markov chain, to that of the random walk. We show, for example, that all periods of the trace process divide the period of the random walk.

A correlated random walk for the transport and sedimentation of particles

1988 ◽  
Vol 25 (A) ◽  
pp. 335-346
Author(s):  
J. Gani
Keyword(s):  
Markov Chain ◽  
Random Walk ◽  
Continuous Time ◽  
Laplace Transforms ◽  
The State ◽  
Random Walk Model ◽  
Rectangular Lattice ◽  
Correlated Random Walk ◽  
Bivariate Markov Chain

This paper considers a bivariate random walk modelon a rectangular lattice for a particle injected into a fluid flowing in a tank. The numbers of jumps of the particle in thexandydirections in this particular model are correlated. It is shown that when the random walk forms a bivariate Markov chain in continuous time, it is possible to obtain the state probabilitiespxy(t) through their Laplace transforms. Two exit rules are considered and results for both of them derived.

Sign in / Sign up

Export Citation Format

Share Document