Stochastic Process, Discrete-time Markov Chain

2022 ◽  
pp. 1-42
Author(s):  
Olga Korosteleva
Keyword(s):  
Stochastic Process ◽  
Markov Chain ◽  
Discrete Time ◽  
Discrete Time Markov Chain

scholarly journals Chain-referral sampling on stochastic block models

2020 ◽  
Vol 24 ◽  
pp. 718-738
Author(s):  
Thi Phuong Thuy Vo
Keyword(s):  
Stochastic Process ◽  
Markov Chain ◽  
Social Network ◽  
Discrete Time ◽  
Precise Description ◽  
Stochastic Block Model ◽  
Hidden Population ◽  
The People ◽  
A Chain ◽  
Block Models

The discovery of the “hidden population”, whose size and membership are unknown, is made possible by assuming that its members are connected in a social network by their relationships. We explore these groups by a chain-referral sampling (CRS) method, where participants recommend the people they know. This leads to the study of a Markov chain on a random graph where vertices represent individuals and edges connecting any two nodes describe the relationships between corresponding people. We are interested in the study of CRS process on the stochastic block model (SBM), which extends the well-known Erdös-Rényi graphs to populations partitioned into communities. The SBM considered here is characterized by a number of vertices N, a number of communities (blocks) m, proportion of each community π = (π1, …, πm) and a pattern for connection between blocks P = (λkl∕N)(k,l)∈{1,…,m}2. In this paper, we give a precise description of the dynamic of CRS process in discrete time on an SBM. The difficulty lies in handling the heterogeneity of the graph. We prove that when the population’s size is large, the normalized stochastic process of the referral chain behaves like a deterministic curve which is the unique solution of a system of ODEs.

Criteria for the non-ergodicity of stochastic processes: application to the exponential back-off protocol

1987 ◽  
Vol 24 (02) ◽  
pp. 347-354 ◽  
Author(s):  
Guy Fayolle ◽  
Rudolph Iasnogorodski
Keyword(s):  
Stochastic Process ◽  
Markov Chain ◽  
Stochastic Processes ◽  
State Space ◽  
Discrete Time ◽  
Random Variables ◽  
Countable State Space ◽  
Countable State ◽  
New Criteria

In this paper, we present some simple new criteria for the non-ergodicity of a stochastic process (Yn ), n ≧ 0 in discrete time, when either the upward or downward jumps are majorized by i.i.d. random variables. This situation is encountered in many practical situations, where the (Yn ) are functionals of some Markov chain with countable state space. An application to the exponential back-off protocol is described.

Lumpability for non-irreducible finite markov chains

1984 ◽  
Vol 21 (03) ◽  
pp. 567-574 ◽  
Author(s):  
Atef M. Abdel-Moneim ◽  
Frederick W. Leysieffer
Keyword(s):  
Markov Chain ◽  
Markov Chains ◽  
State Space ◽  
Discrete Time ◽  
The State ◽  
Discrete Time Markov Chain ◽  
Finite Markov Chains

Conditions under which a function of a finite, discrete-time Markov chain, X(t), is again Markov are given, when X(t) is not irreducible. These conditions are given in terms of an interrelationship between two partitions of the state space of X(t), the partition induced by the minimal essential classes of X(t) and the partition with respect to which lumping is to be considered.

Sign in / Sign up

Export Citation Format

Share Document