Convergence to stationary state for a Markov move-to-front scheme

1995 ◽  
Vol 32 (3) ◽  
pp. 768-776 ◽  
Author(s):  
Eliane R. Rodrigues

This work considers items (e.g. books, files) arranged in an array (e.g. shelf, tape) with N positions and assumes that items are requested according to a Markov chain (possibly, of higher order). After use, the requested item is returned to the leftmost position of the array. Successive applications of the procedure above give rise to a Markov chain on permutations. For equally likely items, the number of requests that makes this Markov chain close to its stationary state is estimated. To achieve that, a coupling argument and the total variation distance are used. Finally, for non-equally likely items and so-called p-correlated requests, the coupling time is presented as a function of the coupling time when requests are independent.

1995 ◽  
Vol 32 (03) ◽  
pp. 768-776 ◽  
Author(s):  
Eliane R. Rodrigues

This work considers items (e.g. books, files) arranged in an array (e.g. shelf, tape) with N positions and assumes that items are requested according to a Markov chain (possibly, of higher order). After use, the requested item is returned to the leftmost position of the array. Successive applications of the procedure above give rise to a Markov chain on permutations. For equally likely items, the number of requests that makes this Markov chain close to its stationary state is estimated. To achieve that, a coupling argument and the total variation distance are used. Finally, for non-equally likely items and so-called p-correlated requests, the coupling time is presented as a function of the coupling time when requests are independent.


2015 ◽  
Vol 47 (1) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.


2015 ◽  
Vol 47 (01) ◽  
pp. 83-105 ◽  
Author(s):  
Hiroyuki Masuyama

In this paper we study the augmented truncation of discrete-time block-monotone Markov chains under geometric drift conditions. We first present a bound for the total variation distance between the stationary distributions of an original Markov chain and its augmented truncation. We also obtain such error bounds for more general cases, where an original Markov chain itself is not necessarily block monotone but is blockwise dominated by a block-monotone Markov chain. Finally, we discuss the application of our results to GI/G/1-type Markov chains.


2001 ◽  
Vol 10 (4) ◽  
pp. 293-308 ◽  
Author(s):  
OURANIA CHRYSSAPHINOU ◽  
STAVROS PAPASTAVRIDIS ◽  
EUTICHIA VAGGELATOU

Let X1, …, Xn be a sequence of r.v.s produced by a stationary Markov chain with state space an alphabet Ω = {ω1, …, ωq}, q [ges ] 2. We consider a set of words {A1, …, Ar}, r [ges ] 2, with letters from the alphabet Ω. We allow the words to have self-overlaps as well as overlaps between them. Let [Escr ] denote the event of the appearance of a word from the set {A1, …, Ar} at a given position. Moreover, define by N the number of non-overlapping (competing renewal) appearances of [Escr ] in the sequence X1, …, Xn. We derive a bound on the total variation distance between the distribution of N and a Poisson distribution with parameter [ ]N. The Stein–Chen method and combinatorial arguments concerning the structure of words are employed. As a corollary, we obtain an analogous result for the i.i.d. case. Furthermore, we prove that, under quite general conditions, the r.v. N converges in distribution to a Poisson r.v. A numerical example is presented to illustrate the performance of the bound in the Markov case.


2017 ◽  
Vol 2017 ◽  
pp. 1-11 ◽  
Author(s):  
Mario Muñoz-Organero ◽  
Ramona Ruiz-Blázquez

The automatic detection of road related information using data from sensors while driving has many potential applications such as traffic congestion detection or automatic routable map generation. This paper focuses on the automatic detection of road elements based on GPS data from on-vehicle systems. A new algorithm is developed that uses the total variation distance instead of the statistical moments to improve the classification accuracy. The algorithm is validated for detecting traffic lights, roundabouts, and street-crossings in a real scenario and the obtained accuracy (0.75) improves the best results using previous approaches based on statistical moments based features (0.71). Each road element to be detected is characterized as a vector of speeds measured when a driver goes through it. We first eliminate the speed samples in congested traffic conditions which are not comparable with clear traffic conditions and would contaminate the dataset. Then, we calculate the probability mass function for the speed (in 1 m/s intervals) at each point. The total variation distance is then used to find the similarity among different points of interest (which can contain a similar road element or a different one). Finally, a k-NN approach is used for assigning a class to each unlabelled element.


2002 ◽  
Vol 34 (03) ◽  
pp. 609-625 ◽  
Author(s):  
N. Papadatos ◽  
V. Papathanasiou

The random variablesX1,X2, …,Xnare said to be totally negatively dependent (TND) if and only if the random variablesXiand ∑j≠iXjare negatively quadrant dependent for alli. Our main result provides, for TND 0-1 indicatorsX1,x2, …,Xnwith P[Xi= 1] =pi= 1 - P[Xi= 0], an upper bound for the total variation distance between ∑ni=1Xiand a Poisson random variable with mean λ ≥ ∑ni=1pi. An application to a generalized birthday problem is considered and, moreover, some related results concerning the existence of monotone couplings are discussed.


2014 ◽  
Vol 59 (9) ◽  
pp. 2353-2368 ◽  
Author(s):  
Charalambos D. Charalambous ◽  
Ioannis Tzortzis ◽  
Sergey Loyka ◽  
Themistoklis Charalambous

10.37236/8623 ◽  
2019 ◽  
Vol 26 (4) ◽  
Author(s):  
Thomas Budzinski ◽  
Nicolas Curien ◽  
Bram Petri

Starting from an arbitrary sequence of polygons whose total perimeter is $2n$, we can build an (oriented) surface by pairing their sides in a uniform fashion. Chmutov & Pittel have shown that, regardless of the configuration of polygons we started with, the degree sequence of the graph obtained this way is remarkably constant in total variation distance and converges towards a Poisson–Dirichlet partition as $n \to \infty$. We actually show that several other geometric properties of the graph are universal. En route we provide an alternative proof of a weak version of the result of Chmutov & Pittel using probabilistic techniques and related to the circle of ideas around the peeling process of random planar maps. At this occasion we also fill a gap in the existing literature by surveying the properties of a uniform random map with $n$ edges. In particular we show that the diameter of a random map with $n$ edges converges in law towards a random variable taking only values in $\{2,3\}$.


Sign in / Sign up

Export Citation Format

Share Document