Combinatorial Optimization, Markov Chains, and Stochastic Automata

2021 ◽  
pp. 543-564
Author(s):  
Eugene Shragowitz ◽  
Rung-Bin Lin
1990 ◽  
Vol 22 (1) ◽  
pp. 293-324 ◽  
Author(s):  
Eugene Shragowitz ◽  
Rung-Bin Lin

1997 ◽  
Vol 11 (2) ◽  
pp. 229-253 ◽  
Author(s):  
Peter Buchholz

Stochastic automata networks (SANs) have recently received much attention in the literature as a means to analyze complex Markov chains in an efficient way. The main advantage of SANs over most other paradigms is that they allow a very compact description of the generator matrix by means of much smaller matrices for single automata. This representation can be exploited in different iterative techniques to compute the stationary solution. However, the set of applicable solution methods for SANs is restricted, because a solution method has to respect the specific representation of the generator matrix to exploit the compact representation. In particular, aggregation/disaggregation (a/d) methods cannot be applied in their usual realization for SANs without losing the possibility to exploit the compact representation of the generator matrix.In this paper, a new a/d algorithm for SANs is introduced. The algorithm differs significantly from standard a/d methods because the parts to be aggregated are defined in a completely different way, exploiting the structure of the generator matrix of a SAN. Aggregation is performed with respect to single automata or sets of automata, which are the basic parts generating a SAN. It is shown that the new algorithm is efficient even if the automata are not loosely coupled.


2001 ◽  
Vol 38 (A) ◽  
pp. 66-77 ◽  
Author(s):  
Albrecht Irle ◽  
Joseph Gani

This paper considers the occurrence of patterns in sequences of independent trials from a finite alphabet; Gani and Irle (1999) have described a finite state automaton which identifies exactly those sequences of symbols containing the specific pattern, which may be thought of as the word of interest. Each word generates a particular Markov chain. Motivated by a result of Guibas and Odlyzko (1981) on stochastic monotonicity for the random times when a particular word is completed for the first time, a new level-crossing ordering is introduced for stochastic processes. A process {Yn : n = 0, 1, …} is slower in level-crossing than a process {Zn}, if it takes {Yn} stochastically longer than {Zn} to exceed any given level. This relation is shown to be useful for the comparison of stochastic automata, and is used to investigate this ordering for Markov chains in discrete time.


2001 ◽  
Vol 38 (A) ◽  
pp. 66-77
Author(s):  
Albrecht Irle ◽  
Joseph Gani

This paper considers the occurrence of patterns in sequences of independent trials from a finite alphabet; Gani and Irle (1999) have described a finite state automaton which identifies exactly those sequences of symbols containing the specific pattern, which may be thought of as the word of interest. Each word generates a particular Markov chain. Motivated by a result of Guibas and Odlyzko (1981) on stochastic monotonicity for the random times when a particular word is completed for the first time, a new level-crossing ordering is introduced for stochastic processes. A process {Yn : n = 0, 1, …} is slower in level-crossing than a process {Zn }, if it takes {Yn } stochastically longer than {Zn } to exceed any given level. This relation is shown to be useful for the comparison of stochastic automata, and is used to investigate this ordering for Markov chains in discrete time.


2019 ◽  
Vol 16 (8) ◽  
pp. 663-664 ◽  
Author(s):  
Jasleen K. Grewal ◽  
Martin Krzywinski ◽  
Naomi Altman
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document