finite markov chains
Recently Published Documents


TOTAL DOCUMENTS

245
(FIVE YEARS 20)

H-INDEX

31
(FIVE YEARS 2)

2021 ◽  
Vol Volume 17, Issue 4 ◽  
Author(s):  
Yo Mitani ◽  
Naoki Kobayashi ◽  
Takeshi Tsukada

We introduce PHFL, a probabilistic extension of higher-order fixpoint logic, which can also be regarded as a higher-order extension of probabilistic temporal logics such as PCTL and the $\mu^p$-calculus. We show that PHFL is strictly more expressive than the $\mu^p$-calculus, and that the PHFL model-checking problem for finite Markov chains is undecidable even for the $\mu$-only, order-1 fragment of PHFL. Furthermore the full PHFL is far more expressive: we give a translation from Lubarsky's $\mu$-arithmetic to PHFL, which implies that PHFL model checking is $\Pi^1_1$-hard and $\Sigma^1_1$-hard. As a positive result, we characterize a decidable fragment of the PHFL model-checking problems using a novel type system.


2021 ◽  
Vol 155 (14) ◽  
pp. 140901
Author(s):  
Daniel J. Sharpe ◽  
David J. Wales

Mathematics ◽  
2021 ◽  
Vol 9 (15) ◽  
pp. 1752
Author(s):  
Alexander Zeifman ◽  
Yacov Satin ◽  
Alexander Sipin

We apply the method of differential inequalities for the computation of upper bounds for the rate of convergence to the limiting regime for one specific class of (in)homogeneous continuous-time Markov chains. Such an approach seems very general; the corresponding description and bounds were considered earlier for finite Markov chains with analytical in time intensity functions. Now we generalize this method to locally integrable intensity functions. Special attention is paid to the situation of a countable Markov chain. To obtain these estimates, we investigate the corresponding forward system of Kolmogorov differential equations as a differential equation in the space of sequences l1.


2020 ◽  
Vol 30 (4) ◽  
pp. 215-241
Author(s):  
Gavriil A. Bakay ◽  
Aleksandr V. Shklyaev

AbstractLet (ξ(i), η(i)) ∈ ℝd+1, 1 ≤ i < ∞, be independent identically distributed random vectors, η(i) be nonnegative random variables, the vector (ξ(1), η(1)) satisfy the Cramer condition. On the base of renewal process, NT = max{k : η(1) + … + η(k) ≤ T} we define the generalized renewal process ZT = $\begin{array}{} \sum_{i=1}^{N_T} \end{array}$ξ(i). Put IΔT(x) = {y ∈ ℝd : xj ≤ yj < xj + ΔT, j = 1, …, d}. We find asymptotic formulas for the probabilities P(ZT ∈ IΔT(x)) as ΔT → 0 and P(ZT = x) in non-lattice and arithmetic cases, respectively, in a wide range of x values, including normal, moderate, and large deviations. The analogous results were obtained for a process with delay in which the distribution of (ξ(1), η(1)) differs from the distribution on the other steps. Using these results, we prove local limit theorems for processes with regeneration and for additive functionals of finite Markov chains, including normal, moderate, and large deviations.


Sign in / Sign up

Export Citation Format

Share Document