The convergence of Cesaro averages for certain nonstationary Markov chains

Stochastic Processes and their Applications ◽

10.1016/0304-4149(77)90032-1 ◽

1977 ◽

Vol 5 (3) ◽

pp. 221-230 ◽

Author(s):

Bruce Bowerman ◽

H.T. David ◽

Dean Isaacson

Keyword(s):

Markov Chains ◽

Cesaro Averages

Download Full-text

Empirical Markov chains as models of dynamic processes

PsycEXTRA Dataset ◽

10.1037/e484502008-001 ◽

2008 ◽

Author(s):

Stephen Merrill

Keyword(s):

Markov Chains ◽

Dynamic Processes

Download Full-text

Markov models—Markov chains

Nature Methods ◽

10.1038/s41592-019-0476-x ◽

2019 ◽

Vol 16 (8) ◽

pp. 663-664 ◽

Author(s):

Jasleen K. Grewal ◽

Martin Krzywinski ◽

Naomi Altman

Keyword(s):

Markov Chains ◽

Download Full-text

A Comprehensive Performance Evaluation on Iterative Algorithms for Sensitivity Analysis of Continuous-Time Markov Chains

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences ◽

10.1587/transfun.2019eap1171 ◽

2020 ◽

Vol E103.A (11) ◽

pp. 1252-1259

Author(s):

Yepeng CHENG ◽

Hiroyuki OKAMURA ◽

Tadashi DOHI

Keyword(s):

Sensitivity Analysis ◽

Performance Evaluation ◽

Markov Chains ◽

Continuous Time ◽

Iterative Algorithms ◽

Continuous Time Markov Chains ◽

Comprehensive Performance

Download Full-text

Optimal and Near-Optimal Incentive Strategies in the Hierarchical Control of Markov Chains

10.23919/acc.1983.4788279 ◽

1983 ◽

Author(s):

Vikram R. Saksena ◽

J. B. Cruz

Keyword(s):

Markov Chains ◽

Hierarchical Control ◽

Incentive Strategies

Download Full-text

On Hankel-Norm Approximation of Large-Scale Markov Chains

1991 American Control Conference ◽

10.23919/acc.1991.4791662 ◽

1991 ◽

Author(s):

Guanrong Chen ◽

Charles K. Chui ◽

Yaoqi Yu

Keyword(s):

Markov Chains ◽

Large Scale ◽

Hankel Norm ◽

Norm Approximation

Download Full-text

A note on some new results on the ergodic control of partially observed Markov chains

Proceedings of the 2004 American Control Conference ◽

10.23919/acc.2004.1383687 ◽

2004 ◽

Author(s):

Shun-Pin Hsu ◽

A. Arapostathis

Keyword(s):

Markov Chains ◽

Ergodic Control ◽

Partially Observed

Download Full-text

Numerical Methods in Markov Chains and Bulk Queues

10.1007/978-3-642-80712-1 ◽

1972 ◽

Author(s):

Tapan P. Bagchi ◽

James G. C. Templeton

Keyword(s):

Numerical Methods ◽

Download Full-text

A perturbation analysis of Markov chains models with time-varying parameters

Bernoulli ◽

10.3150/20-bej1210 ◽

2020 ◽

Vol 26 (4) ◽

pp. 2876-2906

Author(s):

Lionel Truquet

Keyword(s):

Markov Chains ◽

Perturbation Analysis ◽

Time Varying ◽

Varying Parameters ◽

Time Varying Parameters

Download Full-text

Transient Solution of Acyclic Markov Chains.

10.21236/ada162314 ◽

1985 ◽

Author(s):

Raymond Marie ◽

Andrew Reibman ◽

Kishor Trivedi

Keyword(s):

Markov Chains ◽

Transient Solution

Download Full-text

Rootfinding for Markov Chains with Quasi-Triangular Transition Matrices

10.21236/ada202468 ◽

1988 ◽

Author(s):

Carl M. Harris

Keyword(s):

Markov Chains ◽

Transition Matrices

Download Full-text