A Renewal Theorem for Strongly Ergodic Markov Chains in Dimension d ≥ 3 and Centered Case

Potential Analysis ◽

10.1007/s11118-010-9200-2 ◽

2010 ◽

Vol 34 (4) ◽

pp. 385-410 ◽

Author(s):

Denis Guibourg ◽

Loïc Hervé

Keyword(s):

Markov Chains ◽

Renewal Theorem

Download Full-text

Renewal Theorem For Markov Chains Theorem D

Lecture Notes in Mathematics - Limit Theorems for Markov Chains and Stochastic Properties of Dynamical Systems by Quasi-Compactness ◽

10.1007/3-540-44623-0_7 ◽

2007 ◽

pp. 43-48

Keyword(s):

Markov Chains ◽

Renewal Theorem

Download Full-text

A multi-dimensional renewal theorem for finite Markov chains

Arkiv för matematik ◽

10.1007/bf02387381 ◽

1990 ◽

Vol 28 (1-2) ◽

pp. 273-287

Author(s):

Thomas Höglund

Keyword(s):

Markov Chains ◽

Renewal Theorem ◽

Finite Markov Chains

Download Full-text

Coupling Methods for Markov Chains and the Renewal Theorem for Lattice Distributions

10.1007/978-3-030-78939-8_8 ◽

2021 ◽

pp. 99-112

Author(s):

Rabi Bhattacharya ◽

Edward C. Waymire

Keyword(s):

Markov Chains ◽

Renewal Theorem ◽

Coupling Methods

Download Full-text

Empirical Markov chains as models of dynamic processes

PsycEXTRA Dataset ◽

10.1037/e484502008-001 ◽

2008 ◽

Author(s):

Stephen Merrill

Keyword(s):

Markov Chains ◽

Dynamic Processes

Download Full-text

Markov models—Markov chains

Nature Methods ◽

10.1038/s41592-019-0476-x ◽

2019 ◽

Vol 16 (8) ◽

pp. 663-664 ◽

Author(s):

Jasleen K. Grewal ◽

Martin Krzywinski ◽

Naomi Altman

Keyword(s):

Markov Chains ◽

Download Full-text

A Comprehensive Performance Evaluation on Iterative Algorithms for Sensitivity Analysis of Continuous-Time Markov Chains

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences ◽

10.1587/transfun.2019eap1171 ◽

2020 ◽

Vol E103.A (11) ◽

pp. 1252-1259

Author(s):

Yepeng CHENG ◽

Hiroyuki OKAMURA ◽

Tadashi DOHI

Keyword(s):

Sensitivity Analysis ◽

Performance Evaluation ◽

Markov Chains ◽

Continuous Time ◽

Iterative Algorithms ◽

Continuous Time Markov Chains ◽

Comprehensive Performance

Download Full-text

Optimal and Near-Optimal Incentive Strategies in the Hierarchical Control of Markov Chains

10.23919/acc.1983.4788279 ◽

1983 ◽

Author(s):

Vikram R. Saksena ◽

J. B. Cruz

Keyword(s):

Markov Chains ◽

Hierarchical Control ◽

Incentive Strategies

Download Full-text

On Hankel-Norm Approximation of Large-Scale Markov Chains

1991 American Control Conference ◽

10.23919/acc.1991.4791662 ◽

1991 ◽

Author(s):

Guanrong Chen ◽

Charles K. Chui ◽

Yaoqi Yu

Keyword(s):

Markov Chains ◽

Large Scale ◽

Hankel Norm ◽

Norm Approximation

Download Full-text

A note on some new results on the ergodic control of partially observed Markov chains

Proceedings of the 2004 American Control Conference ◽

10.23919/acc.2004.1383687 ◽

2004 ◽

Author(s):

Shun-Pin Hsu ◽

A. Arapostathis

Keyword(s):

Markov Chains ◽

Ergodic Control ◽

Partially Observed

Download Full-text

Numerical Methods in Markov Chains and Bulk Queues

10.1007/978-3-642-80712-1 ◽

1972 ◽

Author(s):

Tapan P. Bagchi ◽

James G. C. Templeton

Keyword(s):

Numerical Methods ◽

Download Full-text