Asymptotically Optimal Sequential Discrimination between Markov Chains

mODa 6 — Advances in Model-Oriented Design and Analysis - Contributions to Statistics ◽

10.1007/978-3-642-57576-1_18 ◽

2001 ◽

pp. 163-170

Author(s):

M. B. Malyutov ◽

I. I. Tsitovich

Keyword(s):

Markov Chains ◽

Asymptotically Optimal

Download Full-text

Asymptotically Optimal Tests for Finite Markov Chains

The Annals of Mathematical Statistics ◽

10.1214/aoms/1177693067 ◽

1971 ◽

Vol 42 (6) ◽

pp. 1992-2007 ◽

Cited By ~ 23

Author(s):

Luis B. Boza

Keyword(s):

Markov Chains ◽

Asymptotically Optimal ◽

Optimal Tests ◽

Asymptotically Optimal Tests ◽

Finite Markov Chains

Download Full-text

An asymptotically optimal learning controller for finite Markov chains with unknown transition probabilities

IEEE Transactions on Automatic Control ◽

10.1109/tac.1985.1103853 ◽

1985 ◽

Vol 30 (11) ◽

pp. 1147-1149 ◽

Cited By ~ 6

Author(s):

M. Sato ◽

K. Abe ◽

H. Takeda

Keyword(s):

Markov Chains ◽

Transition Probabilities ◽

Optimal Learning ◽

Asymptotically Optimal ◽

Finite Markov Chains

Download Full-text

Empirical Markov chains as models of dynamic processes

PsycEXTRA Dataset ◽

10.1037/e484502008-001 ◽

2008 ◽

Author(s):

Stephen Merrill

Keyword(s):

Markov Chains ◽

Dynamic Processes

Download Full-text

Markov models—Markov chains

Nature Methods ◽

10.1038/s41592-019-0476-x ◽

2019 ◽

Vol 16 (8) ◽

pp. 663-664 ◽

Cited By ~ 1

Author(s):

Jasleen K. Grewal ◽

Martin Krzywinski ◽

Naomi Altman

Keyword(s):

Markov Chains ◽

Markov Models

Download Full-text

A Comprehensive Performance Evaluation on Iterative Algorithms for Sensitivity Analysis of Continuous-Time Markov Chains

IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences ◽

10.1587/transfun.2019eap1171 ◽

2020 ◽

Vol E103.A (11) ◽

pp. 1252-1259

Author(s):

Yepeng CHENG ◽

Hiroyuki OKAMURA ◽

Tadashi DOHI

Keyword(s):

Sensitivity Analysis ◽

Performance Evaluation ◽

Markov Chains ◽

Continuous Time ◽

Iterative Algorithms ◽

Continuous Time Markov Chains ◽

Comprehensive Performance

Download Full-text

Optimal and Near-Optimal Incentive Strategies in the Hierarchical Control of Markov Chains

10.23919/acc.1983.4788279 ◽

1983 ◽

Author(s):

Vikram R. Saksena ◽

J. B. Cruz

Keyword(s):

Markov Chains ◽

Hierarchical Control ◽

Incentive Strategies

Download Full-text

On Hankel-Norm Approximation of Large-Scale Markov Chains

1991 American Control Conference ◽

10.23919/acc.1991.4791662 ◽

1991 ◽

Author(s):

Guanrong Chen ◽

Charles K. Chui ◽

Yaoqi Yu

Keyword(s):

Markov Chains ◽

Large Scale ◽

Hankel Norm ◽

Norm Approximation

Download Full-text

A note on some new results on the ergodic control of partially observed Markov chains

Proceedings of the 2004 American Control Conference ◽

10.23919/acc.2004.1383687 ◽

2004 ◽

Author(s):

Shun-Pin Hsu ◽

A. Arapostathis

Keyword(s):

Markov Chains ◽

Ergodic Control ◽

Partially Observed

Download Full-text

Numerical Methods in Markov Chains and Bulk Queues

10.1007/978-3-642-80712-1 ◽

1972 ◽

Cited By ~ 15

Author(s):

Tapan P. Bagchi ◽

James G. C. Templeton

Keyword(s):

Numerical Methods ◽

Markov Chains

Download Full-text

A perturbation analysis of Markov chains models with time-varying parameters

Bernoulli ◽

10.3150/20-bej1210 ◽

2020 ◽

Vol 26 (4) ◽

pp. 2876-2906

Author(s):

Lionel Truquet

Keyword(s):

Markov Chains ◽

Perturbation Analysis ◽

Time Varying ◽

Varying Parameters ◽

Time Varying Parameters

Download Full-text