Computational Methods for Controlled Markov Chains

Numerical Methods for Stochastic Control Problems in Continuous Time - Stochastic Modelling and Applied Probability ◽

10.1007/978-1-4613-0007-6_7 ◽

2001 ◽

pp. 153-189

Author(s):

Harold J. Kushner ◽

Paul Dupuis

Keyword(s):

Markov Chains ◽

Computational Methods ◽

Controlled Markov Chains

Download Full-text

Computational Methods for Controlled Markov Chains

Numerical Methods for Stochastic Control Problems in Continuous Time ◽

10.1007/978-1-4684-0441-8_7 ◽

1992 ◽

pp. 151-192

Author(s):

Harold J. Kushner ◽

Paul G. Dupuis

Keyword(s):

Markov Chains ◽

Computational Methods ◽

Controlled Markov Chains

Download Full-text

Stability estimates for controlled Markov chains with a minorant

Journal of Soviet Mathematics ◽

10.1007/bf01083641 ◽

1988 ◽

Vol 40 (4) ◽

pp. 481-486

Author(s):

E. I. Gordienko

Keyword(s):

Markov Chains ◽

Stability Estimates ◽

Controlled Markov Chains

Download Full-text

Controlled Markov chains and safety criteria

Proceedings of the 40th IEEE Conference on Decision and Control (Cat. No.01CH37228) ◽

10.1109/cdc.2001.981142 ◽

2003 ◽

Cited By ~ 1

Author(s):

A. Arapostathis ◽

R. Kumar ◽

S. Tangirala

Keyword(s):

Markov Chains ◽

Controlled Markov Chains

Download Full-text

Markov Processes and Controlled Markov Chains

10.1007/978-1-4613-0265-0 ◽

2002 ◽

Cited By ~ 3

Keyword(s):

Markov Chains ◽

Markov Processes ◽

Controlled Markov Chains

Download Full-text

Controlled Markov Chains

Numerical Methods for Stochastic Control Problems in Continuous Time ◽

10.1007/978-1-4684-0441-8_3 ◽

1992 ◽

pp. 35-51

Author(s):

Harold J. Kushner ◽

Paul G. Dupuis

Keyword(s):

Markov Chains ◽

Controlled Markov Chains

Download Full-text

Multiple Model-Based Control Using Finite Controlled Markov Chains

Cognitive Computation ◽

10.1007/s12559-009-9020-0 ◽

2009 ◽

Vol 1 (3) ◽

pp. 234-243 ◽

Cited By ~ 8

Author(s):

Enso Ikonen ◽

Kaddour Najim

Keyword(s):

Markov Chains ◽

Multiple Model ◽

Model Based Control ◽

Model Based ◽

Controlled Markov Chains

Download Full-text

On lexicographical optimality criteria in controlled markov chains

Lecture Notes in Control and Information Sciences - Stochastic Optimization ◽

10.1007/bfb0007092 ◽

2005 ◽

pp. 148-156

Author(s):

G. I. Mirzashvili

Keyword(s):

Markov Chains ◽

Optimality Criteria ◽

Controlled Markov Chains

Download Full-text

Calibration of Controlled Markov Chains for Predicting Pedestrian Crossing Behavior Using Multi-objective Genetic Algorithms

2019 IEEE Intelligent Transportation Systems Conference (ITSC) ◽

10.1109/itsc.2019.8917317 ◽

2019 ◽

Author(s):

Jingyuan Wu ◽

Johannes Ruenz ◽

Matthias Althoff

Keyword(s):

Genetic Algorithms ◽

Markov Chains ◽

Multi Objective ◽

Controlled Markov Chains ◽

Pedestrian Crossing

Download Full-text

Uniform iterated logarithm laws for martingales and their application to functional estimation in controlled Markov chains

Stochastic Processes and their Applications ◽

10.1016/s0304-4149(00)00025-9 ◽

2000 ◽

Vol 89 (2) ◽

pp. 193-211 ◽

Cited By ~ 5

Author(s):

R. Senoussi

Keyword(s):

Markov Chains ◽

Functional Estimation ◽

Controlled Markov Chains ◽

Iterated Logarithm ◽

Logarithm Laws ◽

Iterated Logarithm Laws

Download Full-text

Pattern recognition algorithms for controlled Markov chains and their application to medical diagnosis

Pattern Recognition Letters ◽

10.1016/0167-8655(83)90067-3 ◽

1983 ◽

Vol 1 (5-6) ◽

pp. 299-303 ◽

Cited By ~ 4

Author(s):

Andrzej Żołnierek

Keyword(s):

Pattern Recognition ◽

Markov Chains ◽

Medical Diagnosis ◽

Controlled Markov Chains ◽

Recognition Algorithms

Download Full-text