On the vanishing discount factor approach for Markov decision processes with weakly continuous transition probabilities

Journal of Mathematical Analysis and Applications ◽

10.1016/j.jmaa.2015.02.007 ◽

2015 ◽

Vol 426 (2) ◽

pp. 978-985 ◽

Author(s):

Óscar Vega-Amaya

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Discount Factor ◽

Continuous Transition ◽

Weakly Continuous ◽

Markov Decision

Download Full-text

Average Cost Markov Decision Processes with Weakly Continuous Transition Probabilities

Mathematics of Operations Research ◽

10.1287/moor.1120.0555 ◽

2012 ◽

Vol 37 (4) ◽

pp. 591-607 ◽

Author(s):

Eugene A. Feinberg ◽

Pavlo O. Kasyanov ◽

Nina V. Zadoianchuk

Keyword(s):

Markov Decision Processes ◽

Average Cost ◽

Transition Probabilities ◽

Decision Processes ◽

Continuous Transition ◽

Weakly Continuous ◽

Markov Decision

Download Full-text

Partially Observable Total-Cost Markov Decision Processes with Weakly Continuous Transition Probabilities

Mathematics of Operations Research ◽

10.1287/moor.2015.0746 ◽

2016 ◽

Vol 41 (2) ◽

pp. 656-681 ◽

Author(s):

Eugene A. Feinberg ◽

Pavlo O. Kasyanov ◽

Michael Z. Zgurovsky

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Continuous Transition ◽

Weakly Continuous ◽

Markov Decision ◽

Partially Observable

Download Full-text

Robust analysis of discounted Markov decision processes with uncertain transition probabilities

Applied Mathematics-A Journal of Chinese Universities ◽

10.1007/s11766-020-3664-1 ◽

2020 ◽

Vol 35 (4) ◽

pp. 417-436

Author(s):

Zhen-kai Lou ◽

Fu-jun Hou ◽

Xu-ming Lou

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Robust Analysis ◽

Markov Decision

Download Full-text

Markov Decision Processes with Imprecise Transition Probabilities

Operations Research ◽

10.1287/opre.42.4.739 ◽

1994 ◽

Vol 42 (4) ◽

pp. 739-749 ◽

Author(s):

Chelsea C. White ◽

Hany K. Eldeib

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Markov Decision

Download Full-text

Average control of Markov decision processes with Feller transition probabilities and general action spaces

Journal of Mathematical Analysis and Applications ◽

10.1016/j.jmaa.2012.05.073 ◽

2012 ◽

Vol 396 (1) ◽

pp. 58-69 ◽

Author(s):

O.L.V. Costa ◽

F. Dufour

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Markov Decision ◽

General Action ◽

Average Control ◽

Download Full-text

A fuzzy approach to Markov decision processes with uncertain transition probabilities

Fuzzy Sets and Systems ◽

10.1016/j.fss.2004.10.023 ◽

2006 ◽

Vol 157 (19) ◽

pp. 2674-2682 ◽

Author(s):

M. Kurano ◽

M. Yasuda ◽

J. Nakagami ◽

Y. Yoshida

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Fuzzy Approach ◽

Markov Decision

Download Full-text

Average Cost Markov Decision Processes with Semi-Uniform Feller Transition Probabilities

Modern Trends in Controlled Stochastic Processes: - Emergence, Complexity and Computation ◽

10.1007/978-3-030-76928-4_1 ◽

2021 ◽

pp. 1-18

Author(s):

Eugene A. Feinberg ◽

Pavlo O. Kasyanov ◽

Michael Z. Zgurovsky

Keyword(s):

Markov Decision Processes ◽

Average Cost ◽

Transition Probabilities ◽

Decision Processes ◽

Markov Decision

Download Full-text

Loss bounds for uncertain transition probabilities in Markov decision processes

2012 IEEE 51st IEEE Conference on Decision and Control (CDC) ◽

10.1109/cdc.2012.6426504 ◽

2012 ◽

Author(s):

Andrew Mastin ◽

Patrick Jaillet

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Markov Decision

Download Full-text

Solutions of the average cost optimality equation for Markov decision processes with weakly continuous kernel: The fixed-point approach revisited

Journal of Mathematical Analysis and Applications ◽

10.1016/j.jmaa.2018.03.077 ◽

2018 ◽

Vol 464 (1) ◽

pp. 152-163

Author(s):

Óscar Vega-Amaya

Keyword(s):

Fixed Point ◽

Markov Decision Processes ◽

Average Cost ◽

Decision Processes ◽

Optimality Equation ◽

Fixed Point Approach ◽

Weakly Continuous ◽

Markov Decision ◽

Average Cost Optimality Equation ◽

Cost Optimality

Download Full-text

Markov decision processes with dynamic transition probabilities: An analysis of shooting strategies in basketball

The Annals of Applied Statistics ◽

10.1214/20-aoas1348 ◽

2020 ◽

Vol 14 (3) ◽

pp. 1122-1145

Author(s):

Nathan Sandholtz ◽

Luke Bornn

Keyword(s):

Markov Decision Processes ◽

Transition Probabilities ◽

Decision Processes ◽

Dynamic Transition ◽

Markov Decision

Download Full-text