Optimal control of perturbed Markov chains

Singular Perturbations and Asymptotic Analysis in Control Systems - Lecture Notes in Control and Information Sciences ◽

10.1007/bfb0007180 ◽

1987 ◽

pp. 288-309

Author(s):

J. P. Quadrat

Keyword(s):

Optimal Control ◽

Markov Chains

Optimal Control of Semi-Markov Chains under Uncertainty with Applications to Queueing Models

Vorträge der Jahrestagung 1979 / Papers of the Annual Meeting 1979 ◽

10.1007/978-3-662-00401-2_76 ◽

1980 ◽

pp. 430-435 ◽

Cited By ~ 1

Author(s):

M. Kolonko ◽

M. Schäl

Keyword(s):

Optimal Control ◽

Markov Chains ◽

Queueing Models

Estimation and optimal control for constrained Markov chains

10.1109/cdc.1986.267523 ◽

1986 ◽

Cited By ~ 28

Author(s):

D.-j. Ma ◽

A. Makowski ◽

A. Shwartz

Keyword(s):

Optimal Control ◽

Markov Chains

Optimal Control of Perturbed Markov Chains: The Multitime Scale Case

Singular Perturbations in Systems and Control ◽

10.1007/978-3-7091-2638-7_9 ◽

1983 ◽

pp. 215-239 ◽

Cited By ~ 1

Author(s):

J. P. Quadrat

Keyword(s):

Optimal Control ◽

Markov Chains

Aggregation and optimal control of nearly completely decomposable Markov chains

10.1109/cdc.1989.70343 ◽

2003 ◽

Cited By ~ 7

Author(s):

R.W. Aldhaheri ◽

H.K. Khalil

Keyword(s):

Optimal Control ◽

Markov Chains

Optimal Control of Ergodic Continuous-Time Markov Chains with Average Sample-Path Rewards

SIAM Journal on Control and Optimization ◽

10.1137/s0363012903420875 ◽

2005 ◽

Vol 44 (1) ◽

pp. 29-48 ◽

Cited By ~ 16

Author(s):

Xianping Guo ◽

Xi-Ren Cao

Keyword(s):

Optimal Control ◽

Markov Chains ◽

Continuous Time ◽

Sample Path ◽

Continuous Time Markov Chains ◽

Average Sample

Decentralized optimal control of Markov chains with a common past information set

IEEE Transactions on Automatic Control ◽

10.1109/tac.1987.1104483 ◽

1987 ◽

Vol 32 (11) ◽

pp. 1028-1031 ◽

Cited By ~ 38

Author(s):

M. Aicardi ◽

F. Davoli ◽

R. Minciardi

Keyword(s):

Optimal Control ◽

Markov Chains ◽

Information Set

Optimal control of time-inhomogeneous Markov chains with application to dam management

2013 Australian Control Conference ◽

10.1109/aucc.2013.6697278 ◽

2013 ◽

Cited By ~ 3

Author(s):

Daniel McInnes ◽

Boris Miller

Keyword(s):

Optimal Control ◽

Markov Chains ◽

Dam Management

Optimal control of a large dam using time-inhomogeneous Markov chains with an application to flood control

IFAC-PapersOnLine ◽

10.1016/j.ifacol.2017.08.936 ◽

2017 ◽

Vol 50 (1) ◽

pp. 3499-3504 ◽

Cited By ~ 2

Author(s):

Daniel McInnes ◽

Boris Miller

Keyword(s):

Optimal Control ◽

Markov Chains ◽

Flood Control ◽

Large Dam

Optimal control of Markov chains with constraints

Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference ◽

10.1109/cdc.2009.5400627 ◽

2009 ◽

Cited By ~ 6

Author(s):

Boris Miller ◽

Gregory Miller ◽

Konstantin Siemenikhin

Keyword(s):

Optimal Control ◽

Markov Chains

Towards the optimal control of Markov chains with constraints

Automatica ◽

10.1016/j.automatica.2010.06.003 ◽

2010 ◽

Vol 46 (9) ◽

pp. 1495-1502 ◽

Cited By ~ 15

Author(s):

Boris Miller ◽

Gregory Miller ◽

Konstantin Siemenikhin

Keyword(s):

Optimal Control ◽

Markov Chains