Value iteration for controlled Markov chains with risk sensitive cost criterion

2003 ◽  
Author(s):  
T. Bielecki ◽  
D. Hernandez-Hernandez ◽  
S.R. Pliska
Keyword(s):  
Markov Chains ◽  
Value Iteration ◽  
Controlled Markov Chains ◽  
Cost Criterion ◽  
Risk Sensitive

Value iteration in a class of average controlled Markov chains with unbounded costs: necessary and sufficient conditions for pointwise convergence

1996 ◽  
Vol 33 (4) ◽  
pp. 986-1002 ◽  
Author(s):  
Rolando Cavazos-Cadena ◽  
Emmanuel Fernández-Gaucherand
Keyword(s):  
Markov Chains ◽  
Cost Function ◽  
Sufficient Conditions ◽  
Value Functions ◽  
Value Iteration ◽  
Controlled Markov Chains ◽  
Cost Criterion ◽  
Convergence Results ◽  
Differential Costs ◽  
Necessary And Sufficient

This work concerns controlled Markov chains with denumerable state space, (possibly) unbounded cost function, and an expected average cost criterion. Under a Lyapunov function condition, together with mild continuity-compactness assumptions, a simple necessary and sufficient criterion is given so that the relative value functions and differential costs produced by the value iteration scheme converge pointwise to the solution of the optimality equation; this criterion is applied to obtain convergence results when the cost function is bounded below or bounded above.

Value iteration in a class of average controlled Markov chains with unbounded costs: necessary and sufficient conditions for pointwise convergence

1996 ◽  
Vol 33 (04) ◽  
pp. 986-1002 ◽  
Author(s):  
Rolando Cavazos-Cadena ◽  
Emmanuel Fernández-Gaucherand
Keyword(s):  
Markov Chains ◽  
Cost Function ◽  
Sufficient Conditions ◽  
Value Functions ◽  
Value Iteration ◽  
Controlled Markov Chains ◽  
Cost Criterion ◽  
Convergence Results ◽  
Differential Costs ◽  
Necessary And Sufficient

This work concerns controlled Markov chains with denumerable state space, (possibly)unboundedcost function, and an expectedaveragecost criterion. Under aLyapunov function condition, together with mild continuity-compactness assumptions, a simplenecessary and sufficientcriterion is given so that the relative value functions and differential costs produced by thevalue iterationscheme converge pointwise to the solution of the optimality equation; this criterion is applied to obtain convergence results when the cost function is bounded below or bounded above.

Controlled Semi-Markov Chains with Risk-Sensitive Average Cost Criterion

2016 ◽  
Vol 170 (2) ◽  
pp. 670-686 ◽  
Author(s):  
Selene Chávez-Rodríguez ◽  
Rolando Cavazos-Cadena ◽  
Hugo Cruz-Suárez
Keyword(s):  
Markov Chains ◽  
Average Cost ◽  
Average Cost Criterion ◽  
Cost Criterion ◽  
Risk Sensitive
Sign in / Sign up

Export Citation Format

Share Document