scholarly journals Multi-objective Model Checking of Markov Decision Processes

Author(s):  
K. Etessami ◽  
M. Kwiatkowska ◽  
M. Y. Vardi ◽  
M. Yannakakis
Author(s):  
Kousha Etessami ◽  
Marta Kwiatkowska ◽  
Moshe Vardi ◽  
Mihalis Yannakakis

2013 ◽  
Vol 15 (2) ◽  
pp. 258-270 ◽  
Author(s):  
F. Pianosi ◽  
A. Castelletti ◽  
M. Restelli

Multi-objective Markov decision processes (MOMDPs) provide an effective modeling framework for decision-making problems involving water systems. The traditional approach is to define many single-objective problems (resulting from different combinations of the objectives), each solvable by standard optimization. This paper presents an approach based on reinforcement learning (RL) that can learn the operating policies for all combinations of objectives in a single training process. The key idea is to enlarge the approximation of the action-value function, which is performed by single-objective RL over the state-action space, to the space of the objectives' weights. The batch-mode nature of the algorithm allows for enriching the training dataset without further interaction with the controlled system. The approach is demonstrated on a numerical test case study and evaluated on a real-world application, the Hoa Binh reservoir, Vietnam. Experimental results on the test case show that the proposed approach (multi-objective fitted Q-iteration; MOFQI) becomes computationally preferable over the repeated application of its single-objective version (fitted Q-iteration; FQI) when evaluating more than five weight combinations. In the Hoa Binh case study, the operating policies computed with MOFQI and FQI have comparable efficiency, while MOFQI provides a continuous approximation of the Pareto frontier with no additional computing costs.


2014 ◽  
Vol 36 (12) ◽  
pp. 2587-2600
Author(s):  
Cong-Hua ZHOU ◽  
Zhi-Hu XING ◽  
Zhi-Feng LIU ◽  
Chang-Da WANG

2012 ◽  
Vol 103 ◽  
pp. 49-63 ◽  
Author(s):  
Hua Mao ◽  
Yingke Chen ◽  
Manfred Jaeger ◽  
Thomas D. Nielsen ◽  
Kim G. Larsen ◽  
...  

2021 ◽  
pp. 129-138
Author(s):  
Ekaterina Sedova ◽  
Lawrence Mandow ◽  
José-Luis Pérez-de-la-Cruz

Sign in / Sign up

Export Citation Format

Share Document