Markov Decision Process Model for Path Selection Algorithm on Multi-Business System with Services Composition

2010 ◽  
Vol 5 (9) ◽  
pp. 45-53
Author(s):  
LiYue Zhu ◽  
ZiLei Wang ◽  
HongSheng Xi
Keyword(s):  
Markov Decision Process ◽  
Decision Process ◽  
Process Model ◽  
Path Selection ◽  
Selection Algorithm ◽  
Services Composition ◽  
Business System ◽  
Markov Decision

scholarly journals Using Markov Decision Process Model with Logic Scoring of Preference Model to Optimize HTN Web Services Composition

2011 ◽  
Vol 8 (2) ◽  
pp. 53-73 ◽  
Author(s):  
Jiuyun Xu ◽  
Kun Chen ◽  
Stephan Reiff-Marganiec
Keyword(s):  
Web Services ◽  
Markov Decision Process ◽  
Decision Process ◽  
Process Model ◽  
Ai Planning ◽  
Web Services Composition ◽  
Services Composition ◽  
Composition Problem ◽  
Htn Planning ◽  
Markov Decision

Automatic Web services composition can be achieved using AI planning techniques. HTN planning has been adopted to handle the OWL-S Web service composition problem. However, existing composition methods based on HTN planning have not considered the choice of decompositions available to a problem, which can lead to a variety of valid solutions. In this paper, the authors propose a model of combining a Markov decision process model and HTN planning to address Web services composition. In the model, HTN planning is enhanced to decompose a task in multiple ways and find more than one plan, taking into account both functional and non-functional properties. Furthermore, an evaluation method to choose the optimal plan and experimental results illustrate that the proposed approach works effectively. The paper extends previous work by refining a number of aspects of the approach and applying it to a realistic case study.

Coffee, Tea, or …?: A Markov Decision Process Model for Airline Meal Provisioning

2004 ◽  
Vol 38 (1) ◽  
pp. 107-118 ◽  
Author(s):  
Jason H. Goto ◽  
Mark E. Lewis ◽  
Martin L. Puterman
Keyword(s):  
Markov Decision Process ◽  
Decision Process ◽  
Process Model ◽  
Markov Decision
Sign in / Sign up

Export Citation Format

Share Document