Construction of Semi-Markov Decision Process Models of Continuous State Space Environments Using Growing Cell Structures and Multiagentk-Certainty Exploration Method
2009 ◽
Vol 13
(6)
◽
pp. 608-614
Keyword(s):
k-certainty exploration method, an efficient reinforcement learning algorithm, is not applied to environments whose state space is continuous because continuous state space must be changed to discrete state space. Our purpose is to construct discrete semi-Markov decision process (SMDP) models of such environments using growing cell structures to autonomously divide continuous state space then usingk-certainty exploration method to construct SMDP models. Multiagentk-certainty exploration method is then used to improve exploration efficiency. Mobile robot simulation demonstrated our proposal's usefulness and efficiency.
Keyword(s):
1985 ◽
Vol 17
(02)
◽
pp. 424-442
◽
1994 ◽
Vol 40
(3)
◽
pp. 253-288
◽
Keyword(s):
1974 ◽
Vol 11
(04)
◽
pp. 669-677
◽
1996 ◽
Vol 06
(12a)
◽
pp. 2375-2388
◽
1995 ◽
Vol 42
(1)
◽
pp. 93-108
◽
Keyword(s):