BIOINSPIRED NEURAL NETWORK-BASED Q-LEARNING APPROACH FOR ROBOT PATH PLANNING IN UNKNOWN ENVIRONMENTS

Author(s):  
Jianjun Ni ◽  
Xinyun Li ◽  
Mingang Hua ◽  
Simon X. Yang
Author(s):  
Yongmin Zhong ◽  
Bijan Shirinzadeh ◽  
Xiaobu Yuan

This paper presents a new methodology based on neural dynamics for optimal robot path planning by drawing an analogy between cellular neural network (CNN) and path planning of mobile robots. The target activity is treated as an energy source injected into the neural system and is propagated through the local connectivity of cells in the state space by neural dynamics. By formulating the local connectivity of cells as the local interaction of harmonic functions, an improved CNN model is established to propagate the target activity within the state space in the manner of physical heat conduction, which guarantees that the target and obstacles remain at the peak and the bottom of the activity landscape of the neural network. The proposed methodology cannot only generate real-time, smooth, optimal, and collision-free paths without any prior knowledge of the dynamic environment, but it can also easily respond to the real-time changes in dynamic environments. Further, the proposed methodology is parameter-independent and has an appropriate physical meaning.


2019 ◽  
pp. 491-511
Author(s):  
Yongmin Zhong ◽  
Bijan Shirinzadeh ◽  
Xiaobu Yuan

This paper presents a new methodology based on neural dynamics for optimal robot path planning by drawing an analogy between cellular neural network (CNN) and path planning of mobile robots. The target activity is treated as an energy source injected into the neural system and is propagated through the local connectivity of cells in the state space by neural dynamics. By formulating the local connectivity of cells as the local interaction of harmonic functions, an improved CNN model is established to propagate the target activity within the state space in the manner of physical heat conduction, which guarantees that the target and obstacles remain at the peak and the bottom of the activity landscape of the neural network. The proposed methodology cannot only generate real-time, smooth, optimal, and collision-free paths without any prior knowledge of the dynamic environment, but it can also easily respond to the real-time changes in dynamic environments. Further, the proposed methodology is parameter-independent and has an appropriate physical meaning.


2019 ◽  
Vol 9 (15) ◽  
pp. 3057 ◽  
Author(s):  
Hyansu Bae ◽  
Gidong Kim ◽  
Jonguk Kim ◽  
Dianwei Qian ◽  
Sukgyu Lee

This paper proposes a noble multi-robot path planning algorithm using Deep q learning combined with CNN (Convolution Neural Network) algorithm. In conventional path planning algorithms, robots need to search a comparatively wide area for navigation and move in a predesigned formation under a given environment. Each robot in the multi-robot system is inherently required to navigate independently with collaborating with other robots for efficient performance. In addition, the robot collaboration scheme is highly depends on the conditions of each robot, such as its position and velocity. However, the conventional method does not actively cope with variable situations since each robot has difficulty to recognize the moving robot around it as an obstacle or a cooperative robot. To compensate for these shortcomings, we apply Deep q learning to strengthen the learning algorithm combined with CNN algorithm, which is needed to analyze the situation efficiently. CNN analyzes the exact situation using image information on its environment and the robot navigates based on the situation analyzed through Deep q learning. The simulation results using the proposed algorithm shows the flexible and efficient movement of the robots comparing with conventional methods under various environments.


Sign in / Sign up

Export Citation Format

Share Document