Total travel costs minimization strategy of a dual-stack fuel cell logistics truck enhanced with artificial potential field and deep reinforcement learning

Energy ◽  
2022 ◽  
Vol 239 ◽  
pp. 121866
Author(s):  
Jianhao Zhou ◽  
Jun Liu ◽  
Yuan Xue ◽  
Yuhui Liao
Keyword(s):  
Reinforcement Learning ◽  
Fuel Cell ◽  
Potential Field ◽  
Artificial Potential Field ◽  
Travel Costs ◽  
Dual Stack

scholarly journals Path Planning Method With Improved Artificial Potential Field—A Reinforcement Learning Perspective

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 135513-135523
Author(s):  
Qingfeng Yao ◽  
Zeyu Zheng ◽  
Liang Qi ◽  
Haitao Yuan ◽  
Xiwang Guo ◽  
...  
Keyword(s):  
Reinforcement Learning ◽  
Path Planning ◽  
Potential Field ◽  
Planning Method ◽  
Artificial Potential Field

Intelligent obstacle avoidance path planning method for picking manipulator combined with artificial potential field method

2022 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Zheng Fang ◽  
Xifeng Liang
Keyword(s):  
Genetic Algorithm ◽  
Reinforcement Learning ◽  
Path Planning ◽  
Obstacle Avoidance ◽  
Potential Field ◽  
Field Method ◽  
Planning Method ◽  
Artificial Potential Field ◽  
Content Type ◽  
Artificial Potential Field Method

Purpose The results of obstacle avoidance path planning for the manipulator using artificial potential field (APF) method contain a large number of path nodes, which reduce the efficiency of manipulators. This paper aims to propose a new intelligent obstacle avoidance path planning method for picking robot to improve the efficiency of manipulators. Design/methodology/approach To improve the efficiency of the robot, this paper proposes a new intelligent obstacle avoidance path planning method for picking robot. In this method, we present a snake-tongue algorithm based on slope-type potential field and combine the snake-tongue algorithm with genetic algorithm (GA) and reinforcement learning (RL) to reduce the path length and the number of path nodes in the path planning results. Findings Simulation experiments were conducted with tomato string picking manipulator. The results showed that the path length is reduced from 4.1 to 2.979 m, the number of nodes is reduced from 31 to 3 and the working time of the robot is reduced from 87.35 to 37.12 s, after APF method combined with GA and RL. Originality/value This paper proposes a new improved method of APF, and combines it with GA and RL. The experimental results show that the new intelligent obstacle avoidance path planning method proposed in this paper is beneficial to improve the efficiency of the robotic arm. Graphical abstract Figure 1 According to principles of bionics, we propose a new path search method, snake-tongue algorithm, based on a slope-type potential field. At the same time, we use genetic algorithm to strengthen the ability of the artificial potential field method for path searching, so that it can complete the path searching in a variety of complex obstacle distribution situations with shorter path searching results. Reinforcement learning is used to reduce the number of path nodes, which is good for improving the efficiency of robot work. The use of genetic algorithm and reinforcement learning lays the foundation for intelligent control.

Solution to reinforcement learning problems with artificial potential field

2008 ◽  
Vol 15 (4) ◽  
pp. 552-557 ◽  
Author(s):  
Li-juan Xie ◽  
Guang-rong Xie ◽  
Huan-wen Chen ◽  
Xiao-li Li
Keyword(s):  
Reinforcement Learning ◽  
Potential Field ◽  
Learning Problems ◽  
Artificial Potential Field

scholarly journals An obstacles avoidance method for serial manipulator based on reinforcement learning and Artificial Potential Field

2021 ◽  
Author(s):  
Haoxuan Li ◽  
Daoxiong Gong ◽  
Jianjun Yu
Keyword(s):  
Reinforcement Learning ◽  
Potential Field ◽  
Avoidance Performance ◽  
Field Method ◽  
Artificial Potential Field ◽  
Simulation Experiments ◽  
Reward Function ◽  
Physical Experiments ◽  
Different Types ◽  
Artificial Potential Field Method

AbstractThe obstacles avoidance of manipulator is a hot issue in the field of robot control. Artificial Potential Field Method (APFM) is a widely used obstacles avoidance path planning method, which has prominent advantages. However, APFM also has some shortcomings, which include the inefficiency of avoiding obstacles close to target or dynamic obstacles. In view of the shortcomings of APFM, Reinforcement Learning (RL) only needs an automatic learning model to continuously improve itself in the specified environment, which makes it capable of optimizing APFM theoretically. In this paper, we introduce an approach hybridizing RL and APFM to solve those problems. We define the concepts of Distance reinforcement factors (DRF) and Force reinforcement factors (FRF) to make RL and APFM integrated more effectively. We disassemble the reward function of RL into two parts through DRF and FRF, and make them activate in different situations to optimize APFM. Our method can obtain better obstacles avoidance performance through finding the optimal strategy by RL, and the effectiveness of the proposed algorithm is verified by multiple sets of simulation experiments, comparative experiments and physical experiments in different types of obstacles. Our approach is superior to traditional APFM and the other improved APFM method in avoiding collisions and approaching obstacles avoidance. At the same time, physical experiments verify the practicality of the proposed algorithm.

Sign in / Sign up

Export Citation Format

Share Document