scholarly journals Towards Hierarchical Task Decomposition using Deep Reinforcement Learning for Pick and Place Subtasks

Author(s):  
Luca Marzari ◽  
Ameya Pore ◽  
Diego Dall'Alba ◽  
Gerardo Aragon-Camarasa ◽  
Alessandro Farinelli ◽  
...  
Robotics ◽  
2021 ◽  
Vol 10 (3) ◽  
pp. 105
Author(s):  
Andrew Lobbezoo ◽  
Yanjun Qian ◽  
Hyock-Ju Kwon

The field of robotics has been rapidly developing in recent years, and the work related to training robotic agents with reinforcement learning has been a major focus of research. This survey reviews the application of reinforcement learning for pick-and-place operations, a task that a logistics robot can be trained to complete without support from a robotics engineer. To introduce this topic, we first review the fundamentals of reinforcement learning and various methods of policy optimization, such as value iteration and policy search. Next, factors which have an impact on the pick-and-place task, such as reward shaping, imitation learning, pose estimation, and simulation environment are examined. Following the review of the fundamentals and key factors for reinforcement learning, we present an extensive review of all methods implemented by researchers in the field to date. The strengths and weaknesses of each method from literature are discussed, and details about the contribution of each manuscript to the field are reviewed. The concluding critical discussion of the available literature, and the summary of open problems indicates that experiment validation, model generalization, and grasp pose selection are topics that require additional research.


2021 ◽  
pp. 251-265
Author(s):  
Natanael Magno Gomes ◽  
Felipe N. Martins ◽  
José Lima ◽  
Heinrich Wörtche

2019 ◽  
Vol 9 (2) ◽  
pp. 348 ◽  
Author(s):  
Ander Iriondo ◽  
Elena Lazkano ◽  
Loreto Susperregi ◽  
Julen Urain ◽  
Ane Fernandez ◽  
...  

Programming robots to perform complex tasks is a very expensive job. Traditional path planning and control are able to generate point to point collision free trajectories, but when the tasks to be performed are complex, traditional planning and control become complex tasks. This study focused on robotic operations in logistics, specifically, on picking objects in unstructured areas using a mobile manipulator configuration. The mobile manipulator has to be able to place its base in a correct place so the arm is able to plan a trajectory up to an object in a table. A deep reinforcement learning (DRL) approach was selected to solve this type of complex control tasks. Using the arm planner’s feedback, a controller for the robot base is learned, which guides the platform to such a place where the arm is able to plan a trajectory up to the object. In addition the performance of two DRL algorithms ((Deep Deterministic Policy Gradient (DDPG)) and (Proximal Policy Optimisation (PPO)) is compared within the context of a concrete robotic task.


Sign in / Sign up

Export Citation Format

Share Document