Deep Learning from Demonstration for Motion Planning of Mobile Robot

Author(s):  
Joichiro SUMIYOSHI ◽  
Satoshi HOSHINO ◽  
Kenichiro UCHIDA ◽  
Tomoki YOSHIKAWA
Author(s):  
Yi Liu ◽  
Ming Cong ◽  
Hang Dong ◽  
Dong Liu

Purpose The purpose of this paper is to propose a new method based on three-dimensional (3D) vision technologies and human skill integrated deep learning to solve assembly positioning task such as peg-in-hole. Design/methodology/approach Hybrid camera configuration was used to provide the global and local views. Eye-in-hand mode guided the peg to be in contact with the hole plate using 3D vision in global view. When the peg was in contact with the workpiece surface, eye-to-hand mode provided the local view to accomplish peg-hole positioning based on trained CNN. Findings The results of assembly positioning experiments proved that the proposed method successfully distinguished the target hole from the other same size holes according to the CNN. The robot planned the motion according to the depth images and human skill guide line. The final positioning precision was good enough for the robot to carry out force controlled assembly. Practical implications The developed framework can have an important impact on robotic assembly positioning process, which combine with the existing force-guidance assembly technology as to build a whole set of autonomous assembly technology. Originality/value This paper proposed a new approach to the robotic assembly positioning based on 3D visual technologies and human skill integrated deep learning. Dual cameras swapping mode was used to provide visual feedback for the entire assembly motion planning process. The proposed workpiece positioning method provided an effective disturbance rejection, autonomous motion planning and increased overall performance with depth images feedback. The proposed peg-hole positioning method with human skill integrated provided the capability of target perceptual aliasing avoiding and successive motion decision for the robotic assembly manipulation.


2021 ◽  
Author(s):  
Muhammad Usman Sarwar ◽  
Moman Sohail ◽  
Muhayy Ud Din ◽  
Jan Rosell ◽  
Wajahat M Qazi

Author(s):  
Xin-Jun Liu ◽  
Zhao Gong ◽  
Fugui Xie ◽  
Shuzhan Shentu

In this paper, a mobile robot named VicRoB with 6 degrees of freedom (DOFs) driven by three tracked vehicles is designed and analyzed. The robot employs a 3-PPSR parallel configuration. The scheme of the mechanism and the inverse kinematic solution are given. A path planning method of a single tracked vehicle and a coordinated motion planning of three tracked vehicles are proposed. The mechanical structure and the electrical architecture of VicRoB prototype are illustrated. VicRoB can achieve the point-to-point motion mode and the continuous motion mode with employing the motion planning method. The orientation precision of VicRoB is measured in a series of motion experiments, which verifies the feasibility of the motion planning method. This work provides a kinematic basis for the orientation closed loop control of VicRoB whether it works on flat or rough road.


2020 ◽  
Vol 69 ◽  
pp. 471-500
Author(s):  
Shih-Yun Lo ◽  
Shiqi Zhang ◽  
Peter Stone

Intelligent mobile robots have recently become able to operate autonomously in large-scale indoor environments for extended periods of time. In this process, mobile robots need the capabilities of both task and motion planning. Task planning in such environments involves sequencing the robot’s high-level goals and subgoals, and typically requires reasoning about the locations of people, rooms, and objects in the environment, and their interactions to achieve a goal. One of the prerequisites for optimal task planning that is often overlooked is having an accurate estimate of the actual distance (or time) a robot needs to navigate from one location to another. State-of-the-art motion planning algorithms, though often computationally complex, are designed exactly for this purpose of finding routes through constrained spaces. In this article, we focus on integrating task and motion planning (TMP) to achieve task-level-optimal planning for robot navigation while maintaining manageable computational efficiency. To this end, we introduce TMP algorithm PETLON (Planning Efficiently for Task-Level-Optimal Navigation), including two configurations with different trade-offs over computational expenses between task and motion planning, for everyday service tasks using a mobile robot. Experiments have been conducted both in simulation and on a mobile robot using object delivery tasks in an indoor office environment. The key observation from the results is that PETLON is more efficient than a baseline approach that pre-computes motion costs of all possible navigation actions, while still producing plans that are optimal at the task level. We provide results with two different task planning paradigms in the implementation of PETLON, and offer TMP practitioners guidelines for the selection of task planners from an engineering perspective.


Sign in / Sign up

Export Citation Format

Share Document