scholarly journals Combining Supervised Learning and Digital Twin for Autonomous Path-planning

2021 ◽  
Vol 54 (16) ◽  
pp. 7-15
Author(s):  
Chanjei Vasanthan ◽  
Dong T. Nguyen
2021 ◽  
Author(s):  
Xiaowei Guoa

Abstract Product assembly is an important stage in complex product manufacturing. How to intelligently plan the assembly process based on dynamic product and environment information has become an pressing issue needs to be addressed. For this reason, this research has constructed a digital twin assembly system, including virtual and real interactive feedback, data fusion analysis and decision-making iterative optimization modules. In the virtual space, a modified Q-learning algorithm is proposed to solve the path planning problem in product assembly. The proposed algorithm speeds up the convergence speed by adding dynamic reward function, optimizes the initial Q table by introducing knowledge and experience through the case-based reasoning (CBR) algorithm, and prevents entry into the trapped area through the obstacle avoiding method. Finally, take the six-joint robot UR10 as an example to verify the performance of the algorithm in the three-dimensional pathfinding space. The experimental results show that the modified Q-learning algorithm's pathfinding performance is significantly better than the original Q-learning algorithm.


Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3606
Author(s):  
Bogdan Trăsnea ◽  
Cosmin Ginerică ◽  
Mihai Zaha ◽  
Gigel Măceşanu ◽  
Claudiu Pozna ◽  
...  

Autonomous mobile robots are usually faced with challenging situations when driving in complex environments. Namely, they have to recognize the static and dynamic obstacles, plan the driving path and execute their motion. For addressing the issue of perception and path planning, in this paper, we introduce OctoPath, which is an encoder-decoder deep neural network, trained in a self-supervised manner to predict the local optimal trajectory for the ego-vehicle. Using the discretization provided by a 3D octree environment model, our approach reformulates trajectory prediction as a classification problem with a configurable resolution. During training, OctoPath minimizes the error between the predicted and the manually driven trajectories in a given training dataset. This allows us to avoid the pitfall of regression-based trajectory estimation, in which there is an infinite state space for the output trajectory points. Environment sensing is performed using a 40-channel mechanical LiDAR sensor, fused with an inertial measurement unit and wheels odometry for state estimation. The experiments are performed both in simulation and real-life, using our own developed GridSim simulator and RovisLab’s Autonomous Mobile Test Unit platform. We evaluate the predictions of OctoPath in different driving scenarios, both indoor and outdoor, while benchmarking our system against a baseline hybrid A-Star algorithm and a regression-based supervised learning method, as well as against a CNN learning-based optimal path planning method.


Diabetes ◽  
2020 ◽  
Vol 69 (Supplement 1) ◽  
pp. 1006-P
Author(s):  
BENYAMIN GROSMAN ◽  
ANIRBAN ROY ◽  
DI WU ◽  
NEHA PARIKH ◽  
LOUIS J. LINTEREUR ◽  
...  

Author(s):  
Edward Reutzel ◽  
Kevin Gombotz ◽  
Richard Martukanitz ◽  
Panagiotis Michaleris

2018 ◽  
Vol 2018 (15) ◽  
pp. 132-1-1323
Author(s):  
Shijie Zhang ◽  
Zhengtian Song ◽  
G. M. Dilshan P. Godaliyadda ◽  
Dong Hye Ye ◽  
Atanu Sengupta ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document