Effectiveness of multi-gated sequence model for the learning of kinematics and dynamics of an industrial robot

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Aditya Singh ◽  
Padmakar Pandey ◽  
G.C. Nandi

Purpose For efficient trajectory control of industrial robots, a cumbersome computation for inverse kinematics and inverse dynamics is needed, which is usually developed using spatial transformation using Denavit–Hartenberg principle and Lagrangian or Newton–Euler methods, respectively. The model is highly non-linear and needs to deal with uncertainties because of lack of accurate measurement of mechanical parameters, noise and non-inclusion of joint friction, which results in some inaccuracies in predicting accurate torque trajectories. To get a guaranteed closed form solution, the robot designers normally follow Pieper’s recommendation and compromise with the mechanical design. While this may be acceptable for the industrial robots where the aesthetic look is not that important, it is not for humanoid and social robots. To help solve this problem, this study aims to propose an alternative machine learning-based computational approach based on a multi-gated sequence model for finding appropriate mapping between Cartesian space to joint space and motion space to joint torque space. Design/methodology/approach First, the authors generate sufficient data required for the sequence model, using forward kinematics and forward dynamics by running N number of nested loops, where N is the number of joints of the robot. Subsequently, to develop a learning-based model based on sequence analysis, the authors propose to use long short-term memory (LSTM) and hence, train an LSTM model, the architecture details of which have been discussed in the paper. To make LSTM learning algorithms perform efficiently, the authors need to detect and eliminate redundant features from the data set, which the authors propose to do using an elegant statistical tool called Pearson coefficient. Findings To validate the proposed model, the authors have performed rigorous experiments using both hardware and simulation robots (Baxter/Anukul robot) available in their laboratory and KUKA simulation robot data set made available from Neural Learning for Robotics Laboratory. Through several characteristic plots, it has been shown that a sequence-based LSTM model of deep learning architecture with non-redundant features could help the robots to learn smooth and accurate trajectories more quickly compared to data sets having redundancy. Such data-driven modeling techniques can change the future course of direction of robotics research for solving the classical problems such as trajectory planning and motion planning for manipulating industrial as well as social humanoid robots. Originality/value The present investigation involves development of deep learning-based computation model, statistical analyses to eliminate redundant features, data creation from one hardware robot (Anukul) and one simulation robot model (KUKA), rigorously training and testing separately two computational models (specially configured two LSTM models) – one for learning inverse kinematics and one for learning inverse dynamics problem – and comparison of the inverse dynamics model with the state-of-the-art model. Hence, the authors strongly believe that the present paper is compact and complete to get published in a reputed journal so that dissemination of new ideas can benefit the researchers in the area of robotics.

2017 ◽  
Vol 37 (1) ◽  
pp. 1-12 ◽  
Author(s):  
Haluk Ay ◽  
Anthony Luscher ◽  
Carolyn Sommerich

Purpose The purpose of this study is to design and develop a testing device to simulate interaction between human hand–arm dynamics, right-angle (RA) computer-controlled power torque tools and joint-tightening task-related variables. Design/methodology/approach The testing rig can simulate a variety of tools, tasks and operator conditions. The device includes custom data-acquisition electronics and graphical user interface-based software. The simulation of the human hand–arm dynamics is based on the rig’s four-bar mechanism-based design and mechanical components that provide adjustable stiffness (via pneumatic cylinder) and mass (via plates) and non-adjustable damping. The stiffness and mass values used are based on an experimentally validated hand–arm model that includes a database of model parameters. This database is with respect to gender and working posture, corresponding to experienced tool operators from a prior study. Findings The rig measures tool handle force and displacement responses simultaneously. Peak force and displacement coefficients of determination (R2) between rig estimations and human testing measurements were 0.98 and 0.85, respectively, for the same set of tools, tasks and operator conditions. The rig also provides predicted tool operator acceptability ratings, using a data set from a prior study of discomfort in experienced operators during torque tool use. Research limitations/implications Deviations from linearity may influence handle force and displacement measurements. Stiction (Coulomb friction) in the overall rig, as well as in the air cylinder piston, is neglected. The rig’s mechanical damping is not adjustable, despite the fact that human hand–arm damping varies with respect to gender and working posture. Deviations from these assumptions may affect the correlation of the handle force and displacement measurements with those of human testing for the same tool, task and operator conditions. Practical implications This test rig will allow the rapid assessment of the ergonomic performance of DC torque tools, saving considerable time in lineside applications and reducing the risk of worker injury. DC torque tools are an extremely effective way of increasing production rate and improving torque accuracy. Being a complex dynamic system, however, the performance of DC torque tools varies in each application. Changes in worker mass, damping and stiffness, as well as joint stiffness and tool program, make each application unique. This test rig models all of these factors and allows quick assessment. Social implications The use of this tool test rig will help to identify and understand risk factors that contribute to musculoskeletal disorders (MSDs) associated with the use of torque tools. Tool operators are subjected to large impulsive handle reaction forces, as joint torque builds up while tightening a fastener. Repeated exposure to such forces is associated with muscle soreness, fatigue and physical stress which are also risk factors for upper extremity injuries (MSDs; e.g. tendinosis, myofascial pain). Eccentric exercise exertions are known to cause damage to muscle tissue in untrained individuals and affect subsequent performance. Originality/value The rig provides a novel means for quantitative, repeatable dynamic evaluation of RA powered torque tools and objective selection of tightening programs. Compared to current static tool assessment methods, dynamic testing provides a more realistic tool assessment relative to the tool operator’s experience. This may lead to improvements in tool or controller design and reduction in associated musculoskeletal discomfort in operators.


Author(s):  
Yi Liu ◽  
Ming Cong ◽  
Hang Dong ◽  
Dong Liu

Purpose The purpose of this paper is to propose a new method based on three-dimensional (3D) vision technologies and human skill integrated deep learning to solve assembly positioning task such as peg-in-hole. Design/methodology/approach Hybrid camera configuration was used to provide the global and local views. Eye-in-hand mode guided the peg to be in contact with the hole plate using 3D vision in global view. When the peg was in contact with the workpiece surface, eye-to-hand mode provided the local view to accomplish peg-hole positioning based on trained CNN. Findings The results of assembly positioning experiments proved that the proposed method successfully distinguished the target hole from the other same size holes according to the CNN. The robot planned the motion according to the depth images and human skill guide line. The final positioning precision was good enough for the robot to carry out force controlled assembly. Practical implications The developed framework can have an important impact on robotic assembly positioning process, which combine with the existing force-guidance assembly technology as to build a whole set of autonomous assembly technology. Originality/value This paper proposed a new approach to the robotic assembly positioning based on 3D visual technologies and human skill integrated deep learning. Dual cameras swapping mode was used to provide visual feedback for the entire assembly motion planning process. The proposed workpiece positioning method provided an effective disturbance rejection, autonomous motion planning and increased overall performance with depth images feedback. The proposed peg-hole positioning method with human skill integrated provided the capability of target perceptual aliasing avoiding and successive motion decision for the robotic assembly manipulation.


Author(s):  
Joanne Pransky

Purpose The following paper is a “Q&A interview” conducted by Joanne Pransky of Industrial Robot Journal as a method to impart the combined technological, business and personal experience of a prominent, robotic industry PhD-turned-entrepreneur regarding the commercialization and challenges of bringing a technological invention to market. This paper aims to discuss these issues. Design/methodology/approach The interviewee is Dr Jun Ho Oh, Professor of Mechanical Engineering at the Korea Advanced Institute of Science and Technology (KAIST) and Director of KAIST’s Hubolab. Determined to build a humanoid robot in the early 2000s to compete with Japan’s humanoids, Dr Oh and KAIST created the KHR1. This research led to seven more advanced versions of a biped humanoid robot and the founding of the Robot for Artificial Intelligence and Boundless Walking (Rainbow) Co., a professional technological mechatronics company. In this interview, Dr Oh shares the history and success of Korea’s humanoid robot research. Findings Dr Oh received his BSc in 1977 and MSc in Mechanical Engineering in 1979 from Yonsei University. Oh worked as a Researcher for the Korea Atomic Energy Research Institute before receiving his PhD from the University of California (UC) Berkeley in mechanical engineering in 1985. After his PhD, Oh remained at UC Berkeley to do Postdoctoral research. Since 1985, Oh has been a Professor of Mechanical Engineering at KAIST. He was a Visiting Professor from 1996 to 1997 at the University of Texas Austin. Oh served as the Vice President of KAIST from 2013-2014. In addition to teaching, Oh applied his expertise in robotics, mechatronics, automatic and real-time control to the commercial development of a series of humanoid robots. Originality/value Highly self-motivated and always determined, Dr Oh’s initial dream of building the first Korean humanoid bipedal robot has led him to become one of the world leaders of humanoid robots. He has contributed widely to the field over the nearly past two decades with the development of five versions of the HUBO robot. Oh led Team KAIST to win the 2015 DARPA Robotics Challenge (DRC) and a grand prize of US$2m with its humanoid robot DRC-HUBO+, beating 23 teams from six countries. Oh serves as a robotics policy consultant for the Korean Ministry of Commerce Industry and Energy. He was awarded the 2016 Changjo Medal for Science and Technology, the 2016 Ho-Am Prize for engineering, and the 2010 KAIST Distinguished Professor award. He is a member of the Korea Academy of Science and Technology.


Author(s):  
LianZheng Ge ◽  
Jian Chen ◽  
Ruifeng Li ◽  
Peidong Liang

Purpose The global performance of industrial robots partly depends on the properties of drive system consisting of motor inertia, gearbox inertia, etc. This paper aims to deal with the problem of optimization of global dynamic performance for robotic drive system selected from available components. Design/methodology/approach Considering the performance specifications of drive system, an optimization model whose objective function is composed of working efficiency and natural frequency of robots is proposed. Meanwhile, constraints including the rated and peak torque of motor, lifetime of gearbox and light-weight were taken into account. Furthermore, the mapping relationship between discrete optimal design variables and component properties of drive system were presented. The optimization problem with mixed integer variables was solved by a mixed integer-laplace crossover power mutation algorithm. Findings The optimization results show that our optimization model and methods are applicable, and the performances are also greatly promoted without sacrificing any constraints of drive system. Besides, the model fits the overall performance well with respect to light-weight ratio, safety, cost reduction and others. Practical implications The proposed drive system optimization method has been used for a 4-DOF palletizing robot, which has been largely manufactured in a factory. Originality/value This paper focuses on how the simulation-based optimization can be used for the purpose of generating trade-offs between cost, performance and lifetime when designing robotic drive system. An applicable optimization model and method are proposed to handle the dynamic performance optimization problem of a drive system for industrial robot.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
BinBin Zhang ◽  
Fumin Zhang ◽  
Xinghua Qu

Purpose Laser-based measurement techniques offer various advantages over conventional measurement techniques, such as no-destructive, no-contact, fast and long measuring distance. In cooperative laser ranging systems, it’s crucial to extract center coordinates of retroreflectors to accomplish automatic measurement. To solve this problem, this paper aims to propose a novel method. Design/methodology/approach We propose a method using Mask RCNN (Region Convolutional Neural Network), with ResNet101 (Residual Network 101) and FPN (Feature Pyramid Network) as the backbone, to localize retroreflectors, realizing automatic recognition in different backgrounds. Compared with two other deep learning algorithms, experiments show that the recognition rate of Mask RCNN is better especially for small-scale targets. Based on this, an ellipse detection algorithm is introduced to obtain the ellipses of retroreflectors from recognized target areas. The center coordinates of retroreflectors in the camera coordinate system are obtained by using a mathematics method. Findings To verify the accuracy of this method, an experiment was carried out: the distance between two retroreflectors with a known distance of 1,000.109 mm was measured, with 2.596 mm root-mean-squar error, meeting the requirements of the coarse location of retroreflectors. Research limitations/implications The research limitations/implications are as follows: (i) As the data set only has 200 pictures, although we have used some data augmentation methods such as rotating, mirroring and cropping, there is still room for improvement in the generalization ability of detection. (ii) The ellipse detection algorithm needs to work in relatively dark conditions, as the retroreflector is made of stainless steel, which easily reflects light. Originality/value The originality/value of the article lies in being able to obtain center coordinates of multiple retroreflectors automatically even in a cluttered background; being able to recognize retroreflectors with different sizes, especially for small targets; meeting the recognition requirement of multiple targets in a large field of view and obtaining 3 D centers of targets by monocular model-based vision.


Author(s):  
Guanghui Liu ◽  
Qiang Li ◽  
Lijin Fang ◽  
Bing Han ◽  
Hualiang Zhang

Purpose The purpose of this paper is to propose a new joint friction model, which can accurately model the real friction, especially in cases with sudden changes in the motion direction. The identification and sensor-less control algorithm are investigated to verify the validity of this model. Design/methodology/approach The proposed friction model is nonlinear and it considers the angular displacement and angular velocity of the joint as a secondary compensation for identification. In the present study, the authors design a pipeline – including a manually designed excitation trajectory, a weighted least squares algorithm for identifying the dynamic parameters and a hand guiding controller for the arm’s direct teaching. Findings Compared with the conventional joint friction model, the proposed method can effectively predict friction factors during the dynamic motion of the arm. Then friction parameters are quantitatively obtained and compared with the proposed friction model and the conventional friction model indirectly. It is found that the average root mean square error of predicted six joints in the proposed method decreases by more than 54%. The arm’s force control with the full torque using the estimated dynamic parameters is qualitatively studied. It is concluded that a light-weight industrial robot can be dragged smoothly by the hand guiding. Practical implications In the present study, a systematic pipeline is proposed for identifying and controlling an industrial arm. The whole procedure has been verified in a commercial six DOF industrial arm. Based on the conducted experiment, it is found that the proposed approach is more accurate in comparison with conventional methods. A hand-guiding demo also illustrates that the proposed approach can provide the industrial arm with the full torque compensation. This essential functionality is widely required in many industrial arms such as kinaesthetic teaching. Originality/value First, a new friction model is proposed. Based on this model, identifying the dynamic parameter is carried out to obtain a set of model parameters of an industrial arm. Finally, a smooth hand guiding control is demonstrated based on the proposed dynamic model.


Author(s):  
Tuna Balkan ◽  
M. Kemal Özgören ◽  
M. A. Sahir Arikan ◽  
H. Murat Baykurt

Abstract In this study, an inverse kinematic solution approach applicable to six degree-of-freedom industrial robotic manipulators is introduced. The approach is based on a previously introduced kinematic classification of industrial robotic manipulators by Balkan et al. (1999), and depending on the kinematic structure, either an analytical or a semi-analytical inverse kinematic solution is obtained. The semi-analytical method is named as the parametrized joint variable (PJV) method. Compact forward kinematic equations obtained by utilizing the properties of exponential rotation matrices. In the inverse kinematic solutions of the industrial robots surveyed in the previous study, most of the simplified compact equations can be solved analytically and the remaining few of them can be solved semi-analytically through a numerical solution of a single univariate equation. In these solutions, the singularities and the multiple configurations of the manipulators can be determined easily. By the method employed in this study, the kinematic and inverse kinematic analysis of any manipulator or designed-to-be manipulator can be performed and using the solutions obtained, the inverse kinematics can also be computerized by means of short and fast algorithms. As an example for the demonstration of the applicability of the presented method to manipulators with closed-chains, ABB IRB2000 industrial robot is selected which has a four-bar mechanism for the actuation of the third link, and its compact forward kinematic equations are given as well as the inverse kinematic solution.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Zhengtuo Wang ◽  
Yuetong Xu ◽  
Guanhua Xu ◽  
Jianzhong Fu ◽  
Jiongyan Yu ◽  
...  

Purpose In this work, the authors aim to provide a set of convenient methods for generating training data, and then develop a deep learning method based on point clouds to estimate the pose of target for robot grasping. Design/methodology/approach This work presents a deep learning method PointSimGrasp on point clouds for robot grasping. In PointSimGrasp, a point cloud emulator is introduced to generate training data and a pose estimation algorithm, which, based on deep learning, is designed. After trained with the emulation data set, the pose estimation algorithm could estimate the pose of target. Findings In experiment part, an experimental platform is built, which contains a six-axis industrial robot, a binocular structured-light sensor and a base platform with adjustable inclination. A data set that contains three subsets is set up on the experimental platform. After trained with the emulation data set, the PointSimGrasp is tested on the experimental data set, and an average translation error of about 2–3 mm and an average rotation error of about 2–5 degrees are obtained. Originality/value The contributions are as follows: first, a deep learning method on point clouds is proposed to estimate 6D pose of target; second, a convenient training method for pose estimation algorithm is presented and a point cloud emulator is introduced to generate training data; finally, an experimental platform is built, and the PointSimGrasp is tested on the platform.


2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Saroj Kumar Pandey ◽  
Rekh Ram Janghel

PurposeAccording to the World Health Organization, arrhythmia is one of the primary causes of deaths across the globe. In order to reduce mortality rate, cardiovascular disease should be properly identified and the proper treatment for the same should be immediately provided to the patients. The objective of this paper was to implement a better heartbeat classification model which will work better than the other implemented heartbeat classification methods.Design/methodology/approachIn this paper, the ensemble of two deep learning models is proposed to classify the MIT-BIH arrhythmia database into four different classes according to ANSI-AAMI standards. First, a convolutional neural network (CNN) model is used to classify heartbeats on a raw data set. Secondly, four features (wavelets, R-R intervals, morphological and higher-order statistics) are extracted from the data set and then applied to a long short-term memory (LSTM) model to classify the heartbeats. Finally, the ensemble of CNN and LSTM model with sum rule, product rule and majority voting has been used to identify the heartbeat classes.FindingsAmong these, the highest accuracy obtained is 98.58% using ensemble method with product rule. The results show that the ensemble of CNN and BLSTM has offered satisfactory performance compared to other techniques discussed in this study.Originality/valueIn this study, we have developed a new combination of two deep learning models to enhance the performance of arrhythmia classification using segmentation of input ECG signals. The contributions of this study are as follows: First, a deep CNN model is built to classify ECG heartbeat using a raw data set. Second, four types of features (R-R interval, HOS, morphological and wavelet) were extracted from the raw data set and then applied to the bidirectional LSTM model to classify the ECG heartbeat. Third, combination rules (sum rules, product rules and majority voting rules) were tested to ensure the accumulated probabilities of the CNN and LSTM models.


Author(s):  
Yang Chuangui ◽  
Liu Xingbao ◽  
Yue Xiaobin ◽  
Mi Liang ◽  
Wang Junwen ◽  
...  

PurposeThis paper aims to solve the nonlinear problem in the uncertainty evaluation of the measurement of the positioning repeatability (RP) of industrial robots and provide guidance to restrict the uncertainty of measurement of RP (uRP).Design/methodology/approachFirstly, some uncertain sources existing in the measurement procedure of RP are identified. Secondly, the probability distribution function (PDF) of every source is established on the basis of its measurements. Some spatial combined normal distributions are adopted. Then, a method, based on Monte Carlo method (MCM) and established measurement model, is developed for the estimation ofuRP. Thirdly, some tests are developed for the identification and validation of the selected PDFs of uncertain sources. Afterwards, the proposed method is applied for the evaluation and validation of theuRP. Finally, influence analyses of some key factors are proposed for the quantification of their relative contributions touRP.FindingsResults show that the proposed method can reasonably and objectively estimate theuRPof the selected industrial robot, and changes of the industrial robots’ position and the laser trackers measurement are correlated. Additionally, theuRPof the selected industrial robot can be restricted by using the results of its key factors onuRP.Originality/valueThis paper proposes the spatial combined normal distribution to model the uncertainty of the repeatability of the laser tracker and industrial robot. Meanwhile, the proposed method and influence analyses can be used in estimating and restricting theuRPand thus useful in determining whether the RP of a tested industrial robot meets its requirements.


Sign in / Sign up

Export Citation Format

Share Document