Laser vision seam tracking system based on proximal policy optimization

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Yanbiao Zou ◽  
Hengchang Zhou

Purpose This paper aims to propose a weld seam tracking method based on proximal policy optimization (PPO). Design/methodology/approach By constructing a neural network based on PPO and using the reference image block and the image block to be detected as the dual-channel input of the network, the method predicts the translation relation between the two images and corrects the location of feature points in the weld image. The localization accuracy estimation network (LAE-Net) is built to update the reference image block during the welding process, which is helpful to reduce the tracking error. Findings Off-line simulation results show that the proposed algorithm has strong robustness and performs well on the test set of curved seam images with strong noise. In the welding experiment, the movement of welding torch is stable, the molten material is uniform and smooth and the welding error is small, which can meet the requirements of industrial production. Originality/value The idea of image registration is applied to weld seam tracking, and the weld seam tracking network is built on the basis of PPO. In order to further improve the tracking accuracy, the LAE-Net is constructed and the reference images can be updated.

2013 ◽  
Vol 683 ◽  
pp. 725-728
Author(s):  
Bo Chen ◽  
Chuan Bao Jia ◽  
Ji Cai Feng

Weld seam tracking system is urgently needed in weld automation process, but it has not been well studied in underwater weld applications. This paper used visual sensor to automatically monitor the weld seam in underwater wet weld process, and image processing algorithms were developed to remove the influence of water environment on the captured image and automatically obtain the weld torch deviation, and the weld torch was adjusted automatically according to the deviation obtained by the image, experiment results showed that the system could meet the requirements of underwater wet welding process.


2015 ◽  
Vol 1088 ◽  
pp. 824-828 ◽  
Author(s):  
Jong Pyo Lee ◽  
Qian Qian Wu ◽  
Min Ho Park ◽  
Cheol Kyun Park ◽  
Ill Soo Kim

In modern market, achieving mechanical and automatic arc welding process is the key issue to be solved in welding industries. Because of the high complexity of the welding environment, manual detection of the weld line information is hard to be successful and time consuming. Therefore, this study aim at developing a new image processing algorithm for seam tracking system in Gas Metal Arc (GMA) welding by modified Hough algorithm based on the laser vision system. Firstly, noises in the captured weld seam images by CCD camera were effectively removed by noise filtering algorithm and then weld joint position were detected by the modified Hough algorithm to realize the automatic weld seam tracking. To verify the efficiency of the developed image processing model, a common image processing method was employed and the processed results were compared with the proposed algorithm. Statistical results proved that the modified Hough algorithm was able to acquire the weld information precisely with less computing time and memory cost, which also capable for industrial application.


2021 ◽  
Author(s):  
Yanfeng Gao ◽  
Jianhua Xiao ◽  
Genliang Xiong ◽  
Hua Zhang

Abstract It is essential to sense the deviation of weld seam real-timely in robotic welding process. However, welding process always accompanied with high temperature, strong arc light and background noises, which significantly affects the application of sensors. In this study, a novel acoustic sensor was developed. This sensor consists of two microphones. Based on the sound signals collected by these two microphones, the deviation of weld seam was detected. The frequency response of the developed acoustic sensor was studied through simulation method firstly, and then the sensing performance of it was analyzed with experiments. The experimental results show that the developed acoustic sensor has a linear property for the deviation detection of V-groove weld seam. This research provides a novel method for weld seam tracking.


2021 ◽  
Author(s):  
Yinshui He ◽  
Zhuohua Yu ◽  
Ziyi Xiao ◽  
Jian Le

Abstract In this paper, a robust stable three-dimensional (3D) seam tracking method is investigate based on the Kalman filter (KF) and machine learning during the multipass gas metal arc welding process with a T-joint of 60 mm thickness. The laser vision sensor is used to profile the weld seam, and with the reference image captured before arcing a scheme is proposed to extract the variable weld seam profiles (WSPs) using scale-invariant feature transform and the clustering algorithm. An effective slope mutation detection method is presented to identify the feature points of the extracted WSP, namely the candidate welding positions. In order to lower the impact of fake welding positions on seam tracking, a Bayesian Network model is first built to implement fault detection and diagnosis for the visual feature measurement process using the involved process parameters and the trigger rule. A KF, as an estimator, is then established to further stabilize the tracking process combing with a self determination algorithm of the measurement result. With the visual calibration technology, 3D seam tracking is realized. Seam tracking results show that the proposed method overcomes the tremor of the tracking position and multiple fake candidate welding positions on tracking accuracy, and the tracking accuracy is 0.6 mm. This method provides potential industrial application value for industrial manufacturing with large-scale components.


2016 ◽  
Vol 91 (1-4) ◽  
pp. 751-761 ◽  
Author(s):  
Yu Huang ◽  
Gen Li ◽  
WenJun Shao ◽  
ShiHua Gong ◽  
XiaoLong Zhang

Sign in / Sign up

Export Citation Format

Share Document