scholarly journals Deep Learning-Based Detection of Penetration from Weld Pool Reflection Images

2020 ◽  
Vol 99 (9) ◽  
pp. 239s-245s
Author(s):  
CHAO LI ◽  
◽  
QIYUE WANG ◽  
WENHUA JIAO ◽  
MICHAEL JOHNSON ◽  
...  

An innovative method was proposed to determine weld joint penetration using machine learning techniques. In our approach, the dot-structured laser images reflected from an oscillating weld pool surface were captured. Experienced welders typically evaluate the weld penetration status based on this reflected laser pattern. To overcome the challenges in identifying features and accurately processing the images using conventional machine vision algorithms, we proposed the use the raw images without any processing as the input to a convolutional neural network (CNN). The labels needed to train the CNN were the measured weld penetration states, obtained from the images on the backside of the workpiece as a set of discrete weld penetration categories. The raw data, images, and penetration state were generated from extensive experiments using an automated robotic gas tungsten arc welding process. Data augmentation was performed to enhance the robustness of the trained network, which led to 270,000 training examples, 45,000 validation examples, and 45,000 test examples. A six-layer convolutional neural net-work trained with a modified mini-batch gradient descent method led to a final testing accuracy of 90.7%. A voting mechanism based on three continuous images increased the classification accuracy to 97.6%.

1997 ◽  
Vol 119 (2) ◽  
pp. 161-169 ◽  
Author(s):  
R. Kovacevic ◽  
Y. M. Zhang

The arc weld pool is always deformed by plasma jet. In a previous study, a novel sensing mechanism was proposed to sense the free weld pool surface. The specular reflection of pulsed laser stripes from the mirror-like pool surface was captured by a CCD camera. The distorted laser stripes clearly depicted the 3D shape of the free pool surface. To monitor and control the welding process, the on-line acquisition of the reflection pattern is required. In this work, the captured image is analyzed to identify the torch and electrode. The weld pool edges are then detected. Because of the interference of the torch and electrode, the acquired pool boundary may be incomplete. To acquire the complete pool boundary, models have been fitted using the edge points. Finally, the stripes reflected from the weld pool are detected. Currently, the reflection pattern and pool boundary are being related to the weld penetration and used to control the weld penetration.


2018 ◽  
Vol 37 (5) ◽  
pp. 455-462 ◽  
Author(s):  
Jiankang Huang ◽  
Jing He ◽  
Xiaoying He ◽  
Yu Shi ◽  
Ding Fan

AbstractThe weld pool contains abundant information about the welding process. In particular, the type of the weld pool surface shape, i. e., convex or concave, is determined by the weld penetration. To detect it, an innovative laser-vision-based sensing method is employed to observe the weld pool surface of the gas tungsten arc welding (GTAW). A low-power laser dots pattern is projected onto the entire weld pool surface. Its reflection is intercepted by a screen and captured by a camera. Then the dynamic development process of the weld pool surface can be detected. By observing and analyzing, the change of the reflected laser dots reflection pattern, for shape of the weld pool surface shape, was found to closely correlate to the penetration of weld pool in the welding process. A mathematical model was proposed to correlate the incident ray, reflected ray, screen and surface of weld pool based on structured laser specular reflection. The dynamic variation of the weld pool surface and its corresponding dots laser pattern were simulated and analyzed. By combining the experimental data and the mathematical analysis, the results show that the pattern of the reflected laser dots pattern is closely correlated to the development of weld pool, such as the weld penetration. The concavity of the pool surface was found to increase rapidly after the surface shape was changed from convex to concave during the stationary GTAW process.


2021 ◽  
Author(s):  
Dongsheng Wu ◽  
Jiuling Huang ◽  
Kong Liang ◽  
Xueming Hua ◽  
Min Wang ◽  
...  

Abstract Self-developed high speed tandem TIG welding equipment were adopted to manufacture titanium welded tubes with high efficiency and high quality. The joint made by this high efficient welding process met Chinese standard requirements. A coupled electrode, arc and weld pool numerical model was also developed to investigate temperature and velocity distributions, and energy propagation of this welding process. The numerical results showed that the Marangoni stress was much higher than the arc shear stress, and was mainly positive after leading and trailing arcs in the x and y directions, so the molten metal flowed backward on the top weld pool surface. Previous studies proposed that a “pull-push” flow pattern defined as a backward molten metal flow after the leading arc and a forward molten metal flow before the trailing arc existed on the top weld pool surface in tandem arc welding processes, while it was not observed in this case. The calculated arc efficiency of the high speed tandem TIG welding was about 79.8%.


2020 ◽  
Author(s):  
Jiankang Huang ◽  
LIU Guangyin ◽  
HE Jing ◽  
YU Shurong ◽  
LIU Shien ◽  
...  

Abstract In order to study the dynamic characteristics of the weld pool surface during the TIG welding process of the filler wire, an observation test platform for the study of the three-dimensional surface behavior evolution of the TIG weld pool based on the grid structure laser was used to observe the weld pool surface and obtain the reflection grid laser image. The three-dimensional surface evolution of the fixed-point TIG welding pool is accurately restored by the three-dimensional recovery algorithm of the weld pool surface, so as to obtain the three-dimensional surface morphology of the weld pool. The difference between the obtained weld pool height and the experimental results is very small, and the results are basically the same.


2021 ◽  
Vol 100 (5) ◽  
Author(s):  
YONGCHAO CHENG ◽  
◽  
QIYUE WANG ◽  
WENHUA JIAO ◽  
JUN XIAO ◽  
...  

While penetration occurs underneath the workpiece, the raw information used to detect it during welding must be measurable to a sensor attached to the torch. Challenges are apparent because it is difficult to find such measurable raw information that fundamentally correlates with the phenomena occurring underneath. Additional challenges arise because the welding process is extremely complex such that analytically correlating any raw information to the underneath phenomena is practically impossible; therefore, handcrafted methods to propose features from raw information are human dependent and labor extensive. In this paper, the profile of the weld pool surface was proposed as the raw information. An innovative method was proposed to acquire it by projecting a single laser stripe on the weld pool surface transversely and intercepting its reflection from the mirror-like weld pool surface. To minimize human intervention, which can affect success, a deep-learning-based method was proposed to automatically recognize features from the single-stripe active vision images by fitting a convolutional neural network (CNN). To train the CNN, spot gas tungsten arc welding experiments were designed and conducted to collect the active vision images in pairs with their actual penetration states measured by a camera that views the backside surface of the workpiece. The CNN architecture was optimized by trying different hyperparameters, including kernel number, kernel size, and node number. The accuracy of the optimized model is about 98% and the cycle time in the personal computer is ~ 0.1 s, which fully meets the required engineering application.


Author(s):  
Jiankang Huang ◽  
Guangyin Liu ◽  
Jing He ◽  
Shurong Yu ◽  
Shien Liu ◽  
...  

2006 ◽  
Vol 129 (1) ◽  
pp. 180-189 ◽  
Author(s):  
Wei Lu ◽  
Y. M. Zhang ◽  
John Emmerson

Practical welding control systems require durable/compact sensors to sense the welding process and appropriate control algorithms to produce smooth welds. A novel arc welding sensor, referred to as nontransferred plasma charge sensor, which requires no additional attachment to the torch, has been proved to be reliable for weld pool surface sensing. Aiming at eliminating the effect of manufacturing conditions on the sensor performance, this paper proposes two simple yet effective methods. Specifically, reference signals are sampled either from the bottom or the top surface of the work-piece and used to define relative signals, which can measure the depth of the weld pool with better accuracy. Using improved sensing methods, two groups of welding control experiments, keyhole plasma arc welding and all-position pipe welding, have been conducted, and the effectiveness of the developed sensing/control systems in producing quality welds under various conditions is verified.


Author(s):  
Karem Tello ◽  
Ustun Duman ◽  
Patricio Mendez

The present work presents how scaling analysis can be applied into multiphysics and multicoupled problems related to welding processes. The formation of the weld pool surface depression in high current and velocity Gas Tungsten Arc Welding (GTAW) is dominated by the gas shear acting on the weld pool. Considering this dominant force the weld penetration was estimated and compared to experimental results. Plastic deformation and heat flow are coupled phenomena in Friction Stir Welding (FSW), the maximum temperature was estimated using scaling analysis and compared with experimental and numerical results reported in the literature. Although the simplicity of the scaling models, they are capable of capturing correct trends and order of magnitudes of the unknown estimations in a problem. Moreover, they are capable of determining the dominant forces that act on the process studied.


Sign in / Sign up

Export Citation Format

Share Document