Multi-Seam Tracking With a Portable Robotic Welding System in Unstructured Environments

Most welding manufacturing of the heavy industry, such as shipbuilding and construction, is carried out in an unstructured workspace. The term Unstructured indicates the production environment is irregular, changeable and without model. In this case, the changeable workpiece position, workpiece shape, environmental background, and environmental illumination should be carefully considered. Because of such complicated characteristics, the welding is currently being relied on the manual operation, resulting in high cost, low efficiency and quality. This work proposes a portable robotic welding system and a novel seam tracking method. Compared to existing methods, it can cope with more complex general spatial curve weld. Firstly, the tracking pose of the robot is modeled by a proposed dual-sequence tracking strategy. On this basis, the working parameters can be adjusted to avoid robot-workpiece collision around the workpiece corners during the tracking process. By associating the forward direction of the welding torch with the viewpoint direction of the camera, it solves the problem that the weld feature points are prone to be lost in the tracking process by conventional methods. Point cloud registration is adopted to globally locate the multi-segment welds in the workpiece, since the system deployment location is not fixed. Various experiments on single or multiple welds under different environmental conditions show that even if the robot is deployed in different positions, it can reach the starting point of the weld smoothly and accurately track along the welds.

Welding seam recognition and tracking for a novel mobile welding robot based on multi-layer sensing strategy

Mobile welding robot with adaptive seam tracking ability can greatly improve the welding efficiency and quality, which has been extensively studied. To further improve the automation in multiple station welding, a novel intelligent mobile welding robot consists of a four-wheeled mobile platform and a collaborative manipulator is developed. Under the support of simultaneous localization and mapping (SLAM) technology, the robot is capable of automatically navigating to different stations to perform welding operation. To automatically detect the welding seam, a composite sensor system including an RGB-D camera and a laser vision sensor is creatively applied. Based on the sensor system, the multi-layer sensing strategy is performed to ensure the welding seam can be detected and tracked with high precision. By applying hybrid filter to the RGB-D camera measurement, the initial welding seam could be effectively extracted. Then a novel welding start point detection method is proposed. Meanwhile, to guarantee the tracking quality, a robust welding seam tracking algorithm based on laser vision sensor is presented to eliminate the tracking discrepancy caused by the platform parking error, through which the tracking trajectory can be corrected in real-time. The experimental results show that the robot can autonomously detect and track the welding seam effectively in different station. Also, the multiple station welding efficiency can be improved and quality can also be guaranteed.

Laser vision seam tracking system based on proximal policy optimization

Purpose This paper aims to propose a weld seam tracking method based on proximal policy optimization (PPO). Design/methodology/approach By constructing a neural network based on PPO and using the reference image block and the image block to be detected as the dual-channel input of the network, the method predicts the translation relation between the two images and corrects the location of feature points in the weld image. The localization accuracy estimation network (LAE-Net) is built to update the reference image block during the welding process, which is helpful to reduce the tracking error. Findings Off-line simulation results show that the proposed algorithm has strong robustness and performs well on the test set of curved seam images with strong noise. In the welding experiment, the movement of welding torch is stable, the molten material is uniform and smooth and the welding error is small, which can meet the requirements of industrial production. Originality/value The idea of image registration is applied to weld seam tracking, and the weld seam tracking network is built on the basis of PPO. In order to further improve the tracking accuracy, the LAE-Net is constructed and the reference images can be updated.

Research on the Deviation Sensing of V-groove Weld Seam based on a Novel Two Channel Acoustic Sensor

It is essential to sense the deviation of weld seam real-timely in robotic welding process. However, welding process always accompanied with high temperature, strong arc light and background noises, which significantly affects the application of sensors. In this study, a novel acoustic sensor was developed. This sensor consists of two microphones. Based on the sound signals collected by these two microphones, the deviation of weld seam was detected. The frequency response of the developed acoustic sensor was studied through simulation method firstly, and then the sensing performance of it was analyzed with experiments. The experimental results show that the developed acoustic sensor has a linear property for the deviation detection of V-groove weld seam. This research provides a novel method for weld seam tracking.

A Novel Sub-pixel Refinement Method for Fillet Weld Under Structured Light Vision

Intelligent welding robots based on structured light vision are widely used in industrial production. With the demands of low cost, miniaturization and flexibility, the development of embedded structured light vision systems for seam tracking is a general trend. The core is how to efficiently and precisely position weld seam with low-configuration hardware. Sub-pixel refinement can break through the limitation of physical resolution, while also reducing hardware cost to achieve the required accuracy. To fill the gap in the sub-pixel refinement for fillet weld joint, a novel sub-pixel refinement method for fillet weld joint under structured light vision is proposed, which can sub-pixel refine the fillet weld joint under various working conditions. The main novelties of the proposed method include: (1) a novel sub-pixel refinement method for fillet weld joint by using Mean Shift, weighted least square and directional maximum projection is proposed, which is robust, universal, and accurate. (2) A directional maximum projection algorithm for refining weld is proposed for the first time. (3) The method can accurately refine fillet weld joint with low-resolution image. The proposed method is robust, universal, and accurate, and as demonstrated by the following performances: the average and maximum bias are 0.73 and 3 pixels in the accurate test, positioning accuracy rate is 100% in the test of noise-free, rusty, highly reflective and arc radiation-and-spatter working conditions. the method can be expanded to a common sub-pixel refinement method for structured light intersections through simple transformation.

A Novel Seam Tracking Technique with a Four-Step Method and Experimental Investigation of Robotic Welding Oriented to Complex Welding Seam

The seam tracking operation is essential for extracting welding seam characteristics which can instruct the motion of a welding robot along the welding seam path. The chief tasks for seam tracking would be divided into three partitions. First, starting and ending points detection, then, weld edge detection, followed by joint width measurement, and, lastly, welding path position determination with respect to welding robot co-ordinate frame. A novel seam tracking technique with a four-step method is introduced. A laser sensor is used to scan grooves to obtain profile data, and the data are processed by a filtering algorithm to smooth the noise. The second derivative algorithm is proposed to initially position the feature points, and then linear fitting is performed to achieve precise positioning. The groove data are transformed into the robot’s welding path through sensor pose calibration, which could realize real-time seam tracking. Experimental demonstration was carried out to verify the tracking effect of both straight and curved welding seams. Results show that the average deviations in the X direction are about 0.628 mm and 0.736 mm during the initial positioning of feature points. After precise positioning, the average deviations are reduced to 0.387 mm and 0.429 mm. These promising results show that the tracking errors are decreased by up to 38.38% and 41.71%, respectively. Moreover, the average deviations in both X and Z direction of both straight and curved welding seams are no more than 0.5 mm, after precise positioning. Therefore, the proposed seam tracking method with four steps is feasible and effective, and provides a reference for future seam tracking research.