scholarly journals YOT-Net: YOLOv3 Combined Triplet Loss Network for Copper Elbow Surface Defect Detection

Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7260
Author(s):  
Yuanqing Xian ◽  
Guangjun Liu ◽  
Jinfu Fan ◽  
Yang Yu ◽  
Zhongjie Wang

Copper elbows are an important product in industry. They are used to connect pipes for transferring gas, oil, and liquids. Defective copper elbows can lead to serious industrial accidents. In this paper, a novel model named YOT-Net (YOLOv3 combined triplet loss network) is proposed to automatically detect defective copper elbows. To increase the defect detection accuracy, triplet loss function is employed in YOT-Net. The triplet loss function is introduced into the loss module of YOT-Net, which utilizes image similarity to enhance feature extraction ability. The proposed method of YOT-Net shows outstanding performance in copper elbow surface defect detection.

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Weidong Zhao ◽  
Feng Chen ◽  
Hancheng Huang ◽  
Dan Li ◽  
Wei Cheng

In recent years, more and more scholars devoted themselves to the research of the target detection algorithm due to the continuous development of deep learning. Among them, the detection and recognition of small and complex targets are still a problem to be solved. The authors of this article have understood the shortcomings of the deep learning detection algorithm in detecting small and complex defect targets and would like to share a new improved target detection algorithm in steel surface defect detection. The steel surface defects will affect the quality of steel seriously. We find that most of the current detection algorithms for NEU-DET dataset detection accuracy are low, so we choose to verify a steel surface defect detection algorithm based on machine vision on this dataset for the problem of defect detection in steel production. A series of improvement measures are carried out in the traditional Faster R-CNN algorithm, such as reconstructing the network structure of Faster R-CNN. Based on the small features of the target, we train the network with multiscale fusion. For the complex features of the target, we replace part of the conventional convolution network with a deformable convolution network. The experimental results show that the deep learning network model trained by the proposed method has good detection performance, and the mean average precision is 0.752, which is 0.128 higher than the original algorithm. Among them, the average precision of crazing, inclusion, patches, pitted surface, rolled in scale and scratches is 0.501, 0.791, 0.792, 0.874, 0.649, and 0.905, respectively. The detection method is able to identify small target defects on the steel surface effectively, which can provide a reference for the automatic detection of steel defects.


2021 ◽  
Vol 11 (24) ◽  
pp. 11701
Author(s):  
Xinting Liao ◽  
Shengping Lv ◽  
Denghui Li ◽  
Yong Luo ◽  
Zichun Zhu ◽  
...  

Surface defect detection for printed circuit board (PCB) is indispensable for managing PCB production quality. However, automatic detection of PCB surface defects is still a challenging task because, even within the same category of surface defect, defects present great differences in morphology and pattern. Although many computer vision-based detectors have been established to handle these problems, current detectors struggle to achieve high detection accuracy, fast detection speed and low memory consumption simultaneously. To address those issues, we propose a cost-effective deep learning (DL)-based detector based on the cutting-edge YOLOv4 to detect PCB surface defect quickly and efficiently. The YOLOv4 is improved upon with respect to its backbone network and the activation function in its neck/prediction network. The improved YOLOv4 is evaluated with a customized dataset, collected from a PCB factory. The experimental results show that the improved detector achieved a high performance, scoring 98.64% on mean average precision (mAP) at 56.98 frames per second (FPS), outperforming the other compared SOTA detectors. Furthermore, the improved YOLOv4 reduced the parameter space of YOLOv4 from 63.96 M to 39.59 M and the number of multiply-accumulate operations (Madds) from 59.75 G to 26.15 G.


Algorithms ◽  
2021 ◽  
Vol 14 (9) ◽  
pp. 257
Author(s):  
Yiming Xu ◽  
Kai Zhang ◽  
Li Wang

Aiming at the problems of inefficient detection caused by traditional manual inspection and unclear features in metal surface defect detection, an improved metal surface defect detection technology based on the You Only Look Once (YOLO) model is presented. The shallow features of the 11th layer in the Darknet-53 are combined with the deep features of the neural network to generate a new scale feature layer using the basis of the network structure of YOLOv3. Its goal is to extract more features of small defects. Furthermore, then, K-Means++ is used to reduce the sensitivity to the initial cluster center when analyzing the size information of the anchor box. The optimal anchor box is selected to make the positioning more accurate. The performance of the modified metal surface defect detection technology is compared with other detection methods on the Tianchi dataset. The results show that the average detection accuracy of the modified YOLO model is 75.1%, which ia higher than that of YOLOv3. Furthermore, it also has a great detection speed advantage, compared with faster region-based convolutional neural network (Faster R-CNN) and other detection algorithms. The improved YOLO model can make the highly accurate location information of the small defect target and has strong real-time performance.


Machines ◽  
2021 ◽  
Vol 9 (2) ◽  
pp. 40
Author(s):  
Linjian Lei ◽  
Shengli Sun ◽  
Yue Zhang ◽  
Huikai Liu ◽  
Hui Xie

The rapid development of machine vision has prompted the continuous emergence of new detection systems and algorithms in surface defect detection. However, most of the existing methods establish their systems with few comparisons and verifications, and the methods described still have various problems. Thus, an original defect detection method: Segmented Embedded Rapid Defect Detection Method for Surface Defects (SERDD) is proposed in this paper. This method realizes the two-way fusion of image processing and defect detection, which can efficiently and accurately detect surface defects such as depression, scratches, notches, oil, shallow characters, abnormal dimensions, etc. Besides, the character recognition method based on Spatial Pyramid Character Proportion Matching (SPCPM) is used to identify the engraved characters on the bearing dust cover. Moreover, the problem of characters being cut in coordinate transformation is solved through Image Self-Stitching-and-Cropping (ISSC). This paper adopts adequate real image data to verify and compare the methods and proves the effectiveness and advancement through detection accuracy, missing alarm rate, and false alarm rate. This method can provide machine vision technical support for bearing surface defect detection in its real sense.


Author(s):  
Tianchen Liu ◽  
Fan Zhu ◽  
Haoran Yu ◽  
Haisong Gu

Artificial Intelligence has played an increasingly important role in surface defect detection in recent years. At the same time, there are many challenges using deep learning for this area, such as the detection accuracy, shortage of data and, lack of knowledge of root cause of defects. To solve the problem of data shortage, we propose a taxonomy method called DataonomyTM to extend a meta defect datasets with a small number of samples for training defect classifiers. For the accuracy, we apply two latest deep neural network(DNN) architectures, Inception v3 and fully convolutional networks (FCN) so as not only to classify whether there are defects but also to make a pixel-wise prediction to inference the areas of defects. For those detected defects, we combine DNN with traditional AI methods to find root causes of detected defects. We use a generalized multi-image matting algorithm to extract common defects automatically. We apply this technology to identify defects that stem from systematic errors in the surface operation. Experimental results have shown great capability and versatility of our proposed methods.


2021 ◽  
Vol 70 ◽  
pp. 1-13
Author(s):  
Lisha Cui ◽  
Xiaoheng Jiang ◽  
Mingliang Xu ◽  
Wanqing Li ◽  
Pei Lv ◽  
...  

2021 ◽  
pp. 1-18
Author(s):  
Hui Liu ◽  
Boxia He ◽  
Yong He ◽  
Xiaotian Tao

The existing seal ring surface defect detection methods for aerospace applications have the problems of low detection efficiency, strong specificity, large fine-grained classification errors, and unstable detection results. Considering these problems, a fine-grained seal ring surface defect detection algorithm for aerospace applications is proposed. Based on analysis of the stacking process of standard convolution, heat maps of original pixels in the receptive field participating in the convolution operation are quantified and generated. According to the generated heat map, the feature extraction optimization method of convolution combinations with different dilation rates is proposed, and an efficient convolution feature extraction network containing three kinds of dilated convolutions is designed. Combined with the O-ring surface defect features, a multiscale defect detection network is designed. Before the head of multiscale classification and position regression, feature fusion tree modules are added to ensure the reuse and compression of the responsive features of different receptive fields on the same scale feature maps. Experimental results show that on the O-rings-3000 testing dataset, the mean condition accuracy of the proposed algorithm reaches 95.10% for 5 types of surface defects of aerospace O-rings. Compared with RefineDet, the mean condition accuracy of the proposed algorithm is only reduced by 1.79%, while the parameters and FLOPs are reduced by 35.29% and 64.90%, respectively. Moreover, the proposed algorithm has good adaptability to image blur and light changes caused by the cutting of imaging hardware, thus saving the cost.


Sign in / Sign up

Export Citation Format

Share Document