scholarly journals Multi-operator feature enhancement methods for industrial defect detection

2021 ◽  
Vol 2078 (1) ◽  
pp. 012030
Author(s):  
Bo Zhou ◽  
Yi Chao Fan ◽  
YuXin Liu ◽  
XuDong Yin
Keyword(s):  
Object Detection ◽  
Defect Detection ◽  
Detection Algorithm ◽  
Image Features ◽  
Image Preprocessing ◽  
Validation Experiment ◽  
Industrial Inspection ◽  
Single Operator ◽  
Surface Defect Detection ◽  
Edge Features

Abstract Deep learning based object detection algorithms have been gradually applied to industrial defect detection, but the resulted accuracy does not fully meet the needs of industrial inspection. In order to enhance image features, this paper proposes a series of image preprocessing schemes based on edge detection operators, using a single-operator preprocessing scheme, a multi-operator serial preprocessing scheme and a multi-operator parallel preprocessing scheme for image preprocessing of data to enhance the edge features of images. The validation experiment of the SSD based object detection algorithm is performed on dataset used for industrial inspection, to verify the effectiveness of the processing schemes above. The result shows that the multi-operator based image preprocessing method is effective in improving the accuracy of surface defect detection in the field of industrial defect detection.

Lightweight detection algorithm for fine-grained surface defects of aerospace seal rings

2021 ◽  
pp. 1-18
Author(s):  
Hui Liu ◽  
Boxia He ◽  
Yong He ◽  
Xiaotian Tao
Keyword(s):  
Feature Extraction ◽  
Defect Detection ◽  
Surface Defect ◽  
Surface Defects ◽  
Detection Algorithm ◽  
Seal Ring ◽  
Fine Grained ◽  
Aerospace Applications ◽  
Surface Defect Detection ◽  
The Mean

The existing seal ring surface defect detection methods for aerospace applications have the problems of low detection efficiency, strong specificity, large fine-grained classification errors, and unstable detection results. Considering these problems, a fine-grained seal ring surface defect detection algorithm for aerospace applications is proposed. Based on analysis of the stacking process of standard convolution, heat maps of original pixels in the receptive field participating in the convolution operation are quantified and generated. According to the generated heat map, the feature extraction optimization method of convolution combinations with different dilation rates is proposed, and an efficient convolution feature extraction network containing three kinds of dilated convolutions is designed. Combined with the O-ring surface defect features, a multiscale defect detection network is designed. Before the head of multiscale classification and position regression, feature fusion tree modules are added to ensure the reuse and compression of the responsive features of different receptive fields on the same scale feature maps. Experimental results show that on the O-rings-3000 testing dataset, the mean condition accuracy of the proposed algorithm reaches 95.10% for 5 types of surface defects of aerospace O-rings. Compared with RefineDet, the mean condition accuracy of the proposed algorithm is only reduced by 1.79%, while the parameters and FLOPs are reduced by 35.29% and 64.90%, respectively. Moreover, the proposed algorithm has good adaptability to image blur and light changes caused by the cutting of imaging hardware, thus saving the cost.

scholarly journals Research Progress of Automated Visual Surface Defect Detection for Industrial Metal Planar Materials

Sensors ◽  
2020 ◽  
Vol 20 (18) ◽  
pp. 5136
Author(s):  
Xiaoxin Fang ◽  
Qiwu Luo ◽  
Bingxing Zhou ◽  
Congcong Li ◽  
Lu Tian
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Three Dimensional ◽  
Image Features ◽  
Stereoscopic Vision ◽  
Research Progress ◽  
Inspection System ◽  
Two Dimensional ◽  
Surface Defect Detection ◽  
Planar Materials

The computer-vision-based surface defect detection of metal planar materials is a research hotspot in the field of metallurgical industry. The high standard of planar surface quality in the metal manufacturing industry requires that the performance of an automated visual inspection system and its algorithms are constantly improved. This paper attempts to present a comprehensive survey on both two-dimensional and three-dimensional surface defect detection technologies based on reviewing over 160 publications for some typical metal planar material products of steel, aluminum, copper plates and strips. According to the algorithm properties as well as the image features, the existing two-dimensional methodologies are categorized into four groups: statistical, spectral, model, and machine learning-based methods. On the basis of three-dimensional data acquisition, the three-dimensional technologies are divided into stereoscopic vision, photometric stereo, laser scanner, and structured light measurement methods. These classical algorithms and emerging methods are introduced, analyzed, and compared in this review. Finally, the remaining challenges and future research trends of visual defect detection are discussed and forecasted at an abstract level.

scholarly journals Semantic Segmentation Network for Surface Defect Detection of Automobile Wheel Hub Fusing High-Resolution Feature and Multi-Scale Feature

2021 ◽  
Vol 11 (22) ◽  
pp. 10508
Author(s):  
Chaowei Tang ◽  
Xinxin Feng ◽  
Haotian Wen ◽  
Xu Zhou ◽  
Yanqing Shao ◽  
...  
Keyword(s):  
High Resolution ◽  
Defect Detection ◽  
Automobile Industry ◽  
Surface Defect ◽  
Semantic Segmentation ◽  
The Body ◽  
Multi Scale ◽  
Surface Defect Detection ◽  
Edge Features ◽  
Automobile Wheel

Surface defect detection of an automobile wheel hub is important to the automobile industry because these defects directly affect the safety and appearance of automobiles. At present, surface defect detection networks based on convolutional neural network use many pooling layers when extracting features, reducing the spatial resolution of features and preventing the accurate detection of the boundary of defects. On the basis of DeepLab v3+, we propose a semantic segmentation network for the surface defect detection of an automobile wheel hub. To solve the gridding effect of atrous convolution, the high-resolution network (HRNet) is used as the backbone network to extract high-resolution features, and the multi-scale features extracted by the Atrous Spatial Pyramid Pooling (ASPP) of DeepLab v3+ are superimposed. On the basis of the optical flow, we decouple the body and edge features of the defects to accurately detect the boundary of defects. Furthermore, in the upsampling process, a decoder can accurately obtain detection results by fusing the body, edge, and multi-scale features. We use supervised training to optimize these features. Experimental results on four defect datasets (i.e., wheels, magnetic tiles, fabrics, and welds) show that the proposed network has better F1 score, average precision, and intersection over union than SegNet, Unet, and DeepLab v3+, proving that the proposed network is effective for different defect detection scenarios.

scholarly journals Research on a Surface Defect Detection Algorithm Based on MobileNet-SSD

2018 ◽  
Vol 8 (9) ◽  
pp. 1678 ◽  
Author(s):  
Yiting Li ◽  
Haisong Huang ◽  
Qingsheng Xie ◽  
Liguo Yao ◽  
Qipeng Chen
Keyword(s):  
Defect Detection ◽  
Surface Defect ◽  
Surface Defects ◽  
Detection Method ◽  
Detection Algorithm ◽  
Single Shot ◽  
Detection Model ◽  
Machine Learning Methods ◽  
Network Methods ◽  
Surface Defect Detection

This paper aims to achieve real-time and accurate detection of surface defects by using a deep learning method. For this purpose, the Single Shot MultiBox Detector (SSD) network was adopted as the meta structure and combined with the base convolution neural network (CNN) MobileNet into the MobileNet-SSD. Then, a detection method for surface defects was proposed based on the MobileNet-SSD. Specifically, the structure of the SSD was optimized without sacrificing its accuracy, and the network structure and parameters were adjusted to streamline the detection model. The proposed method was applied to the detection of typical defects like breaches, dents, burrs and abrasions on the sealing surface of a container in the filling line. The results show that our method can automatically detect surface defects more accurately and rapidly than lightweight network methods and traditional machine learning methods. The research results shed new light on defect detection in actual industrial scenarios.

scholarly journals Deep Active Learning for Surface Defect Detection

Sensors ◽  
2020 ◽  
Vol 20 (6) ◽  
pp. 1650 ◽  
Author(s):  
Xiaoming Lv ◽  
Fajie Duan ◽  
Jia-Jia Jiang ◽  
Xiao Fu ◽  
Lin Gan
Keyword(s):  
Active Learning ◽  
Object Detection ◽  
Defect Detection ◽  
Surface Defect ◽  
Candidate List ◽  
Detection Model ◽  
Detection Systems ◽  
Learning Framework ◽  
Surface Defect Detection ◽  
Sampling Scale

Most of the current object detection approaches deliver competitive results with an assumption that a large number of labeled data are generally available and can be fed into a deep network at once. However, due to expensive labeling efforts, it is difficult to deploy the object detection systems into more complex and challenging real-world environments, especially for defect detection in real industries. In order to reduce the labeling efforts, this study proposes an active learning framework for defect detection. First, an Uncertainty Sampling is proposed to produce the candidate list for annotation. Uncertain images can provide more informative knowledge for the learning process. Then, an Average Margin method is designed to set the sampling scale for each defect category. In addition, an iterative pattern of training and selection is adopted to train an effective detection model. Extensive experiments demonstrate that the proposed method can render the required performance with fewer labeled data.

scholarly journals A New Steel Defect Detection Algorithm Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Weidong Zhao ◽  
Feng Chen ◽  
Hancheng Huang ◽  
Dan Li ◽  
Wei Cheng
Keyword(s):  
Deep Learning ◽  
Target Detection ◽  
Defect Detection ◽  
Steel Surface ◽  
Surface Defect ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Average Precision ◽  
Original Algorithm ◽  
Surface Defect Detection

In recent years, more and more scholars devoted themselves to the research of the target detection algorithm due to the continuous development of deep learning. Among them, the detection and recognition of small and complex targets are still a problem to be solved. The authors of this article have understood the shortcomings of the deep learning detection algorithm in detecting small and complex defect targets and would like to share a new improved target detection algorithm in steel surface defect detection. The steel surface defects will affect the quality of steel seriously. We find that most of the current detection algorithms for NEU-DET dataset detection accuracy are low, so we choose to verify a steel surface defect detection algorithm based on machine vision on this dataset for the problem of defect detection in steel production. A series of improvement measures are carried out in the traditional Faster R-CNN algorithm, such as reconstructing the network structure of Faster R-CNN. Based on the small features of the target, we train the network with multiscale fusion. For the complex features of the target, we replace part of the conventional convolution network with a deformable convolution network. The experimental results show that the deep learning network model trained by the proposed method has good detection performance, and the mean average precision is 0.752, which is 0.128 higher than the original algorithm. Among them, the average precision of crazing, inclusion, patches, pitted surface, rolled in scale and scratches is 0.501, 0.791, 0.792, 0.874, 0.649, and 0.905, respectively. The detection method is able to identify small target defects on the steel surface effectively, which can provide a reference for the automatic detection of steel defects.

Sign in / Sign up

Export Citation Format

Share Document