An intelligent and automated 3D surface defect detection system for quantitative 3D estimation and feature classification of material surface defects

2021 ◽  
Vol 144 ◽  
pp. 106633
Author(s):  
Yulong Zong ◽  
Jin Liang ◽  
Huan Wang ◽  
Maodong Ren ◽  
Mingkai Zhang ◽  
...  
2021 ◽  
pp. 1-18
Author(s):  
Hui Liu ◽  
Boxia He ◽  
Yong He ◽  
Xiaotian Tao

The existing seal ring surface defect detection methods for aerospace applications have the problems of low detection efficiency, strong specificity, large fine-grained classification errors, and unstable detection results. Considering these problems, a fine-grained seal ring surface defect detection algorithm for aerospace applications is proposed. Based on analysis of the stacking process of standard convolution, heat maps of original pixels in the receptive field participating in the convolution operation are quantified and generated. According to the generated heat map, the feature extraction optimization method of convolution combinations with different dilation rates is proposed, and an efficient convolution feature extraction network containing three kinds of dilated convolutions is designed. Combined with the O-ring surface defect features, a multiscale defect detection network is designed. Before the head of multiscale classification and position regression, feature fusion tree modules are added to ensure the reuse and compression of the responsive features of different receptive fields on the same scale feature maps. Experimental results show that on the O-rings-3000 testing dataset, the mean condition accuracy of the proposed algorithm reaches 95.10% for 5 types of surface defects of aerospace O-rings. Compared with RefineDet, the mean condition accuracy of the proposed algorithm is only reduced by 1.79%, while the parameters and FLOPs are reduced by 35.29% and 64.90%, respectively. Moreover, the proposed algorithm has good adaptability to image blur and light changes caused by the cutting of imaging hardware, thus saving the cost.


2013 ◽  
Vol 433-435 ◽  
pp. 915-918 ◽  
Author(s):  
Hai Lun Zhang ◽  
Xing Guang Qi ◽  
Xiao Ting Li

This paper presents the research of several key technologies during the implementation of cold-rolling aluminum surface defect detection system, including the difficulty of achieving these key technologies and the improvement of image processing algorithm. Through the installation and commissioning on actual production line, summarize and analyze the requirements of the hardware and software design for highly reflective aluminum plate, to achieve the control of product quality at present.


2018 ◽  
Vol 8 (9) ◽  
pp. 1678 ◽  
Author(s):  
Yiting Li ◽  
Haisong Huang ◽  
Qingsheng Xie ◽  
Liguo Yao ◽  
Qipeng Chen

This paper aims to achieve real-time and accurate detection of surface defects by using a deep learning method. For this purpose, the Single Shot MultiBox Detector (SSD) network was adopted as the meta structure and combined with the base convolution neural network (CNN) MobileNet into the MobileNet-SSD. Then, a detection method for surface defects was proposed based on the MobileNet-SSD. Specifically, the structure of the SSD was optimized without sacrificing its accuracy, and the network structure and parameters were adjusted to streamline the detection model. The proposed method was applied to the detection of typical defects like breaches, dents, burrs and abrasions on the sealing surface of a container in the filling line. The results show that our method can automatically detect surface defects more accurately and rapidly than lightweight network methods and traditional machine learning methods. The research results shed new light on defect detection in actual industrial scenarios.


2014 ◽  
Vol 1006-1007 ◽  
pp. 773-778 ◽  
Author(s):  
Chuan Ren ◽  
Xiao Yu Xiu ◽  
Guo Hui Zhou

This paper proposed a new method of surface defect detection of rolling element based on computer vision, which adopted CCD digital camera as image sensor, and used digital image processing techniques to defect the surface defects of rolling element. The main steps include collect image, use an improved median filter to reduce the noise, increase or decrease the exposure to achieve the image enhancement, create a binary image with threshold method and detect the edge of the image, and use subtraction method for surface defects identification. The experiment indicates that the above methods the advantages of simple, the capability of noise resistance, high speed processing and better real-time.


Author(s):  
Jiaming Qian ◽  
Shijie Feng ◽  
Yixuan Li ◽  
Tianyang Tao ◽  
Qian Chen ◽  
...  

2016 ◽  
Vol 836 ◽  
pp. 147-152
Author(s):  
Akhmad Faizin ◽  
Arif Wahjudi ◽  
I. Made Londen Batan ◽  
Agus Sigit Pramono

The quality of product of manufacturing industries depends on dimension accurately and surface roughness quality. There are many types of surface defects and levels of surface roughness quality. Ironing process is one type of metal forming process, which aims to reduce the wall thickness of the cup-shaped or pipes products, thus increasing the height of the wall. Manually surface inspection procedures are very inadequate to ensure the surface in guaranteed quality. To ensure strict requirements of customers, the surface defect inspection based on image processing techniques has been found to be very effective and popular over the last two decades. The paper has been reviewed some papers based on image processing for defect detection. It has been tried to find some alternatives of useful methods for product surface defect detection of ironing process.


2015 ◽  
Vol 713-715 ◽  
pp. 347-352
Author(s):  
Yu Liu ◽  
Si Zhe Li

Defective products are unavoidable in printed circuit board production process, so rapid detection and identificationmethods are badly in need of. PCB surface defect detection including a series of processing such as surface imagecapture, mixed noise filtering,images registering and so on, so it takes a lot of CPU time. To improve detection speed, based on GPU parallel computing platform, we designed a reasonable parallel processing system for PCB defect detectionto meet the need of real-time requirements of a production line. Experimental results show that parallel image processing algorithms based on GPU can achieve good results compared to the CPU-based serial algorithm (with speed up ratio up to8.34 in this paper),providing a new approachfor rapid detection of PCB surface defect.


2019 ◽  
Vol 9 (15) ◽  
pp. 3159 ◽  
Author(s):  
Fei Zhou ◽  
Guihua Liu ◽  
Feng Xu ◽  
Hao Deng

Aiming at the problems of complex texture, variable interference factors and large sample acquisition in surface defect detection, a generic method of automated surface defect detection based on a bilinear model was proposed. To realize the automatic classification and localization of surface defects, a new Double-Visual Geometry Group16 (D-VGG16) is firstly designed as feature functions of the bilinear model. The global and local features fully extracted from the bilinear model by D-VGG16 are output to the soft-max function to realize the automatic classification of surface defects. Then the heat map of the original image is obtained by applying Gradient-weighted Class Activation Mapping (Grad-CAM) to the output features of D-VGG16. Finally, the defects in the original input image can be located automatically after processing the heat map with a threshold segmentation method. The training process of the proposed method is characterized by a small sample, end-to-end, and is weakly-supervised. Furthermore, experiments are performed on two public and two industrial datasets, which have different defective features in texture, shape and color. The results show that the proposed method can simultaneously realize the classification and localization of defects with different defective features. The average precision of the proposed method is above 99% on the four datasets, and is higher than the known latest algorithms.


Sign in / Sign up

Export Citation Format

Share Document