scholarly journals SurfNetv2: An Improved Real-Time SurfNet and Its Applications to Defect Recognition of Calcium Silicate Boards

Sensors ◽  
2020 ◽  
Vol 20 (16) ◽  
pp. 4356 ◽  
Author(s):  
Chi-Yi Tsai ◽  
Hao-Wei Chen

This paper presents an improved Convolutional Neural Network (CNN) architecture to recognize surface defects of the Calcium Silicate Board (CSB) using visual image information based on a deep learning approach. The proposed CNN architecture is inspired by the existing SurfNet architecture and is named SurfNetv2, which comprises a feature extraction module and a surface defect recognition module. The output of the system is the recognized defect category on the surface of the CSB. In the collection of the training dataset, we manually captured the defect images presented on the surface of the CSB samples. Then, we divided these defect images into four categories, which are crash, dirty, uneven, and normal. In the training stage, the proposed SurfNetv2 is trained through an end-to-end supervised learning method, so that the CNN model learns how to recognize surface defects of the CSB only through the RGB image information. Experimental results show that the proposed SurfNetv2 outperforms five state-of-the-art methods and achieves a high recognition accuracy of 99.90% and 99.75% in our private CSB dataset and the public Northeastern University (NEU) dataset, respectively. Moreover, the proposed SurfNetv2 model achieves a real-time computing speed of about 199.38 fps when processing images with a resolution of 128 × 128 pixels. Therefore, the proposed CNN model has great potential for real-time automatic surface defect recognition applications.

2021 ◽  
Vol 50 ◽  
pp. 101392
Author(s):  
Yucheng Wang ◽  
Xinyu Li ◽  
Yiping Gao ◽  
Lijian Wang ◽  
Liang Gao

2018 ◽  
Vol 2018 ◽  
pp. 1-8
Author(s):  
Hou Jingzhong ◽  
Xia Kewen ◽  
Yang Fan ◽  
Zu Baokai

Strip steel surface defect recognition is a pattern recognition problem with wide applications. Previous works on strip surface defect recognition mainly focus on feature selection and dimension reduction. There are also approaches on real-time systems that mainly exploit the autocorrection within some given picture. However, the instances cannot be used in practical applications because of a bad recognition rate and low efficiency. In this paper, we study the intelligent algorithm of strip steel surface defect recognition, where the goal is to improve the accuracy and save running time. This problem is very important in various applications, especially the process testing of steel manufacturing. We propose an approach called the second-order cone programming (SOCP) optimized multiple kernel relevance vector machine (MKRVM), which can recognize strip surface defects much better than other methods. The method includes the model parameter estimation, training, and optimization of the model based on SOCP and the classification test. We compare our approach with existing methods on strip surface defect recognition. The results demonstrate that our proposed approach can improve the recognition accuracy and reduce the time costs of the strip surface defect.


2011 ◽  
Vol 308-310 ◽  
pp. 1328-1332 ◽  
Author(s):  
Wu Bin Li ◽  
Chang Hou Lu ◽  
Jian Chuan Zhang

Rolling steel surface defect inspection technology based on machine vision is more and more widely used. The latest progress of vision-based real-time inspection algorithm for rolling steel surface defect at home and abroad is introduced, and several key issues are analyzed. Finally, the current domestic research emphases and development trends are proposed.


2021 ◽  
Author(s):  
Anna Litvintseva ◽  
Oleg Evstafev ◽  
Sergey Shavetov

Materials ◽  
2020 ◽  
Vol 13 (20) ◽  
pp. 4629
Author(s):  
Yang Liu ◽  
Yachao Yuan ◽  
Cristhian Balta ◽  
Jing Liu

Automatic inspection of surface defects is crucial in industries for real-time applications. Nowadays, computer vision-based approaches have been successfully employed. However, most of the existing works need a large number of training samples to achieve satisfactory classification results, while collecting massive training datasets is labor-intensive and financially costly. Moreover, most of them obtain high accuracy at the expense of high latency, and are thus not suitable for real-time applications. In this work, a novel Concurrent Convolutional Neural Network (ConCNN) with different image scales is proposed, which is light-weighted and easy to deploy for real-time defect classification applications. To evaluate the performance of ConCNN, the NEU-CLS dataset is used in our experiments. Simulation results demonstrate that ConCNN performs better than other state-of-the-art approaches considering accuracy and latency for steel surface defect classification. Specifically, ConCNN achieves as high as 98.89% classification accuracy with only around 5.58 ms latency over low training cost.


Symmetry ◽  
2021 ◽  
Vol 13 (4) ◽  
pp. 706
Author(s):  
Xinglong Feng ◽  
Xianwen Gao ◽  
Ling Luo

It is important to accurately classify the defects in hot rolled steel strip since the detection of defects in hot rolled steel strip is closely related to the quality of the final product. The lack of actual hot-rolled strip defect data sets currently limits further research on the classification of hot-rolled strip defects to some extent. In real production, the convolutional neural network (CNN)-based algorithm has some difficulties, for example, the algorithm is not particularly accurate in classifying some uncommon defects. Therefore, further research is needed on how to apply deep learning to the actual detection of defects on the surface of hot rolled steel strip. In this paper, we proposed a hot rolled steel strip defect dataset called Xsteel surface defect dataset (X-SDD) which contains seven typical types of hot rolled strip defects with a total of 1360 defect images. Compared with the six defect types of the commonly used NEU surface defect database (NEU-CLS), our proposed X-SDD contains more types. Then, we adopt the newly proposed RepVGG algorithm and combine it with the spatial attention (SA) mechanism to verify the effect on the X-SDD. Finally, we apply multiple algorithms to test on our proposed X-SDD to provide the corresponding benchmarks. The test results show that our algorithm achieves an accuracy of 95.10% on the testset, which exceeds other comparable algorithms by a large margin. Meanwhile, our algorithm achieves the best results in Macro-Precision, Macro-Recall and Macro-F1-score metrics.


2021 ◽  
Vol 1955 (1) ◽  
pp. 012090
Author(s):  
Cheng Liu ◽  
XinYi Su ◽  
Jialing Wu ◽  
Qun Zhou ◽  
Tao Li ◽  
...  

2021 ◽  
pp. 1-18
Author(s):  
Hui Liu ◽  
Boxia He ◽  
Yong He ◽  
Xiaotian Tao

The existing seal ring surface defect detection methods for aerospace applications have the problems of low detection efficiency, strong specificity, large fine-grained classification errors, and unstable detection results. Considering these problems, a fine-grained seal ring surface defect detection algorithm for aerospace applications is proposed. Based on analysis of the stacking process of standard convolution, heat maps of original pixels in the receptive field participating in the convolution operation are quantified and generated. According to the generated heat map, the feature extraction optimization method of convolution combinations with different dilation rates is proposed, and an efficient convolution feature extraction network containing three kinds of dilated convolutions is designed. Combined with the O-ring surface defect features, a multiscale defect detection network is designed. Before the head of multiscale classification and position regression, feature fusion tree modules are added to ensure the reuse and compression of the responsive features of different receptive fields on the same scale feature maps. Experimental results show that on the O-rings-3000 testing dataset, the mean condition accuracy of the proposed algorithm reaches 95.10% for 5 types of surface defects of aerospace O-rings. Compared with RefineDet, the mean condition accuracy of the proposed algorithm is only reduced by 1.79%, while the parameters and FLOPs are reduced by 35.29% and 64.90%, respectively. Moreover, the proposed algorithm has good adaptability to image blur and light changes caused by the cutting of imaging hardware, thus saving the cost.


Sign in / Sign up

Export Citation Format

Share Document