Visual inspection of steel surface defects based on domain adaptation and adaptive convolutional neural network

2021 ◽  
Vol 153 ◽  
pp. 107541
Author(s):  
Siyu Zhang ◽  
Qiuju Zhang ◽  
Jiefei Gu ◽  
Lei Su ◽  
Ke Li ◽  
...  
2019 ◽  
Vol 9 (22) ◽  
pp. 4898 ◽  
Author(s):  
Augustas Urbonas ◽  
Vidas Raudonis ◽  
Rytis Maskeliūnas ◽  
Robertas Damaševičius

In the lumber and wood processing industry, most visual quality inspections are still done by trained human operators. Visual inspection is a tedious and repetitive task that involves a high likelihood of human error. Currently, new automated solutions with high-resolution cameras and visual inspection algorithms are being tested, but they are not always fast and accurate enough for real-time industrial applications. This paper proposes an automatic visual inspection system for the location and classification of defects on the wood surface. We adopted a faster region-based convolutional neural network (faster R-CNN) for the identification of defects on wood veneer surfaces. Faster R-CNN has been successfully used in medical image processing and object tracking before, but it has not yet been applied for wood panel surface quality assurance. To improve the results, we used pre-trained AlexNet, VGG16, BNInception, and ResNet152 neural network models for transfer learning. The results of the experiments using a synthetically augmented dataset are presented. The best average accuracy of 80.6% was obtained using the pretrained ResNet152 neural network model. By combining all the defect classes, a 96.1% accuracy of finding wood panel surface defects was achieved.


2020 ◽  
Vol 5 (4) ◽  
pp. 203-208
Author(s):  
Yousra KATEB ◽  
Hocine MEGLOULI ◽  
Abdelmalek KHEBLI

Steel is the most important engineering and construction material in the world. It is used in all aspects of our lives. But as every metal is can be defected and then will not be useful by the consumer Steel surface inspection has seen an important attention in relation with industrial quality of products. In addition, it has been studied in different methods based on image classification in the most of time, but these can detect only such kind of defects in very limited conditions such as illumination, obvious contours, contrast and noise...etc. In this paper, we aim to try a new method to detect steel defects this last depend on artificial intelligence and artificial neural networks. We will discuss the automatic detection of steel surface defects using the convolutional neural network, which can classify the images in their specific classes. The steel we are going to use will be well-classified weather the conditions of imaging are not the same, and this is the advantage of the convolutional neural network in our work. The accuracy and the robustness of the results are so satisfying.


Author(s):  
Xuefeng Zhao ◽  
Shengyuan Li ◽  
Hongguo Su ◽  
Lei Zhou ◽  
Kenneth J. Loh

Bridge management and maintenance work is an important part for the assessment the health state of bridge. The conventional management and maintenance work mainly relied on experienced engineering staffs by visual inspection and filling in survey forms. However, the human-based visual inspection is a difficult and time-consuming task and its detection results significantly rely on subjective judgement of human inspectors. To address the drawbacks of human-based visual inspection method, this paper proposes an image-based comprehensive maintenance and inspection method for bridges using deep learning. To classify the types of bridges, a convolutional neural network (CNN) classifier established by fine-turning the AlexNet is trained, validated and tested using 3832 images with three types of bridges (arch, suspension and cable-stayed bridge). For the recognition of bridge components (tower and deck of bridges), a Faster Region-based Convolutional Neural Network (Faster R-CNN) based on modified ZF-net is trained, validated and tested by utilizing 600 bridge images. To implement the strategy of a sliding window technique for the crack detection, another CNN from fine-turning the GoogLeNet is trained, validated and tested by employing a databank with cropping 1455 raw concrete images into 60000 intact and cracked images. The performance of the trained CNNs and Faster R-CNN is tested on some new images which are not used for training and validation processes. The test results substantiate the proposed method can indeed recognize the types and components and detect cracks for a bridges.


Author(s):  
Ranganath Singari ◽  
Karun Singla ◽  
Gangesh Chawla

Deep learning has offered new avenues in the field of industrial management. Traditional methods of quality inspection such as Acceptance Sampling relies on a probabilistic measure derived from inspecting a sample of finished products. Evaluating a fixed number of products to derive the quality level for the complete batch is not a robust approach. Visual inspection solutions based on deep learning can be employed in the large manufacturing units to improve the quality inspection units for steel surface defect detection. This leads to optimization of the human capital due to reduction in manual intervention and turnaround time in the overall supply chain of the industry. Consequently, the sample size in the Acceptance sampling can be increased with minimal effort vis-à-vis an increase in the overall accuracy of the inspection. The learning curve of this work is supported by Convolutional Neural Network which has been used to extract feature representations from grayscale images to classify theinputs into six types of surface defects. The neural network architecture is compiled in Keras framework using Tensorflow backend with state of the art Adam RMS Prop with Nesterov Momentum (NADAM) optimizer. The proposed classification algorithm holds the potential to identify the dominant flaws in the manufacturing system responsible for leaking costs.


2019 ◽  
Vol 9 (16) ◽  
pp. 3312 ◽  
Author(s):  
Zhu ◽  
Ge ◽  
Liu

In order to realize the non-destructive intelligent identification of weld surface defects, an intelligent recognition method based on deep learning is proposed, which is mainly formed by convolutional neural network (CNN) and forest random. First, the high-level features are automatically learned through the CNN. Random forest is trained with extracted high-level features to predict the classification results. Secondly, the weld surface defects images are collected and preprocessed by image enhancement and threshold segmentation. A database of weld surface defects is established using pre-processed images. Finally, comparative experiments are performed on the weld surface defects database. The results show that the accuracy of the method combined with CNN and random forest can reach 0.9875, and it also demonstrates the method is effective and practical.


2020 ◽  
Author(s):  
Maria Kaselimi ◽  
Nikolaos Doulamis ◽  
Demitris Delikaraoglou

<p>Knowledge of the ionospheric electron density is essential for a wide range of applications, e.g., telecommunications, satellite positioning and navigation, and Earth observation from space. Therefore, considerable efforts have been concentrated on modeling this ionospheric parameter of interest. Ionospheric electron density is characterized by high complexity and is space−and time−varying, as it is highly dependent on local time, latitude, longitude, season, solar cycle and activity, and geomagnetic conditions. Daytime disturbances cause periodic changes in total electron content (diurnal variation) and additionally, there are multi-day periodicities, seasonal variations, latitudinal variations, or even ionospheric perturbations that cause fluctuations in signal transmission.</p><p>Because of its multiple band frequencies, the current Global Navigation Satellite Systems (GNSS) offer an excellent example of how we can infer ionosphere conditions from its effect on the radiosignals from different GNSS band frequencies. Thus, GNSS techniques provide a way of directly measuring the electron density in the ionosphere. The main advantage of such techniques is the provision of the integrated electron content measurements along the satellite-to-receiver line-of-sight at a large number of sites over a large geographic area.</p><p>Deep learning techniques are essential to reveal accurate ionospheric conditions and create representations at high levels of abstraction. These methods can successfully deal with non-linearity and complexity and are capable of identifying complex data patterns, achieving accurate ionosphere modeling. One application that has recently attracted considerable attention within the geodetic community is the possibility of applying these techniques in order to model the ionosphere delays based on GNSS satellite signals.</p><p>This paper deals with a modeling approach suitable for predicting the ionosphere delay at different locations of the IGS network stations using an adaptive Convolutional Neural Network (CNN). As experimental data we used actual GNSS observations from selected stations of the global IGS network which were participating in the still-ongoing MGEX project that provides various satellite signals from the currently available multiple navigation satellite systems. Slant TEC data (STEC) were obtained using the undifferenced and unconstrained PPP technique. The STEC data were provided by GAMP software and converted to VTEC data values. The proposed CNN uses the following basic information: GNSS signal azimuth and elevation angle, GNSS satellite position (x and y). Then, the adaptive CNN utilizes these data inputs along with the predicted VTEC values of the first CNN for the previous observation epochs. Topics to be discussed in the paper include the design of the CNN network structure, training strategy, data analysis, as well as preliminary testing results of the ionospheric delays predictions as compared with the IGS ionosphere products.   </p>


Sign in / Sign up

Export Citation Format

Share Document