scholarly journals Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning

2019 ◽  
Author(s):  
Ruofeng Wei ◽  
Yunbo Bi
Keyword(s):  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Average Precision ◽  
Saliency Maps ◽  
Aluminum Profile ◽  
Safety And Reliability ◽  
Aluminum Profiles

Aluminum profile surface defects can greatly affect the performance, safety and reliability of products. Traditional human-based visual inspection is low accuracy and time consuming, and machine vision-based methods depend on hand-crafted features which need to be carefully designed and lack robustness. To recognize the multiple types of defects with various size on aluminum profiles, a multiscale defect detection network based on deep learning is proposed. Then, the network is trained and evaluated using aluminum profile surface defects images. Results show 84.6%, 48.5%, 96.9%, 97.9%, 96.9%, 42.5%, 47.2%, 100%, 100%, 43.3% average precision(AP) for the ten defect categories, respectively, with a mean AP of 75.8%, which illustrate the effectiveness of the network in aluminum profile surface defects detection. In addition, saliency maps also show the feasibility of the proposed network.

scholarly journals Research on Recognition Technology of Aluminum Profile Surface Defects Based on Deep Learning

Materials ◽  
2019 ◽  
Vol 12 (10) ◽  
pp. 1681 ◽  
Author(s):  
Ruofeng Wei ◽  
Yunbo Bi
Keyword(s):  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Average Precision ◽  
Saliency Maps ◽  
Aluminum Profile ◽  
Safety And Reliability ◽  
Aluminum Profiles

Aluminum profile surface defects can greatly affect the performance, safety, and reliability of products. Traditional human-based visual inspection has low accuracy and is time consuming, and machine vision-based methods depend on hand-crafted features that need to be carefully designed and lack robustness. To recognize the multiple types of defects with various size on aluminum profiles, a multiscale defect-detection network based on deep learning is proposed. Then, the network is trained and evaluated using aluminum profile surface defects images. Results show 84.6%, 48.5%, 96.9%, 97.9%, 96.9%, 42.5%, 47.2%, 100%, 100%, and 43.3% average precision (AP) for the 10 defect categories, respectively, with a mean AP of 75.8%, which illustrate the effectiveness of the network in aluminum profile surface defects detection. In addition, saliency maps also show the feasibility of the proposed network.

Simultaneous pixel-level concrete defect detection and grouping using a fully convolutional model

2021 ◽  
pp. 147592172098543
Author(s):  
Chaobo Zhang ◽  
Chih-chen Chang ◽  
Maziar Jamshidi
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Visual Inspection ◽  
Surface Defects ◽  
Semantic Segmentation ◽  
Input Image ◽  
Image Size ◽  
Bounding Box ◽  
Proposed Model ◽  
Image Pixels

Deep learning techniques have attracted significant attention in the field of visual inspection of civil infrastructure systems recently. Currently, most deep learning-based visual inspection techniques utilize a convolutional neural network to recognize surface defects either by detecting a bounding box of each defect or classifying all pixels on an image without distinguishing between different defect instances. These outputs cannot be directly used for acquiring the geometric properties of each individual defect in an image, thus hindering the development of fully automated structural assessment techniques. In this study, a novel fully convolutional model is proposed for simultaneously detecting and grouping the image pixels for each individual defect on an image. The proposed model integrates an optimized mask subnet with a box-level detection network, where the former outputs a set of position-sensitive score maps for pixel-level defect detection and the latter predicts a bounding box for each defect to group the detected pixels. An image dataset containing three common types of concrete defects, crack, spalling and exposed rebar, is used for training and testing of the model. Results demonstrate that the proposed model is robust to various defect sizes and shapes and can achieve a mask-level mean average precision ( mAP) of 82.4% and a mean intersection over union ( mIoU) of 75.5%, with a processing speed of about 10 FPS at input image size of 576 × 576 when tested on an NVIDIA GeForce GTX 1060 GPU. Its performance is compared with the state-of-the-art instance segmentation network Mask R-CNN and the semantic segmentation network U-Net. The comparative studies show that the proposed model has a distinct defect boundary delineation capability and outperforms the Mask R-CNN and the U-Net in both accuracy and speed.

scholarly journals State of the Art in Defect Detection Based on Machine Vision

2021 ◽  
Author(s):  
Zhonghe Ren ◽  
Fengzhou Fang ◽  
Ning Yan ◽  
You Wu
Keyword(s):  
Image Processing ◽  
Image Analysis ◽  
Deep Learning ◽  
Machine Vision ◽  
Defect Detection ◽  
Visual Inspection ◽  
State Of The Art ◽  
Image Acquisition ◽  
Detection Algorithms ◽  
Further Development

AbstractMachine vision significantly improves the efficiency, quality, and reliability of defect detection. In visual inspection, excellent optical illumination platforms and suitable image acquisition hardware are the prerequisites for obtaining high-quality images. Image processing and analysis are key technologies in obtaining defect information, while deep learning is significantly impacting the field of image analysis. In this study, a brief history and the state of the art in optical illumination, image acquisition, image processing, and image analysis in the field of visual inspection are systematically discussed. The latest developments in industrial defect detection based on machine vision are introduced. In the further development of the field of visual inspection, the application of deep learning will play an increasingly important role. Thus, a detailed description of the application of deep learning in defect classification, localization and segmentation follows the discussion of traditional defect detection algorithms. Finally, future prospects for the development of visual inspection technology are explored.

scholarly journals Fabric Defect Detection System Using Stacked Convolutional Denoising Auto-Encoders Trained with Synthetic Defect Data

2020 ◽  
Vol 10 (7) ◽  
pp. 2511
Author(s):  
Young-Joo Han ◽  
Ha-Jin Yu
Keyword(s):  
Image Segmentation ◽  
Deep Learning ◽  
Machine Vision ◽  
Image Classification ◽  
Defect Detection ◽  
Detection System ◽  
Image Detection ◽  
Fabric Defect Detection ◽  
Fabric Defect ◽  
Segmentation Image

As defect detection using machine vision is diversifying and expanding, approaches using deep learning are increasing. Recently, there have been much research for detecting and classifying defects using image segmentation, image detection, and image classification. These methods are effective but require a large number of actual defect data. However, it is very difficult to get a large amount of actual defect data in industrial areas. To overcome this problem, we propose a method for defect detection using stacked convolutional autoencoders. The autoencoders we proposed are trained by using only non-defect data and synthetic defect data generated by using the characteristics of defect based on the knowledge of the experts. A key advantage of our approach is that actual defect data is not required, and we verified that the performance is comparable to the systems trained using real defect data.

scholarly journals Visual Inspection of the Aircraft Surface Using a Teleoperated Reconfigurable Climbing Robot and Enhanced Deep Learning Technique

2019 ◽  
Vol 2019 ◽  
pp. 1-14 ◽  
Author(s):  
Balakrishnan Ramalingam ◽  
Vega-Heredia Manuel ◽  
Mohan Rajesh Elara ◽  
Ayyalusami Vengadesh ◽  
Anirudh Krishna Lakshmanan ◽  
...  
Keyword(s):  
Deep Learning ◽  
Visual Inspection ◽  
Surface Defects ◽  
Learning Algorithm ◽  
Periodic Pattern ◽  
Surface Inspection ◽  
Detection Accuracy ◽  
Climbing Robot ◽  
Aircraft Skin ◽  
Surface Images

Aircraft surface inspection includes detecting surface defects caused by corrosion and cracks and stains from the oil spill, grease, dirt sediments, etc. In the conventional aircraft surface inspection process, human visual inspection is performed which is time-consuming and inefficient whereas robots with onboard vision systems can inspect the aircraft skin safely, quickly, and accurately. This work proposes an aircraft surface defect and stain detection model using a reconfigurable climbing robot and an enhanced deep learning algorithm. A reconfigurable, teleoperated robot, named as “Kiropter,” is designed to capture the aircraft surface images with an onboard RGB camera. An enhanced SSD MobileNet framework is proposed for stain and defect detection from these images. A Self-filtering-based periodic pattern detection filter has been included in the SSD MobileNet deep learning framework to achieve the enhanced detection of the stains and defects on the aircraft skin images. The model has been tested with real aircraft surface images acquired from a Boeing 737 and a compact aircraft’s surface using the teleoperated robot. The experimental results prove that the enhanced SSD MobileNet framework achieves improved detection accuracy of aircraft surface defects and stains as compared to the conventional models.

Image-based Surface Defect Detection Using Deep Learning: A Review

2021 ◽  
pp. 1-23
Author(s):  
Prahar Bhatt ◽  
Rishi K. Malhan ◽  
Pradeep Rajendran ◽  
Brual Shah ◽  
Shantanu Thakar ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Surface Defects ◽  
Future Research ◽  
Specific Class ◽  
Survey Paper ◽  
Context Learning ◽  
Surface Defect Detection ◽  
Manufacturing Applications ◽  
Processing Techniques

Abstract Automatically detecting surface defects from images is an essential capability in manufacturing applications. Traditional image processing techniques were useful in solving a specific class of problems. However, these techniques were unable to handle noise, variations in lighting conditions, and background with complex textures. Increasingly deep learning is being explored to automate defect detection. This survey paper presents three different ways of classifying various efforts. These are based on defect detection context, learning techniques, and defect localization and classification method. The existing literature is classified using this methodology. The paper also identifies future research directions based on the trends in the deep learning area.

scholarly journals An intelligent machine vision system for detecting surface defects on packing boxes based on support vector machine

2019 ◽  
Vol 52 (7-8) ◽  
pp. 1102-1110 ◽  
Author(s):  
Yu Wu ◽  
Yanjie Lu
Keyword(s):  
Support Vector Machine ◽  
Machine Vision ◽  
Defect Detection ◽  
Surface Defects ◽  
Vision System ◽  
Rapid Development ◽  
Training Model ◽  
Support Vector ◽  
Ideal Condition ◽  
Product Packaging

Defects in product packaging are one of the key factors that affect product sales. Traditional defect detection depends primarily on artificial vision detection. With the rapid development of machine vision, image processing, pattern recognition, and other technologies, industrial automation detection has become an inevitable trend because machine vision technology can greatly improve accuracy and efficiency; therefore, it is of great practical value to study automatic detection technology of the surface defects encountered in packaging boxes. In this study, machine vision and machine learning were combined to examine a surface defect detection method based on support vector machine where defective products are eliminated by a sorting robot system. After testing, the support vector machine training model using radial basis function kernel detects three kinds of defects at the same time under the ideal condition of parameter selection, and the effective detection rate is 98.0296%.

Machine Vision System for Automatic Inspection of Surface Defects in Aluminum Die Casting

2006 ◽  
Vol 10 (3) ◽  
pp. 281-286 ◽  
Author(s):  
Yakov Frayman ◽  
◽  
Hong Zheng ◽  
Saeid Nahavandi ◽  
Keyword(s):  
Genetic Algorithm ◽  
Machine Vision ◽  
Defect Detection ◽  
Surface Defects ◽  
Vision System ◽  
Die Casting ◽  
Noise Removal ◽  
Morphological Operations ◽  
Automatic Inspection ◽  
Machine Vision System

A camera based machine vision system for the automatic inspection of surface defects in aluminum die casting is presented. The system uses a hybrid image processing algorithm based on mathematic morphology to detect defects with different sizes and shapes. The defect inspection algorithm consists of two parts. One is a parameter learning algorithm, in which a genetic algorithm is used to extract optimal structuring element parameters, and segmentation and noise removal thresholds. The second part is a defect detection algorithm, in which the parameters obtained by a genetic algorithm are used for morphological operations. The machine vision system has been applied in an industrial setting to detect two types of casting defects: parts mix-up and any defects on the surface of castings. The system performs with a 99% or higher accuracy for both part mix-up and defect detection and is currently used in industry as part of normal production.

scholarly journals A New Steel Defect Detection Algorithm Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Weidong Zhao ◽  
Feng Chen ◽  
Hancheng Huang ◽  
Dan Li ◽  
Wei Cheng
Keyword(s):  
Deep Learning ◽  
Target Detection ◽  
Defect Detection ◽  
Steel Surface ◽  
Surface Defect ◽  
Detection Algorithm ◽  
Detection Accuracy ◽  
Average Precision ◽  
Original Algorithm ◽  
Surface Defect Detection

In recent years, more and more scholars devoted themselves to the research of the target detection algorithm due to the continuous development of deep learning. Among them, the detection and recognition of small and complex targets are still a problem to be solved. The authors of this article have understood the shortcomings of the deep learning detection algorithm in detecting small and complex defect targets and would like to share a new improved target detection algorithm in steel surface defect detection. The steel surface defects will affect the quality of steel seriously. We find that most of the current detection algorithms for NEU-DET dataset detection accuracy are low, so we choose to verify a steel surface defect detection algorithm based on machine vision on this dataset for the problem of defect detection in steel production. A series of improvement measures are carried out in the traditional Faster R-CNN algorithm, such as reconstructing the network structure of Faster R-CNN. Based on the small features of the target, we train the network with multiscale fusion. For the complex features of the target, we replace part of the conventional convolution network with a deformable convolution network. The experimental results show that the deep learning network model trained by the proposed method has good detection performance, and the mean average precision is 0.752, which is 0.128 higher than the original algorithm. Among them, the average precision of crazing, inclusion, patches, pitted surface, rolled in scale and scratches is 0.501, 0.791, 0.792, 0.874, 0.649, and 0.905, respectively. The detection method is able to identify small target defects on the steel surface effectively, which can provide a reference for the automatic detection of steel defects.

scholarly journals Drain Structural Defect Detection and Mapping Using AI-Enabled Reconfigurable Robot Raptor and IoRT Framework

Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7287
Author(s):  
Povendhan Palanisamy ◽  
Rajesh Elara Mohan ◽  
Archana Semwal ◽  
Lee Ming Jun Melivin ◽  
Braulio Félix Félix Gómez ◽  
...  
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Structural Defect ◽  
Visual Inspection ◽  
Field Trials ◽  
Detection Task ◽  
Robot Assisted ◽  
Inspection Robot ◽  
Reconfigurable Robot ◽  
Learning Frameworks

Human visual inspection of drains is laborious, time-consuming, and prone to accidents. This work presents an AI-enabled robot-assisted remote drain inspection and mapping framework using our in-house developed reconfigurable robot Raptor. The four-layer IoRT serves as a bridge between the users and the robots, through which seamless information sharing takes place. The Faster RCNN ResNet50, Faster RCNN ResNet101, and Faster RCNN Inception-ResNet-v2 deep learning frameworks were trained using a transfer learning scheme with six typical concrete defect classes and deployed in an IoRT framework remote defect detection task. The efficiency of the trained CNN algorithm and drain inspection robot Raptor was evaluated through various real-time drain inspection field trials using the SLAM technique. The experimental results indicate that robot’s maneuverability was stable, and its mapping and localization were also accurate in different drain types. Finally, for effective drain maintenance, the SLAM-based defect map was generated by fusing defect detection results in the lidar-SLAM map.

Sign in / Sign up

Export Citation Format

Share Document