Deep learning based model for Defect Detection of Mono-Crystalline-Si Solar PV Module Cells in Electroluminescence Images Using Data Augmentation

2019 ◽  
Author(s):  
Wuqin Tang ◽  
Qiang Yang ◽  
Wenjun Yan
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Data Augmentation ◽  
Solar Pv ◽  
Pv Module ◽  
Using Data

scholarly journals Efficient Cell Segmentation from Electroluminescent Images of Single-Crystalline Silicon Photovoltaic Modules and Cell-Based Defect Identification Using Deep Learning with Pseudo-Colorization

Sensors ◽  
2021 ◽  
Vol 21 (13) ◽  
pp. 4292
Author(s):  
Horng-Horng Lin ◽  
Harshad Kumar Dandage ◽  
Keh-Moh Lin ◽  
You-Teh Lin ◽  
Yeou-Jiunn Chen
Keyword(s):  
Deep Learning ◽  
Defect Detection ◽  
Crystalline Silicon ◽  
Cell Segmentation ◽  
Solar Pv ◽  
Single Crystalline Silicon ◽  
Defect Inspection ◽  
Defect Identification ◽  
Pv Modules ◽  
A Cell

Solar cells may possess defects during the manufacturing process in photovoltaic (PV) industries. To precisely evaluate the effectiveness of solar PV modules, manufacturing defects are required to be identified. Conventional defect inspection in industries mainly depends on manual defect inspection by highly skilled inspectors, which may still give inconsistent, subjective identification results. In order to automatize the visual defect inspection process, an automatic cell segmentation technique and a convolutional neural network (CNN)-based defect detection system with pseudo-colorization of defects is designed in this paper. High-resolution Electroluminescence (EL) images of single-crystalline silicon (sc-Si) solar PV modules are used in our study for the detection of defects and their quality inspection. Firstly, an automatic cell segmentation methodology is developed to extract cells from an EL image. Secondly, defect detection can be actualized by CNN-based defect detector and can be visualized with pseudo-colors. We used contour tracing to accurately localize the panel region and a probabilistic Hough transform to identify gridlines and busbars on the extracted panel region for cell segmentation. A cell-based defect identification system was developed using state-of-the-art deep learning in CNNs. The detected defects are imposed with pseudo-colors for enhancing defect visualization using K-means clustering. Our automatic cell segmentation methodology can segment cells from an EL image in about 2.71 s. The average segmentation errors along the x-direction and y-direction are only 1.6 pixels and 1.4 pixels, respectively. The defect detection approach on segmented cells achieves 99.8% accuracy. Along with defect detection, the defect regions on a cell are furnished with pseudo-colors to enhance the visualization.

scholarly journals Image editing-based data augmentation for illumination-insensitive background subtraction

2020 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Dimitrios Sakkos ◽  
Edmond S. L. Ho ◽  
Hubert P. H. Shum ◽  
Garry Elvin
Keyword(s):  
Deep Learning ◽  
Pilot Study ◽  
Background Subtraction ◽  
Data Augmentation ◽  
Point Of View ◽  
Content Type ◽  
Illumination Changes ◽  
Image Appearance ◽  
Using Data ◽  
Limited Training Samples

PurposeA core challenge in background subtraction (BGS) is handling videos with sudden illumination changes in consecutive frames. In our pilot study published in, Sakkos:SKIMA 2019, we tackle the problem from a data point-of-view using data augmentation. Our method performs data augmentation that not only creates endless data on the fly but also features semantic transformations of illumination which enhance the generalisation of the model.Design/methodology/approachIn our pilot study published in SKIMA 2019, the proposed framework successfully simulates flashes and shadows by applying the Euclidean distance transform over a binary mask generated randomly. In this paper, we further enhance the data augmentation framework by proposing new variations in image appearance both locally and globally.FindingsExperimental results demonstrate the contribution of the synthetics in the ability of the models to perform BGS even when significant illumination changes take place.Originality/valueSuch data augmentation allows us to effectively train an illumination-invariant deep learning model for BGS. We further propose a post-processing method that removes noise from the output binary map of segmentation, resulting in a cleaner, more accurate segmentation map that can generalise to multiple scenes of different conditions. We show that it is possible to train deep learning models even with very limited training samples. The source code of the project is made publicly available at https://github.com/dksakkos/illumination_augmentation

scholarly journals Plastic Gasket Defect Detection Based on Transfer Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Xieyi Chen ◽  
Dongyun Wang ◽  
Jinjun Shao ◽  
Jun Fan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Defect Detection ◽  
Data Augmentation ◽  
Surface Defects ◽  
Visual Detection ◽  
Training Data

To automatically detect plastic gasket defects, a set of plastic gasket defect visual detection devices based on GoogLeNet Inception-V2 transfer learning was designed and established in this study. The GoogLeNet Inception-V2 deep convolutional neural network (DCNN) was adopted to extract and classify the defect features of plastic gaskets to solve the problem of their numerous surface defects and difficulty in extracting and classifying the features. Deep learning applications require a large amount of training data to avoid model overfitting, but there are few datasets of plastic gasket defects. To address this issue, data augmentation was applied to our dataset. Finally, the performance of the three convolutional neural networks was comprehensively compared. The results showed that the GoogLeNet Inception-V2 transfer learning model had a better performance in less time. It means it had higher accuracy, reliability, and efficiency on the dataset used in this paper.

scholarly journals Face Recognition via Deep Learning Using Data Augmentation Based on Orthogonal Experiments

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1088 ◽  
Author(s):  
Zhao Pei ◽  
Hang Xu ◽  
Yanning Zhang ◽  
Min Guo ◽  
Yee-Hong Yang
Keyword(s):  
Deep Learning ◽  
Face Recognition ◽  
Large Scale ◽  
Data Augmentation ◽  
Small Sample ◽  
Geometric Transformation ◽  
Image Brightness ◽  
Class Attendance ◽  
Orthogonal Experiments ◽  
Using Data

Class attendance is an important means in the management of university students. Using face recognition is one of the most effective techniques for taking daily class attendance. Recently, many face recognition algorithms via deep learning have achieved promising results with large-scale labeled samples. However, due to the difficulties of collecting samples, face recognition using convolutional neural networks (CNNs) for daily attendance taking remains a challenging problem. Data augmentation can enlarge the samples and has been applied to the small sample learning. In this paper, we address this problem using data augmentation through geometric transformation, image brightness changes, and the application of different filter operations. In addition, we determine the best data augmentation method based on orthogonal experiments. Finally, the performance of our attendance method is demonstrated in a real class. Compared with PCA and LBPH methods with data augmentation and VGG-16 network, the accuracy of our proposed method can achieve 86.3%. Additionally, after a period of collecting more data, the accuracy improves to 98.1%.

scholarly journals Medical Augmentation (Med-Aug) for Optimal Data Augmentation in Medical Deep Learning Networks

Sensors ◽  
2021 ◽  
Vol 21 (21) ◽  
pp. 7018
Author(s):  
Justin Lo ◽  
Jillian Cardinell ◽  
Alejo Costanzo ◽  
Dafna Sussman
Keyword(s):  
Deep Learning ◽  
High Performance ◽  
Data Augmentation ◽  
Search Algorithm ◽  
High Dimensional ◽  
Learning Networks ◽  
Imaging Data ◽  
Covariance Matrix Adaptation ◽  
Using Data ◽  
Adaptation Evolution

Deep learning (DL) algorithms have become an increasingly popular choice for image classification and segmentation tasks; however, their range of applications can be limited. Their limitation stems from them requiring ample data to achieve high performance and adequate generalizability. In the case of clinical imaging data, images are not always available in large quantities. This issue can be alleviated by using data augmentation (DA) techniques. The choice of DA is important because poor selection can possibly hinder the performance of a DL algorithm. We propose a DA policy search algorithm that offers an extended set of transformations that accommodate the variations in biomedical imaging datasets. The algorithm makes use of the efficient and high-dimensional optimizer Bi-Population Covariance Matrix Adaptation Evolution Strategy (BIPOP-CMA-ES) and returns an optimal DA policy based on any input imaging dataset and a DL algorithm. Our proposed algorithm, Medical Augmentation (Med-Aug), can be implemented by other researchers in related medical DL applications to improve their model’s performance. Furthermore, we present our found optimal DA policies for a variety of medical datasets and popular segmentation networks for other researchers to use in related tasks.

Sign in / Sign up

Export Citation Format

Share Document