Automatic Defects Segmentation and Identification by Deep Learning Algorithm with Pulsed Thermography: Synthetic and Experimental Data

In quality evaluation (QE) of the industrial production field, infrared thermography (IRT) is one of the most crucial techniques used for evaluating composite materials due to the properties of low cost, fast inspection of large surfaces, and safety. The application of deep neural networks tends to be a prominent direction in IRT Non-Destructive Testing (NDT). During the training of the neural network, the Achilles heel is the necessity of a large database. The collection of huge amounts of training data is the high expense task. In NDT with deep learning, synthetic data contributing to training in infrared thermography remains relatively unexplored. In this paper, synthetic data from the standard Finite Element Models are combined with experimental data to build repositories with Mask Region based Convolutional Neural Networks (Mask-RCNN) to strengthen the neural network, learning the essential features of objects of interest and achieving defect segmentation automatically. These results indicate the possibility of adapting inexpensive synthetic data merging with a certain amount of the experimental database for training the neural networks in order to achieve the compelling performance from a limited collection of the annotated experimental data of a real-world practical thermography experiment.

Download Full-text

Deep Learning Based Adaptive Recurrent Neural Network for Detection of Myocardial Infarction

Journal of Medical Imaging and Health Informatics ◽

10.1166/jmihi.2021.3913 ◽

2021 ◽

Vol 11 (12) ◽

pp. 3044-3053

Author(s):

Rakesh Kumar Mahendran ◽

V. Prabhu ◽

V. Parthasarathy ◽

A. Mary Judith

Keyword(s):

Neural Network ◽

Myocardial Infarction ◽

Deep Learning ◽

Recurrent Neural Network ◽

Classification Accuracy ◽

Learning Algorithm ◽

Training Data ◽

Discrete Wavelet ◽

Ecg Signal ◽

Detection Techniques

Myocardial infarction (MI) may precipitate severe health damage and lead to irreversible death of the heart muscle, the result of prolonged lack of oxygen if it is not treated in a timely manner. Lack of accurate and early detection techniques for this heart disease has reduced the efficiency of MI diagnosis. In this paper, the design, and implementation of an efficient deep learning algorithm called Adaptive Recurrent neural network (ARNN) is proposed for the MI detection. The main objective of the proposed work is the accurate identification of MI disease using ECG signals. ECG signal denoising has been performed using the Multi-Notch filter, which removes the specified noise frequency range. Discrete wavelet transform (DWT) is utilized for performing the feature extraction that decomposes the ECG signal into varied scales with waveletfiltering bank. After the extraction of specific QRS features, classification of the defected and normal ECG arrhythmic beat has been performed using the deep learning-based ARNN classifier. The MIT-BIH database has been used for testing and training data. The performance of the proposed algorithm is evaluated based on classification accuracy. Results that are attained include the classification accuracy of about 99.21%, 99% of sensitivity and 99.4% of specificity with PPV and NPV of about 99.4 and 99.01 values indicate the enhanced performance of our proposed work compared with the conventional LSTM-CAE and LSTM-CNN techniques.

Download Full-text

Convolutional Neural Network

10.4018/978-1-6684-2408-7.ch077 ◽

2022 ◽

pp. 1559-1575

Author(s):

Mário Pereira Véstias

Keyword(s):

Neural Network ◽

Machine Learning ◽

Neural Networks ◽

Artificial Neural Networks ◽

Deep Learning ◽

Convolutional Neural Network ◽

Machine Learning Algorithms ◽

Training Data ◽

Machine Learning Model ◽

Artificial Neural

Machine learning is the study of algorithms and models for computing systems to do tasks based on pattern identification and inference. When it is difficult or infeasible to develop an algorithm to do a particular task, machine learning algorithms can provide an output based on previous training data. A well-known machine learning model is deep learning. The most recent deep learning models are based on artificial neural networks (ANN). There exist several types of artificial neural networks including the feedforward neural network, the Kohonen self-organizing neural network, the recurrent neural network, the convolutional neural network, the modular neural network, among others. This article focuses on convolutional neural networks with a description of the model, the training and inference processes and its applicability. It will also give an overview of the most used CNN models and what to expect from the next generation of CNN models.

Download Full-text

Modeling a Thermochemical Reactor of a Solar Refrigerator by BaCl2-NH3 Sorption Using Artificial Neural Networks and Mathematical Symmetry Groups

Mathematical Problems in Engineering ◽

10.1155/2020/9098709 ◽

2020 ◽

Vol 2020 ◽

pp. 1-11

Author(s):

Onesimo Meza-Cruz ◽

Isaac Pilatowsky ◽

Agustín Pérez-Ramírez ◽

Carlos Rivera-Blanco ◽

Youness El Hamzaoui ◽

...

Keyword(s):

Neural Network ◽

Experimental Data ◽

Neural Networks ◽

Heating Temperature ◽

Barium Chloride ◽

Symmetry Groups ◽

Solar Cooling ◽

Network Training ◽

The Neural Network ◽

Marquardt Algorithm

The aim of this work is to present a model for heat transfer, desorbed refrigerant, and pressure of an intermittent solar cooling system’s thermochemical reactor based on backpropagation neural networks and mathematical symmetry groups. In order to achieve this, a reactor was designed and built based on the reaction of BaCl2-NH3. Experimental data from this reactor were collected, where barium chloride was used as a solid absorbent and ammonia as a refrigerant. The neural network was trained using the Levenberg–Marquardt algorithm. The correlation coefficient between experimental data and data simulated by the neural network was r = 0.9957. In the neural network’s sensitivity analysis, it was found that the inputs, reactor’s heating temperature and sorption time, influence neural network’s learning by 35% and 20%, respectively. It was also found that, by applying permutations to experimental data and using multibase mathematical symmetry groups, the neural network training algorithm converges faster.

Download Full-text

Use of a Multilayer Perceptron to Automate Terrain Assessment for the Needs of the Armed Forces

ISPRS International Journal of Geo-Information ◽

10.3390/ijgi7110430 ◽

2018 ◽

Vol 7 (11) ◽

pp. 430 ◽

Cited By ~ 3

Author(s):

Krzysztof Pokonieczny

Keyword(s):

Neural Network ◽

Neural Networks ◽

Multilayer Perceptron ◽

Learning Algorithm ◽

Armed Forces ◽

Shuttle Radar Topography Mission ◽

Terrain Classification ◽

The Neural Network ◽

Data Configuration ◽

Trained Neural Network

The classification of terrain in terms of passability plays a significant role in the process of military terrain assessment. It involves classifying selected terrain to specific classes (GO, SLOW-GO, NO-GO). In this article, the problem of terrain classification to the respective category of passability was solved by applying artificial neural networks (multilayer perceptron) to generate a continuous Index of Passability (IOP). The neural networks defined this factor for primary fields in two sizes (1000 × 1000 m and 100 × 100 m) based on the land cover elements obtained from Vector Smart Map (VMap) Level 2 and Shuttle Radar Topography Mission (SRTM). The work used a feedforward neural network consisting of three layers. The paper presents a comprehensive analysis of the reliability of the neural network parameters, taking into account the number of neurons, learning algorithm, activation functions and input data configuration. The studies and tests carried out have shown that a well-trained neural network can automate the process of terrain classification in terms of passability conditions.

Download Full-text

Diagnosing Diabetes Using Artificial Neural Networks

European Journal of Engineering Research and Science ◽

10.24018/ejers.2020.5.2.1774 ◽

2020 ◽

Vol 5 (2) ◽

pp. 221-224

Author(s):

Joy Oyinye Orukwo ◽

Ledisi Giok Kabari

Keyword(s):

Neural Network ◽

Neural Networks ◽

Artificial Neural Networks ◽

Success Rate ◽

Medical Diagnosis ◽

Learning Algorithm ◽

Diabetes Diagnosis ◽

Feed Forward Neural Network ◽

The Neural Network ◽

Artificial Neural

Diabetes has always been a silent killer and the number of people suffering from it has increased tremendously in the last few decades. More often than not, people continue with their normal lifestyle, unaware that their health is at severe risk and with each passing day diabetes goes undetected. Artificial Neural Networks have become extensively useful in medical diagnosis as it provides a powerful tool to help analyze, model and make sense of complex clinical data. This study developed a diabetes diagnosis system using feed-forward neural network with supervised learning algorithm. The neural network is systematically trained and tested and a success rate of 90% was achieved.

Download Full-text

Increasing of Thermal Images Resolution Using Deep Learning Neural Networks

Pomiary Automatyka Robotyka ◽

10.14313/par_241/31 ◽

2021 ◽

Vol 25 (3) ◽

pp. 31-35

Author(s):

Piotr Więcek ◽

Dominik Sankowski

Keyword(s):

Neural Network ◽

Neural Networks ◽

Deep Learning ◽

Execution Time ◽

High Accuracy ◽

New Method ◽

Residual Network ◽

Thermal Images ◽

The Neural Network

The article presents a new algorithm for increasing the resolution of thermal images. For this purpose, the residual network was integrated with the Kernel-Sharing Atrous Convolution (KSAC) image sub-sampling module. A significant reduction in the algorithm’s complexity and shortening the execution time while maintaining high accuracy were achieved. The neural network has been implemented in the PyTorch environment. The results of the proposed new method of increasing the resolution of thermal images with sizes 32 × 24, 160 × 120 and 640 × 480 for scales up to 6 are presented.

Download Full-text

Convolutional neural network for image classification based on transfer learning technique

10.32920/ryerson.14663658 ◽

2021 ◽

Author(s):

Ghassan Mohammed Halawani

Keyword(s):

Neural Network ◽

Neural Networks ◽

Deep Learning ◽

Convolutional Neural Network ◽

Image Classification ◽

Transfer Learning ◽

Learning Networks ◽

The Neural Network ◽

Learning Technique ◽

Common Architecture

The main purpose of this project is to modify a convolutional neural network for image classification, based on a deep-learning framework. A transfer learning technique is used by the MATLAB interface to Alex-Net to train and modify the parameters in the last two fully connected layers of Alex-Net with a new dataset to perform classifications of thousands of images. First, the general common architecture of most neural networks and their benefits are presented. The mathematical models and the role of each part in the neural network are explained in detail. Second, different neural networks are studied in terms of architecture, application, and the working method to highlight the strengths and weaknesses of each of neural network. The final part conducts a detailed study on one of the most powerful deep-learning networks in image classification – i.e. the convolutional neural network – and how it can be modified to suit different classification tasks by using transfer learning technique in MATLAB.

Download Full-text

Deep Learning Neural Networks to Predict Serious Complications After Bariatric Surgery: Analysis of Scandinavian Obesity Surgery Registry Data (Preprint)

10.2196/preprints.15992 ◽

2019 ◽

Author(s):

Yang Cao ◽

Scott Montgomery ◽

Johan Ottosson ◽

Erik Näslund ◽

Erik Stenberg

Keyword(s):

Neural Network ◽

Neural Networks ◽

Bariatric Surgery ◽

Deep Learning ◽

Postoperative Complications ◽

Obesity Surgery ◽

Test Data ◽

Registry Data ◽

Training Data ◽

Complications After Bariatric Surgery

BACKGROUND Obesity is one of today’s most visible public health problems worldwide. Although modern bariatric surgery is ostensibly considered safe, serious complications and mortality still occur in some patients. OBJECTIVE This study aimed to explore whether serious postoperative complications of bariatric surgery recorded in a national quality registry can be predicted preoperatively using deep learning methods. METHODS Patients who were registered in the Scandinavian Obesity Surgery Registry (SOReg) between 2010 and 2015 were included in this study. The patients who underwent a bariatric procedure between 2010 and 2014 were used as training data, and those who underwent a bariatric procedure in 2015 were used as test data. Postoperative complications were graded according to the Clavien-Dindo classification, and complications requiring intervention under general anesthesia or resulting in organ failure or death were considered serious. Three supervised deep learning neural networks were applied and compared in our study: multilayer perceptron (MLP), convolutional neural network (CNN), and recurrent neural network (RNN). The synthetic minority oversampling technique (SMOTE) was used to artificially augment the patients with serious complications. The performances of the neural networks were evaluated using accuracy, sensitivity, specificity, Matthews correlation coefficient, and area under the receiver operating characteristic curve. RESULTS In total, 37,811 and 6250 patients were used as the training data and test data, with incidence rates of serious complication of 3.2% (1220/37,811) and 3.0% (188/6250), respectively. When trained using the SMOTE data, the MLP appeared to have a desirable performance, with an area under curve (AUC) of 0.84 (95% CI 0.83-0.85). However, its performance was low for the test data, with an AUC of 0.54 (95% CI 0.53-0.55). The performance of CNN was similar to that of MLP. It generated AUCs of 0.79 (95% CI 0.78-0.80) and 0.57 (95% CI 0.59-0.61) for the SMOTE data and test data, respectively. Compared with the MLP and CNN, the RNN showed worse performance, with AUCs of 0.65 (95% CI 0.64-0.66) and 0.55 (95% CI 0.53-0.57) for the SMOTE data and test data, respectively. CONCLUSIONS MLP and CNN showed improved, but limited, ability for predicting the postoperative serious complications after bariatric surgery in the Scandinavian Obesity Surgery Registry data. However, the overfitting issue is still apparent and needs to be overcome by incorporating intra- and perioperative information. CLINICALTRIAL

Download Full-text

Evaluasi Performasi Ruang Warna pada Klasifikasi Diabetic Retinophaty Menggunakan Convolution Neural Network

Jurnal Teknologi Informasi dan Ilmu Komputer ◽

10.25126/jtiik.2021834459 ◽

2021 ◽

Vol 8 (3) ◽

pp. 619

Author(s):

Candra Dewi ◽

Andri Santoso ◽

Indriati Indriati ◽

Nadia Artha Dewi ◽

Yoke Kusuma Arbawa

Keyword(s):

Neural Network ◽

Diabetic Retinopathy ◽

Deep Learning ◽

Convolutional Neural Network ◽

Learning Algorithm ◽

Color Space ◽

Training Data ◽

Color Spaces ◽

Deep Learning Algorithm ◽

Optimal Accuracy

Semakin meningkatnya jumlah penderita diabetes menjadi salah satu faktor penyebab semakin tingginya penderita penyakit diabetic retinophaty. Salah satu citra yang digunakan oleh dokter mata untuk mengidentifikasi diabetic retinophaty adalah foto retina. Dalam penelitian ini dilakukan pengenalan penyakit diabetic retinophaty secara otomatis menggunakan citra fundus retina dan algoritme Convolutional Neural Network (CNN) yang merupakan variasi dari algoritme Deep Learning. Kendala yang ditemukan dalam proses pengenalan adalah warna retina yang cenderung merah kekuningan sehingga ruang warna RGB tidak menghasilkan akurasi yang optimal. Oleh karena itu, dalam penelitian ini dilakukan pengujian pada berbagai ruang warna untuk mendapatkan hasil yang lebih baik. Dari hasil uji coba menggunakan 1000 data pada ruang warna RGB, HSI, YUV dan L*a*b* memberikan hasil yang kurang optimal pada data seimbang dimana akurasi terbaik masih dibawah 50%. Namun pada data tidak seimbang menghasilkan akurasi yang cukup tinggi yaitu 83,53% pada ruang warna YUV dengan pengujian pada data latih dan akurasi 74,40% dengan data uji pada semua ruang warna. AbstractIncreasing the number of people with diabetes is one of the factors causing the high number of people with diabetic retinopathy. One of the images used by ophthalmologists to identify diabetic retinopathy is a retinal photo. In this research, the identification of diabetic retinopathy is done automatically using retinal fundus images and the Convolutional Neural Network (CNN) algorithm, which is a variation of the Deep Learning algorithm. The obstacle found in the recognition process is the color of the retina which tends to be yellowish red so that the RGB color space does not produce optimal accuracy. Therefore, in this research, various color spaces were tested to get better results. From the results of trials using 1000 images data in the color space of RGB, HSI, YUV and L * a * b * give suboptimal results on balanced data where the best accuracy is still below 50%. However, the unbalanced data gives a fairly high accuracy of 83.53% with training data on the YUV color space and 74,40% with testing data on all color spaces.

Download Full-text

Deep Learning Neural Networks to Predict Serious Complications After Bariatric Surgery: Analysis of Scandinavian Obesity Surgery Registry Data

JMIR Medical Informatics ◽

10.2196/15992 ◽

2020 ◽

Vol 8 (5) ◽

pp. e15992 ◽

Cited By ~ 1

Author(s):

Yang Cao ◽

Scott Montgomery ◽

Johan Ottosson ◽

Erik Näslund ◽

Erik Stenberg

Keyword(s):

Neural Network ◽

Neural Networks ◽

Bariatric Surgery ◽

Deep Learning ◽

Postoperative Complications ◽

Obesity Surgery ◽

Test Data ◽

Registry Data ◽

Training Data ◽

Complications After Bariatric Surgery

Background Obesity is one of today’s most visible public health problems worldwide. Although modern bariatric surgery is ostensibly considered safe, serious complications and mortality still occur in some patients. Objective This study aimed to explore whether serious postoperative complications of bariatric surgery recorded in a national quality registry can be predicted preoperatively using deep learning methods. Methods Patients who were registered in the Scandinavian Obesity Surgery Registry (SOReg) between 2010 and 2015 were included in this study. The patients who underwent a bariatric procedure between 2010 and 2014 were used as training data, and those who underwent a bariatric procedure in 2015 were used as test data. Postoperative complications were graded according to the Clavien-Dindo classification, and complications requiring intervention under general anesthesia or resulting in organ failure or death were considered serious. Three supervised deep learning neural networks were applied and compared in our study: multilayer perceptron (MLP), convolutional neural network (CNN), and recurrent neural network (RNN). The synthetic minority oversampling technique (SMOTE) was used to artificially augment the patients with serious complications. The performances of the neural networks were evaluated using accuracy, sensitivity, specificity, Matthews correlation coefficient, and area under the receiver operating characteristic curve. Results In total, 37,811 and 6250 patients were used as the training data and test data, with incidence rates of serious complication of 3.2% (1220/37,811) and 3.0% (188/6250), respectively. When trained using the SMOTE data, the MLP appeared to have a desirable performance, with an area under curve (AUC) of 0.84 (95% CI 0.83-0.85). However, its performance was low for the test data, with an AUC of 0.54 (95% CI 0.53-0.55). The performance of CNN was similar to that of MLP. It generated AUCs of 0.79 (95% CI 0.78-0.80) and 0.57 (95% CI 0.59-0.61) for the SMOTE data and test data, respectively. Compared with the MLP and CNN, the RNN showed worse performance, with AUCs of 0.65 (95% CI 0.64-0.66) and 0.55 (95% CI 0.53-0.57) for the SMOTE data and test data, respectively. Conclusions MLP and CNN showed improved, but limited, ability for predicting the postoperative serious complications after bariatric surgery in the Scandinavian Obesity Surgery Registry data. However, the overfitting issue is still apparent and needs to be overcome by incorporating intra- and perioperative information.

Download Full-text