Segmented and Non-Segmented Skin Lesions Classification Using Transfer Learning and Adaptive Moment Learning Rate Technique Using Pretrained Convolutional Neural Network

2019 ◽  
Vol 42 ◽  
pp. 67-78 ◽  
Author(s):  
Ali Mohammad Alqudah ◽  
Hiam Alquraan ◽  
Isam Abu Qasmieh
Keyword(s):  
Skin Lesion ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Skin Lesions ◽  
Learning Rate ◽  
Seborrheic Keratosis ◽  
Severe Problem ◽  
Deep Learning Algorithm ◽  
Reliable Classification ◽  
High Degree

A skin lesion is a very severe problem, especially in coastal countries. Early detection by a highly reliable classification of skin lesion causes a great reduction in the mortality rate. Recognition of melanoma is a complicated issue due to the high degree of visual similarities between melanoma and non-melanoma lesions. Various studies are carried out to overcome this problem and to obtain accurate screening of skin lesion, where the most recent method for segmenting and classifying the lesion is based on a deep learning algorithm. In this paper, (GoogleNet) and (AlexNet) are employed with transfer learning and optimization gradient descent adaptive momentum learning rate (ADAM). The proposed method is applied on Archive International Skin Imaging Collaboration (ISIC) database to classify images into three main classes (benign, melanoma, seborrheic keratosis) under the two scenarios; segmented and non-segmented lesion images. The overall accuracy of the non-segmented classification database is 92.2% and 89.8% for the non-segmented dataset. Utilizing optimization algorithm (ADAM) leads to a significant improvement in the classification results when they are compared with previous studies.

scholarly journals Skin Lesions Classification Using Deep Learning Techniques: Review

2021 ◽  
pp. 1-22
Author(s):  
Omar Sedqi Kareem ◽  
Adnan Mohsin Abdulazee ◽  
Diyar Qader Zeebaree
Keyword(s):  
Deep Learning ◽  
Skin Cancer ◽  
Skin Lesion ◽  
Learning Algorithm ◽  
Skin Lesions ◽  
Disease Diagnosis ◽  
Deep Convolutional Neural Networks ◽  
Deep Learning Algorithm ◽  
The Usa ◽  
Effective Models

Skin cancer is a significant health problem. More than 123,000 new cases per year are recorded. Melanoma is the most popular type of skin cancer, leading to more than 9000 deaths annually in the USA. Skin disease diagnosis is getting difficult due to visual similarities. While Melanoma is the most common form of skin cancer, other pathology types are also fatal. Automatic melanoma screening systems will be useful in identifying those skin cancers more appropriately. Advances in technology and growth in computational capabilities have allowed machine learning and deep learning algorithms to analyze skin lesion images. Deep Convolutional Neural Networks (DCNNs) have achieved more encouraging results, yet faster systems for diagnosing fatal diseases are the need of the hour. This paper presents a survey of techniques for skin cancer detection from images. The paper aims to present a review of existing state-of-the-art and effective models for automatically detecting Melanoma from skin images. The result of classifications and segmentation from the skin lesion images will be processed better using the ensemble deep learning algorithm.

Comparing the capabilities of transfer learning models to detect skin lesion in humans

2020 ◽  
Vol 234 (10) ◽  
pp. 1083-1093 ◽  
Author(s):  
Aditi Singhal ◽  
Ramesht Shukla ◽  
Pavan Kumar Kankar ◽  
Saurabh Dubey ◽  
Sukhjeet Singh ◽  
...  
Keyword(s):  
Skin Lesion ◽  
Transfer Learning ◽  
Wiener Filter ◽  
Skin Lesions ◽  
Automated Classification ◽  
Convolutional Networks ◽  
Image Quantization ◽  
Malignant Skin ◽  
Effective Diagnosis

Effective diagnosis of skin tumours mainly relies on the analysis of the characteristics of the lesion. Automatic detection of malignant skin lesion has become a mandatory task to reduce the risk of human deaths and increase their survival. This article proposes a study of skin lesion classification using transfer learning approach. The transfer learning model uses four different state-of-the-art architectures, namely Inception v3, Residual Networks (ResNet 50), Dense Convolutional Networks (DenseNet 201) and Inception Residual Networks (Inception ResNet v2). These models are trained under the dataset comprising seven different classes of skin lesions. The skin lesion images are pre-processed using image quantization, grayscaling and the Wiener filter before final training step. These models are compared for performance evaluation on different metrics. The present study shows the efficacy of the methodology for automated classification of lesion images.

scholarly journals Evaluation of Scalability and Degree of Fine-Tuning of Deep Convolutional Neural Networks for COVID-19 Screening on Chest X-ray Images Using Explainable Deep-Learning Algorithm

2020 ◽  
Vol 10 (4) ◽  
pp. 213 ◽  
Author(s):  
Ki-Sun Lee ◽  
Jae Young Kim ◽  
Eun-tae Jeon ◽  
Won Suk Choi ◽  
Nan Hee Kim ◽  
...  
Keyword(s):  
Deep Learning ◽  
Learning Strategies ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Fine Tuning ◽  
Deep Convolutional Neural Networks ◽  
X Ray ◽  
Backbone Network ◽  
Deep Learning Algorithm ◽  
Chest X Ray

According to recent studies, patients with COVID-19 have different feature characteristics on chest X-ray (CXR) than those with other lung diseases. This study aimed at evaluating the layer depths and degree of fine-tuning on transfer learning with a deep convolutional neural network (CNN)-based COVID-19 screening in CXR to identify efficient transfer learning strategies. The CXR images used in this study were collected from publicly available repositories, and the collected images were classified into three classes: COVID-19, pneumonia, and normal. To evaluate the effect of layer depths of the same CNN architecture, CNNs called VGG-16 and VGG-19 were used as backbone networks. Then, each backbone network was trained with different degrees of fine-tuning and comparatively evaluated. The experimental results showed the highest AUC value to be 0.950 concerning COVID-19 classification in the experimental group of a fine-tuned with only 2/5 blocks of the VGG16 backbone network. In conclusion, in the classification of medical images with a limited number of data, a deeper layer depth may not guarantee better results. In addition, even if the same pre-trained CNN architecture is used, an appropriate degree of fine-tuning can help to build an efficient deep learning model.

scholarly journals Comparison of a Deep Learning Algorithm vs. Humans for Vertebral Heart Scale Measurements in Cats and Dogs Shows a High Degree of Agreement Among Readers

2021 ◽  
Vol 8 ◽  
Author(s):  
Emilie Boissady ◽  
Alois De La Comble ◽  
Xiajuan Zhu ◽  
Jonathan Abbott ◽  
Hespel Adrien-Maxence
Keyword(s):  
Learning Algorithm ◽  
Intraclass Correlation ◽  
Ground Truth ◽  
Reference Points ◽  
Deep Learning Algorithm ◽  
High Degree ◽  
Manual Calculation ◽  
Original Approach ◽  
Cardiac Enlargement

Heart disease is a leading cause of death among cats and dogs. Vertebral heart scale (VHS) is one tool to quantify radiographic cardiac enlargement and to predict the occurrence of congestive heart failure. The aim of this study was to evaluate the performance of artificial intelligence (AI) performing VHS measurements when compared with two board-certified specialists. Ground truth consisted of the average of constituent VHS measurements performed by board-certified specialists. Thirty canine and 30 feline thoracic lateral radiographs were evaluated by each operator, using two different methods for determination of the cardiac short axis on dogs' radiographs: the original approach published by Buchanan and the modified approach proposed by the EPIC trial authors, and only Buchanan's method for cats' radiographs. Overall, the VHS calculated by the AI, radiologist, and cardiologist had a high degree of agreement in both canine and feline patients (intraclass correlation coefficient (ICC) = 0.998). In canine patients, when comparing methods used to calculate VHS by specialists, there was also a high degree of agreement (ICC = 0.999). When evaluating specifically the results of the AI VHS vs. the two specialists' readings, the agreement was excellent for both canine (ICC = 0.998) and feline radiographs (ICC = 0.998). Performance of AI trained to locate VHS reference points agreed with manual calculation by specialists in both cats and dogs. Such a computer-aided technique might be an important asset for veterinarians in general practice to limit interobserver variability and obtain more comparable VHS reading over time.

scholarly journals Transfer Learning Strategies for Deep Learning-based PHM Algorithms

2020 ◽  
Vol 10 (7) ◽  
pp. 2361
Author(s):  
Fan Yang ◽  
Wenjin Zhang ◽  
Laifa Tao ◽  
Jian Ma
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Learning Strategies ◽  
Transfer Learning ◽  
High Speed ◽  
Health Management ◽  
Learning Algorithm ◽  
Learning Technology ◽  
Deep Learning Algorithm ◽  
Transfer Strategies

As we enter the era of big data, we have to face big data generated by industrial systems that are massive, diverse, high-speed, and variability. In order to effectively deal with big data possessing these characteristics, deep learning technology has been widely used. However, the existing methods require great human involvement that is heavily depend on domain expertise and may thus be non-representative and biased from task to similar task, so for a wide variety of prognostic and health management (PHM) tasks, how to apply the developed deep learning algorithms to similar tasks to reduce the amount of development and data collection costs has become an urgent problem. Based on the idea of transfer learning and the structures of deep learning PHM algorithms, this paper proposes two transfer strategies via transferring different elements of deep learning PHM algorithms, analyzes the possible transfer scenarios in practical application, and proposes transfer strategies applicable in each scenario. At the end of this paper, the deep learning algorithm of bearing fault diagnosis based on convolutional neural networks (CNN) is transferred based on the proposed method, which was carried out under different working conditions and for different objects, respectively. The experiments verify the value and effectiveness of the proposed method and give the best choice of transfer strategy.

scholarly journals A Reinforcement Learning Algorithm for Automated Detection of Skin Lesions

2021 ◽  
Vol 11 (20) ◽  
pp. 9367
Author(s):  
Usman Ahmad Usmani ◽  
Junzo Watada ◽  
Jafreezal Jaafar ◽  
Izzatdin Abdul Aziz ◽  
Arunava Roy
Keyword(s):  
Reinforcement Learning ◽  
Learning Algorithm ◽  
Ground Truth ◽  
Skin Lesions ◽  
Action Space ◽  
Gradient Algorithm ◽  
Lesion Segmentation ◽  
Seborrheic Keratosis ◽  
Continuous Action ◽  
Reinforcement Learning Algorithm

Skin cancers are increasing at an alarming rate, and detection in the early stages is essential for advanced treatment. The current segmentation methods have limited labeling ability to the ground truth images due to the numerous noisy expert annotations present in the datasets. The precise boundary segmentation is essential to correctly locate and diagnose the various skin lesions. In this work, the lesion segmentation method is proposed as a Markov decision process. It is solved by training an agent to segment the region using a deep reinforcement-learning algorithm. Our method is similar to the delineation of a region of interest by the physicians. The agent follows a set of serial actions for the region delineation, and the action space is defined as a set of continuous action parameters. The segmentation model learns in continuous action space using the deep deterministic policy gradient algorithm. The proposed method enables continuous improvement in performance as we proceed from coarse segmentation results to finer results. Finally, our proposed model is evaluated on the International Skin Imaging Collaboration (ISIC) 2017 image dataset, Human against Machine (HAM10000), and PH2 dataset. On the ISIC 2017 dataset, the algorithm achieves an accuracy of 96.33% for the naevus cases, 95.39% for the melanoma cases, and 94.27% for the seborrheic keratosis cases. The other metrics are evaluated on these datasets and rank higher when compared with the current state-of-the-art lesion segmentation algorithms.

scholarly journals Deep Neural Networks and Transfer Learning for Food Crop Identification in UAV Images

Drones ◽  
2020 ◽  
Vol 4 (1) ◽  
pp. 7 ◽  
Author(s):  
Robert Chew ◽  
Jay Rineer ◽  
Robert Beach ◽  
Maggie O’Neil ◽  
Noel Ujeneza ◽  
...  
Keyword(s):  
Neural Networks ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Future Research ◽  
Deep Convolutional Neural Networks ◽  
Public And Private ◽  
Deep Learning Algorithm ◽  
Crop Types ◽  
Public And Private Stakeholders ◽  
Uav Images

Accurate projections of seasonal agricultural output are essential for improving food security. However, the collection of agricultural information through seasonal agricultural surveys is often not timely enough to inform public and private stakeholders about crop status during the growing season. Acquiring timely and accurate crop estimates can be particularly challenging in countries with predominately smallholder farms because of the large number of small plots, intense intercropping, and high diversity of crop types. In this study, we used RGB images collected from unmanned aerial vehicles (UAVs) flown in Rwanda to develop a deep learning algorithm for identifying crop types, specifically bananas, maize, and legumes, which are key strategic food crops in Rwandan agriculture. The model leverages advances in deep convolutional neural networks and transfer learning, employing the VGG16 architecture and the publicly accessible ImageNet dataset for pretraining. The developed model performs with an overall test set F1 of 0.86, with individual classes ranging from 0.49 (legumes) to 0.96 (bananas). Our findings suggest that although certain staple crops such as bananas and maize can be classified at this scale with high accuracy, crops involved in intercropping (legumes) can be difficult to identify consistently. We discuss the potential use cases for the developed model and recommend directions for future research in this area.

Rapid and Accurate Varieties Identification of Different Crop Seeds Under Sample-Limited Condition Based on Hyperspectral Imaging and Deep Transfer Learning

2020 ◽  
Author(s):  
Na Wu ◽  
Fei Liu ◽  
Yidan Bao ◽  
Mu Li ◽  
Wei Huang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Hyperspectral Imaging ◽  
Transfer Learning ◽  
Large Scale ◽  
Learning Algorithm ◽  
Accurate Method ◽  
Accurate Identification ◽  
Screening Process ◽  
Limited Condition ◽  
Deep Learning Algorithm

Abstract Background: Varieties identification of crop seeds is significant for breeders to screen out seeds with specific traits and for market regulators to detect seeds purity. Hyperspectral imaging technology provides a fast and non-destructive means for varieties identification. And deep learning algorithm is suitable for effective analysis of redundant spectral data. However, deep learning algorithms have serious big data dependency, while collecting high-quality large-scale samples was high-cost in many cases. This made it difficult to build an accurate identification model. This study aimed to explore a rapid and accurate method for varieties identification of different crop seeds under sample-limited condition based on hyperspectral imaging and deep transfer learning.Results: Three deep neural networks with typical structures were designed based on a samples-rich Pea dataset. Obtained the highest accuracy of 99.57 %, VGG-MODEL was transferred to classify four target datasets (Rice, Oat, Wheat, Cotton) with limited samples. The accuracies of deep transferred model achieved 95 %, 99 %, 80.8 %, and 83.86 % on the four datasets, respectively. Using training sets with different sizes, deep transferred model could always obtain higher performance than other traditional methods. Visualization of training process and classification results confirmed the portability of common features of seed spectra and provided an interpreted method for rapid and accurate varieties identification of crop seeds.Conclusions: This study combined hyperspectral imaging and deep transfer learning to identify varieties of different crop seeds, which was proved to be efficient under sample-limited condition. This facilitated crop variety screening process under the scenario of sample scarcity. It also provided a new idea for the detection of other qualities of crop seeds based on hyperspectral imaging under sample-limited condition.

scholarly journals Bearing Fault Diagnosis under Variable Working Conditions Based on Deep Residual Shrinkage Networks and Transfer Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-13
Author(s):  
Xinyu Yang ◽  
Fulin Chi ◽  
Siyu Shao ◽  
Qiang Zhang
Keyword(s):  
Deep Learning ◽  
Fault Diagnosis ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Operating Conditions ◽  
Mean Deviation ◽  
Variable Load ◽  
Vibration Data ◽  
Deep Learning Algorithm ◽  
Load Variable

Nowadays, deep learning has made great achievements in the field of rotating machinery fault diagnosis. But in the practical engineering scenarios, when facing a large number of unlabeled data and variable operating conditions, only using a deep learning algorithm may reduce the performance. In order to solve the above problem, this paper uses a method of combining transfer learning with deep learning. First, the deep shrinkage residual network is constructed by adding soft thresholds to extract the characteristics of bearing vibration data under noise redundancy. Then, the joint maximum mean deviation (JMMD) criterion and conditional domain adversarial (CDA) learning domain adapting network are used to align the source and target domains. At the same time, adding transferable semantic augmentation (TSA) regular items improves alignment performance between classes. Finally, the proposed model is verified by three experiments: variable load, variable speed, and variable noise, which overcomes the shortcomings of traditional deep learning and shallow transfer learning algorithms.

Sign in / Sign up

Export Citation Format

Share Document