scholarly journals Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study

2020 ◽  
Vol 10 (13) ◽  
pp. 4523 ◽  
Author(s):  
Laith Alzubaidi ◽  
Mohammed A. Fadhel ◽  
Omran Al-Shamma ◽  
Jinglan Zhang ◽  
J. Santamaría ◽  
...  
Keyword(s):  
Medical Imaging ◽  
Transfer Learning ◽  
Foot Ulcer ◽  
Diabetic Foot Ulcer ◽  
Training Data ◽  
Classification Task ◽  
Natural Image ◽  
Target Domain ◽  
Proposed Model

One of the main challenges of employing deep learning models in the field of medicine is a lack of training data due to difficulty in collecting and labeling data, which needs to be performed by experts. To overcome this drawback, transfer learning (TL) has been utilized to solve several medical imaging tasks using pre-trained state-of-the-art models from the ImageNet dataset. However, there are primary divergences in data features, sizes, and task characteristics between the natural image classification and the targeted medical imaging tasks. Therefore, TL can slightly improve performance if the source domain is completely different from the target domain. In this paper, we explore the benefit of TL from the same and different domains of the target tasks. To do so, we designed a deep convolutional neural network (DCNN) model that integrates three ideas including traditional and parallel convolutional layers and residual connections along with global average pooling. We trained the proposed model against several scenarios. We utilized the same and different domain TL with the diabetic foot ulcer (DFU) classification task and with the animal classification task. We have empirically shown that the source of TL from the same domain can significantly improve the performance considering a reduced number of images in the same domain of the target dataset. The proposed model with the DFU dataset achieved F1-score value of 86.6% when trained from scratch, 89.4% with TL from a different domain of the targeted dataset, and 97.6% with TL from the same domain of the targeted dataset.

scholarly journals A novel augmented deep transfer learning for classification of COVID-19 and other thoracic diseases from X-rays

2021 ◽  
Author(s):  
Fouzia Altaf ◽  
Syed M. S. Islam ◽  
Naeem Khalid Janjua
Keyword(s):  
Deep Learning ◽  
Medical Imaging ◽  
Transfer Learning ◽  
Medical Images ◽  
Training Data ◽  
Target Domain ◽  
Data Set ◽  
Learning Technique ◽  
Multi Class Classification ◽  
Effective Transfer

AbstractDeep learning has provided numerous breakthroughs in natural imaging tasks. However, its successful application to medical images is severely handicapped with the limited amount of annotated training data. Transfer learning is commonly adopted for the medical imaging tasks. However, a large covariant shift between the source domain of natural images and target domain of medical images results in poor transfer learning. Moreover, scarcity of annotated data for the medical imaging tasks causes further problems for effective transfer learning. To address these problems, we develop an augmented ensemble transfer learning technique that leads to significant performance gain over the conventional transfer learning. Our technique uses an ensemble of deep learning models, where the architecture of each network is modified with extra layers to account for dimensionality change between the images of source and target data domains. Moreover, the model is hierarchically tuned to the target domain with augmented training data. Along with the network ensemble, we also utilize an ensemble of dictionaries that are based on features extracted from the augmented models. The dictionary ensemble provides an additional performance boost to our method. We first establish the effectiveness of our technique with the challenging ChestXray-14 radiography data set. Our experimental results show more than 50% reduction in the error rate with our method as compared to the baseline transfer learning technique. We then apply our technique to a recent COVID-19 data set for binary and multi-class classification tasks. Our technique achieves 99.49% accuracy for the binary classification, and 99.24% for multi-class classification.

scholarly journals Augmenting Crop Detection for Precision Agriculture with Deep Visual Transfer Learning—A Case Study of Bale Detection

2020 ◽  
Vol 13 (1) ◽  
pp. 23
Author(s):  
Wei Zhao ◽  
William Yamada ◽  
Tianxin Li ◽  
Matthew Digman ◽  
Troy Runge
Keyword(s):  
Object Detection ◽  
Transfer Learning ◽  
Precision Agriculture ◽  
Crop Production ◽  
Domain Adaptation ◽  
Training Data ◽  
Detection Accuracy ◽  
Detection Model ◽  
Agriculture Products

In recent years, precision agriculture has been researched to increase crop production with less inputs, as a promising means to meet the growing demand of agriculture products. Computer vision-based crop detection with unmanned aerial vehicle (UAV)-acquired images is a critical tool for precision agriculture. However, object detection using deep learning algorithms rely on a significant amount of manually prelabeled training datasets as ground truths. Field object detection, such as bales, is especially difficult because of (1) long-period image acquisitions under different illumination conditions and seasons; (2) limited existing prelabeled data; and (3) few pretrained models and research as references. This work increases the bale detection accuracy based on limited data collection and labeling, by building an innovative algorithms pipeline. First, an object detection model is trained using 243 images captured with good illimitation conditions in fall from the crop lands. In addition, domain adaptation (DA), a kind of transfer learning, is applied for synthesizing the training data under diverse environmental conditions with automatic labels. Finally, the object detection model is optimized with the synthesized datasets. The case study shows the proposed method improves the bale detecting performance, including the recall, mean average precision (mAP), and F measure (F1 score), from averages of 0.59, 0.7, and 0.7 (the object detection) to averages of 0.93, 0.94, and 0.89 (the object detection + DA), respectively. This approach could be easily scaled to many other crop field objects and will significantly contribute to precision agriculture.

scholarly journals Application of a modified Inception-v3 model in the dynasty-based classification of ancient murals

2021 ◽  
Vol 2021 (1) ◽  
Author(s):  
Jianfang Cao ◽  
Minmin Yan ◽  
Yiming Jia ◽  
Xiaodong Tian ◽  
Zibang Zhang
Keyword(s):  
Transfer Learning ◽  
Adaptive Learning ◽  
Deep Level ◽  
Image Resolution ◽  
Learning Rate ◽  
Stochastic Gradient Descent ◽  
Natural Image ◽  
Historical Period ◽  
Proposed Model

AbstractIt is difficult to identify the historical period in which some ancient murals were created because of damage due to artificial and/or natural factors; similarities in content, style, and color among murals; low image resolution; and other reasons. This study proposed a transfer learning-fused Inception-v3 model for dynasty-based classification. First, the model adopted Inception-v3 with frozen fully connected and softmax layers for pretraining over ImageNet. Second, the model fused Inception-v3 with transfer learning for parameter readjustment over small datasets. Third, the corresponding bottleneck files of the mural images were generated, and the deep-level features of the images were extracted. Fourth, the cross-entropy loss function was employed to calculate the loss value at each step of the training, and an algorithm for the adaptive learning rate on the stochastic gradient descent was applied to unify the learning rate. Finally, the updated softmax classifier was utilized for the dynasty-based classification of the images. On the constructed small datasets, the accuracy rate, recall rate, and F1 value of the proposed model were 88.4%, 88.36%, and 88.32%, respectively, which exhibited noticeable increases compared with those of typical deep learning models and modified convolutional neural networks. Comparisons of the classification outcomes for the mural dataset with those for other painting datasets and natural image datasets showed that the proposed model achieved stable classification outcomes with a powerful generalization capacity. The training time of the proposed model was only 0.7 s, and overfitting seldom occurred.

scholarly journals Management of grade IV diabetic foot ulcer by vrana ropana chikitsa: A case study

2021 ◽  
Vol 0 (0) ◽  
pp. 0
Author(s):  
SaleenaUmmer Velladath ◽  
AnnMariya Jose ◽  
Shripathi Adiga ◽  
AM Ciraj ◽  
KavithaS Shettigar ◽  
...  
Keyword(s):  
Diabetic Foot ◽  
Foot Ulcer ◽  
Diabetic Foot Ulcer

Probing community nurses' professional basis: a situational case study in diabetic foot ulcer treatment

2017 ◽  
Vol 22 (Sup3) ◽  
pp. S46-S52 ◽  
Author(s):  
Clara Schaarup ◽  
Louise Pape-Haugaard ◽  
Merete Hartun Jensen ◽  
Anders Christian Laursen ◽  
Susan Bermark ◽  
...  
Keyword(s):  
Diabetic Foot ◽  
Foot Ulcer ◽  
Diabetic Foot Ulcer ◽  
Ulcer Treatment

scholarly journals Materials Representation and Transfer Learning for Multi-Property Prediction

2021 ◽  
Author(s):  
Shufeng Kong ◽  
Dan Guevarra ◽  
Carla P. Gomes ◽  
John Gregoire
Keyword(s):  
Machine Learning ◽  
Optical Absorption ◽  
Transfer Learning ◽  
Materials Science ◽  
Training Data ◽  
Target Domain ◽  
Generative Adversarial Network ◽  
Property Prediction ◽  
Adversarial Network ◽  
Correlation Learning

The adoption of machine learning in materials science has rapidly transformed materials property prediction. Hurdles limiting full capitalization of recent advancements in machine learning include the limited development of methods to learn the underlying interactions of multiple elements, as well as the relationships among multiple properties, to facilitate property prediction in new composition spaces. To address these issues, we introduce the Hierarchical Correlation Learning for Multi-property Prediction (H-CLMP) framework that seamlessly integrates (i) prediction using only a material’s composition, (ii) learning and exploitation of correlations among target properties in multitarget regression, and (iii) leveraging training data from tangential domains via generative transfer learning. The model is demonstrated for prediction of spectral optical absorption of complex metal oxides spanning 69 3-cation metal oxide composition spaces. H-CLMP accurately predicts non-linear composition-property relationships in composition spaces for which no training data is available, which broadens the purview of machine learning to the discovery of materials with exceptional properties. This achievement results from the principled integration of latent embedding learning, property correlation learning, generative transfer learning, and attention models. The best performance is obtained using H-CLMP with Transfer learning (H-CLMP(T)) wherein a generative adversarial network is trained on computational density of states data and deployed in the target domain to augment prediction of optical absorption from composition. H-CLMP(T) aggregates multiple knowledge sources with a framework that is well-suited for multi-target regression across the physical sciences.

Management of Diabetic Foot Ulcer by Nishadi Yoga Avachoornana - A Case Study

2017 ◽  
Vol 2 (06) ◽  
Author(s):  
Chiranth Kumar R. ◽  
Syeda Ather Fathima
Keyword(s):  
Diabetes Mellitus ◽  
Diabetic Foot ◽  
Life Style ◽  
Genetic Factor ◽  
Wound Care ◽  
Foot Ulcer ◽  
Diabetic Foot Ulcer ◽  
Foot Complications ◽  
Scientific Approach

Diabetes is considered as ‘ice burg’ of diseases as only 1/3rd of its manifestations can be made out clinically, though the exact cause is not known following are the theories put forth to explain diabetes mellitus - Genetic factor, Life style disorder, Autoimmune cause. Slight injury to glucose laden tissue will cause infection which is precipitated by an ulcer and it tends to a state of non - healing. Main stay of treatment includes antibiotics, debridement, local wound care. Inspite of these treatments there is less reduction in the statistics of diabetic foot complications and amputations. In Sushrutha Samhitha we get the most scientific approach for the management of Vrana, where Sushrutha has mentioned 60 Upakrama’s (modalities of treatment) of which Avachoornana (dusting) is one modality, seen to be effective in the management of diabetic non healing ulcers (Madhu Mehaja Dusta Vrana).

Towards Generalization of Intelligent Fault Detection for Roller Element Bearings via Distinct Dataset Transfer Learning

2021 ◽  
Author(s):  
Justin Larocque-Villiers ◽  
Patrick Dumond
Keyword(s):  
Fault Detection ◽  
Open Source ◽  
Transfer Learning ◽  
Data Augmentation ◽  
Operating Conditions ◽  
Predictive Maintenance ◽  
Training Data ◽  
Fault Classification ◽  
Target Domain ◽  
Bearing Faults

Abstract Through the intelligent classification of bearing faults, predictive maintenance provides for the possibility of service schedule, inventory, maintenance, and safety optimization. However, real-world rotating machinery undergo a variety of operating conditions, fault conditions, and noise. Due to these factors, it is often required that a fault detection algorithm perform accurately even on data outside its trained domain. Although open-source datasets offer an incredible opportunity to advance the performance of predictive maintenance technology and methods, more research is required to develop algorithms capable of generalized intelligent fault detection across domains and discrepancies. In this study, current benchmarks on source–target domain discrepancy challenges are reviewed using the Case Western Reserve University (CWRU) and the Paderborn University (PbU) datasets. A convolutional neural network (CNN) architecture and data augmentation technique more suitable for generalization tasks is proposed and tested against existing benchmarks on the Pb U dataset by training on artificial faults and testing on real faults. The proposed method improves fault classification by 13.35%, with less than half the standard deviation of the compared benchmark. Transfer learning is then used to leverage the larger PbU dataset in order to make predictions on the CWRU dataset under a challenging source-target domain discrepancy in which there is minimal training data to adequately represent unseen bearing faults. The transfer learning-based CNN is found to be capable of generalizing across two open-source datasets, resulting in an improvement in accuracy from 53.1% to 68.3%.

scholarly journals Autoencoder-based transfer learning in brain–computer interface for rehabilitation robot

2019 ◽  
Vol 16 (2) ◽  
pp. 172988141984086 ◽  
Author(s):  
Chuanqi Tan ◽  
Fuchun Sun ◽  
Bin Fang ◽  
Tao Kong ◽  
Wenchang Zhang
Keyword(s):  
Transfer Learning ◽  
Negative Transfer ◽  
Brain Computer Interface ◽  
Training Data ◽  
Computer Interface ◽  
Rehabilitation Robot ◽  
Target Domain ◽  
Source Domain ◽  
Adversarial Network ◽  
The Brain

The brain–computer interface-based rehabilitation robot has quickly become a very important research area due to its natural interaction. One of the most important problems in brain–computer interface is that large-scale annotated electroencephalography data sets required by advanced classifiers are almost impossible to acquire because biological data acquisition is challenging and quality annotation is costly. Transfer learning relaxes the hypothesis that the training data must be independent and identically distributed with the test data. It can be considered a powerful tool for solving the problem of insufficient training data. There are two basic issues with transfer learning, under transfer and negative transfer. We proposed a novel brain–computer interface framework by using autoencoder-based transfer learning, which includes three main components: an autoencoder framework, a joint adversarial network, and a regularized manifold constraint. The autoencoder framework automatically encodes and reconstructs data from source and target domains and forces the neural network to learn to represent these domains reliably. The joint adversarial network aims to force the network to learn to encode more appropriately for the source domain and target domain simultaneously, thereby overcoming the problem of under transfer. The regularized manifold constraint aims to avoid the problem of negative transfer by avoiding geometric manifold structure in the target domain being destroyed by the source domain. Experiments show that the brain–computer interface framework proposed by us can achieve better results than state-of-the-art approaches in electroencephalography signal classification tasks. This is helpful in aiding our rehabilitation robot to understand the intention of patients and can help patients to carry out rehabilitation exercises effectively.

Sign in / Sign up

Export Citation Format

Share Document