scholarly journals EHG-Based Preterm Delivery Prediction Algorithm Driven by Transfer Learning

2021 ◽  
Author(s):  
Yanjun Deng ◽  
Yefei Zhang ◽  
Shenguan Wu ◽  
Lihuan Shao ◽  
Xiaohong Zhang
Keyword(s):  
Preterm Delivery ◽  
Transfer Learning ◽  
Uterine Contraction ◽  
Recurrence Plot ◽  
Prediction Algorithm ◽  
Learning Techniques ◽  
Deep Convolution Neural Network ◽  
Global Concern ◽  
Important Measurement ◽  
Fine Tune

Preterm delivery is currently a global concern of maternal and child health, which directly affects infants’ early morbidity, and even death in several severe cases. Therefore, it is particularly important to effectively monitor the uterine contraction of perinatal pregnant women, and to make effective prediction and timely treatment for the possibility of preterm delivery. Electromyography (EHG) signal, an important measurement to predict preterm delivery in clinical practice, shows obvious consistency and correlation with the frequency and intensity of uterine contraction. This paper proposed a deep convolution neural network (DCNN) model based on transfer learning. Specifically, it is based on the VGGNet model, combined with recurrence plot (RP) analysis and transfer learning techniques such as “Fine-tune”, marked as VGGNet19-I3. Optimized with the clinical measured term-preterm EHG database, it showed good auxiliary prediction performances in 78 training and test samples, and achieved a high accuracy of 97.00% in 100 validation samples.

scholarly journals Is One Teacher Model Enough to Transfer Knowledge to a Student Model?

Algorithms ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 334
Author(s):  
Nicola Landro ◽  
Ignazio Gallo ◽  
Riccardo La Grassa
Keyword(s):  
Neural Network ◽  
Transfer Learning ◽  
Learning Problem ◽  
Learning Techniques ◽  
Starting Point ◽  
Learning Technique ◽  
Interesting Approach ◽  
Classification Tasks ◽  
Learned Features ◽  
Fine Tune

Nowadays, the transfer learning technique can be successfully applied in the deep learning field through techniques that fine-tune the CNN’s starting point so it may learn over a huge dataset such as ImageNet and continue to learn on a fixed dataset to achieve better performance. In this paper, we designed a transfer learning methodology that combines the learned features of different teachers to a student network in an end-to-end model, improving the performance of the student network in classification tasks over different datasets. In addition to this, we tried to answer the following questions which are in any case directly related to the transfer learning problem addressed here. Is it possible to improve the performance of a small neural network by using the knowledge gained from a more powerful neural network? Can a deep neural network outperform the teacher using transfer learning? Experimental results suggest that neural networks can transfer their learning to student networks using our proposed architecture, designed to bring to light a new interesting approach for transfer learning techniques. Finally, we provide details of the code and the experimental settings.

scholarly journals Deep Learning Techniques for Grape Plant Species Identification in Natural Images

Sensors ◽  
2019 ◽  
Vol 19 (22) ◽  
pp. 4850 ◽  
Author(s):  
Carlos S. Pereira ◽  
Raul Morais ◽  
Manuel J. C. S. Reis
Keyword(s):  
Transfer Learning ◽  
Climatic Conditions ◽  
Fine Tuning ◽  
Variety Identification ◽  
Test Accuracy ◽  
Accuracy Score ◽  
Learning Techniques ◽  
Four Corners ◽  
Integrated Software ◽  
Grape Varieties

Frequently, the vineyards in the Douro Region present multiple grape varieties per parcel and even per row. An automatic algorithm for grape variety identification as an integrated software component was proposed that can be applied, for example, to a robotic harvesting system. However, some issues and constraints in its development were highlighted, namely, the images captured in natural environment, low volume of images, high similarity of the images among different grape varieties, leaf senescence, and significant changes on the grapevine leaf and bunch images in the harvest seasons, mainly due to adverse climatic conditions, diseases, and the presence of pesticides. In this paper, the performance of the transfer learning and fine-tuning techniques based on AlexNet architecture were evaluated when applied to the identification of grape varieties. Two natural vineyard image datasets were captured in different geographical locations and harvest seasons. To generate different datasets for training and classification, some image processing methods, including a proposed four-corners-in-one image warping algorithm, were used. The experimental results, obtained from the application of an AlexNet-based transfer learning scheme and trained on the image dataset pre-processed through the four-corners-in-one method, achieved a test accuracy score of 77.30%. Applying this classifier model, an accuracy of 89.75% on the popular Flavia leaf dataset was reached. The results obtained by the proposed approach are promising and encouraging in helping Douro wine growers in the automatic task of identifying grape varieties.

scholarly journals Precise Identification of Prostate Cancer from DWI Using Transfer Learning

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3664
Author(s):  
Islam R. Abdelmaksoud ◽  
Ahmed Shalaby ◽  
Ali Mahmoud ◽  
Mohammed Elmogy ◽  
Ahmed Aboelfetouh ◽  
...  
Keyword(s):  
Prostate Cancer ◽  
Transfer Learning ◽  
Sensitivity And Specificity ◽  
Benign Tumors ◽  
B Values ◽  
Cad System ◽  
Average Accuracy ◽  
Apparent Diffusion ◽  
Invasive Techniques ◽  
Fine Tune

Background and Objective: The use of computer-aided detection (CAD) systems can help radiologists make objective decisions and reduce the dependence on invasive techniques. In this study, a CAD system that detects and identifies prostate cancer from diffusion-weighted imaging (DWI) is developed. Methods: The proposed system first uses non-negative matrix factorization (NMF) to integrate three different types of features for the accurate segmentation of prostate regions. Then, discriminatory features in the form of apparent diffusion coefficient (ADC) volumes are estimated from the segmented regions. The ADC maps that constitute these volumes are labeled by a radiologist to identify the ADC maps with malignant or benign tumors. Finally, transfer learning is used to fine-tune two different previously-trained convolutional neural network (CNN) models (AlexNet and VGGNet) for detecting and identifying prostate cancer. Results: Multiple experiments were conducted to evaluate the accuracy of different CNN models using DWI datasets acquired at nine distinct b-values that included both high and low b-values. The average accuracy of AlexNet at the nine b-values was 89.2±1.5% with average sensitivity and specificity of 87.5±2.3% and 90.9±1.9%. These results improved with the use of the deeper CNN model (VGGNet). The average accuracy of VGGNet was 91.2±1.3% with sensitivity and specificity of 91.7±1.7% and 90.1±2.8%. Conclusions: The results of the conducted experiments emphasize the feasibility and accuracy of the developed system and the improvement of this accuracy using the deeper CNN.

scholarly journals Unmanned Aerial Vehicle Operating Mode Classification Using Deep Residual Learning Feature Extraction

Aerospace ◽  
2021 ◽  
Vol 8 (3) ◽  
pp. 79
Author(s):  
Carolyn J. Swinney ◽  
John C. Woods
Keyword(s):  
Feature Extraction ◽  
Transfer Learning ◽  
Operating Mode ◽  
Classification Problem ◽  
Large Signal ◽  
Signal Representations ◽  
Novel Approach ◽  
Power Spectral ◽  
Aerial Vehicle ◽  
Deep Convolution Neural Network

Unmanned Aerial Vehicles (UAVs) undoubtedly pose many security challenges. We need only look to the December 2018 Gatwick Airport incident for an example of the disruption UAVs can cause. In total, 1000 flights were grounded for 36 h over the Christmas period which was estimated to cost over 50 million pounds. In this paper, we introduce a novel approach which considers UAV detection as an imagery classification problem. We consider signal representations Power Spectral Density (PSD); Spectrogram, Histogram and raw IQ constellation as graphical images presented to a deep Convolution Neural Network (CNN) ResNet50 for feature extraction. Pre-trained on ImageNet, transfer learning is utilised to mitigate the requirement for a large signal dataset. We evaluate performance through machine learning classifier Logistic Regression. Three popular UAVs are classified in different modes; switched on; hovering; flying; flying with video; and no UAV present, creating a total of 10 classes. Our results, validated with 5-fold cross validation and an independent dataset, show PSD representation to produce over 91% accuracy for 10 classifications. Our paper treats UAV detection as an imagery classification problem by presenting signal representations as images to a ResNet50, utilising the benefits of transfer learning and outperforming previous work in the field.

scholarly journals Deep Transfer Learning for Improved Detection of Keratoconus using Corneal Topographic Maps

2021 ◽  
Author(s):  
Ali H. Al-Timemy ◽  
Nebras H. Ghaeb ◽  
Zahraa M. Mosa ◽  
Javier Escudero
Keyword(s):  
Transfer Learning ◽  
Learning Strategy ◽  
Clinical Decision ◽  
Topographic Maps ◽  
Computer Assisted ◽  
Clinical Knowledge ◽  
Average Accuracy ◽  
Assisted Diagnosis ◽  
Improved Accuracy ◽  
Fine Tune

Abstract Clinical keratoconus (KCN) detection is a challenging and time-consuming task. In the diagnosis process, ophthalmologists must revise demographic and clinical ophthalmic examinations. The latter include slit-lamb, corneal topographic maps, and Pentacam indices (PI). We propose an Ensemble of Deep Transfer Learning (EDTL) based on corneal topographic maps. We consider four pretrained networks, SqueezeNet (SqN), AlexNet (AN), ShuffleNet (SfN), and MobileNet-v2 (MN), and fine-tune them on a dataset of KCN and normal cases, each including four topographic maps. We also consider a PI classifier. Then, our EDTL method combines the output probabilities of each of the five classifiers to obtain a decision based on the fusion of probabilities. Individually, the classifier based on PI achieved 93.1% accuracy, whereas the deep classifiers reached classification accuracies over 90% only in isolated cases. Overall, the average accuracy of the deep networks over the four corneal maps ranged from 86% (SfN) to 89.9% (AN). The classifier ensemble increased the accuracy of the deep classifiers based on corneal maps to values ranging (92.2% to 93.1%) for SqN and (93.1% to 94.8%) for AN. Including in the ensemble-specific combinations of corneal maps’ classifiers and PI increased the accuracy to 98.3%. Moreover, visualization of first learner filters in the networks and Grad-CAMs confirmed that the networks had learned relevant clinical features. This study shows the potential of creating ensembles of deep classifiers fine-tuned with a transfer learning strategy as it resulted in an improved accuracy while showing learnable filters and Grad-CAMs that agree with clinical knowledge. This is a step further towards the potential clinical deployment of an improved computer-assisted diagnosis system for KCN detection to help ophthalmologists to confirm the clinical decision and to perform fast and accurate KCN treatment.

“A comparative study of shallow learning and deep transfer learning techniques for accurate fingerprints vitality detection”

2021 ◽  
Author(s):  
Donato Impedovo ◽  
Vincenzo Dentamaro ◽  
Giacomo Abbattista ◽  
Vincenzo Gattulli ◽  
Giuseppe Pirlo
Keyword(s):  
Comparative Study ◽  
Transfer Learning ◽  
Learning Techniques

StackBC: Deep learning and transfer learning techniques based stacking approach for accurate Invasive Ductal Carcinoma classification using histology images

2022 ◽  
pp. 1-12
Author(s):  
Amin Ul Haq ◽  
Jian Ping Li ◽  
Samad Wali ◽  
Sultan Ahmad ◽  
Zafar Ali ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Deep Learning ◽  
Transfer Learning ◽  
Invasive Ductal Carcinoma ◽  
Ductal Carcinoma ◽  
Early Recognition ◽  
Predictive Performance ◽  
Operating Characteristics ◽  
Data Set ◽  
Learning Techniques

Artificial intelligence (AI) based computer-aided diagnostic (CAD) systems can effectively diagnose critical disease. AI-based detection of breast cancer (BC) through images data is more efficient and accurate than professional radiologists. However, the existing AI-based BC diagnosis methods have complexity in low prediction accuracy and high computation time. Due to these reasons, medical professionals are not employing the current proposed techniques in E-Healthcare to effectively diagnose the BC. To diagnose the breast cancer effectively need to incorporate advanced AI techniques based methods in diagnosis process. In this work, we proposed a deep learning based diagnosis method (StackBC) to detect breast cancer in the early stage for effective treatment and recovery. In particular, we have incorporated deep learning models including Convolutional neural network (CNN), Long short term memory (LSTM), and Gated recurrent unit (GRU) for the classification of Invasive Ductal Carcinoma (IDC). Additionally, data augmentation and transfer learning techniques have been incorporated for data set balancing and for effective training the model. To further improve the predictive performance of model we used stacking technique. Among the three base classifiers (CNN, LSTM, GRU) the predictive performance of GRU are better as compared to individual model. The GRU is selected as a meta classifier to distinguish between Non-IDC and IDC breast images. The method Hold-Out has been incorporated and the data set is split into 90% and 10% for training and testing of the model, respectively. Model evaluation metrics have been computed for model performance evaluation. To analyze the efficacy of the model, we have used breast histology images data set. Our experimental results demonstrated that the proposed StackBC method achieved improved performance by gaining 99.02% accuracy and 100% area under the receiver operating characteristics curve (AUC-ROC) compared to state-of-the-art methods. Due to the high performance of the proposed method, we recommend it for early recognition of breast cancer in E-Healthcare.

scholarly journals Applying a Deep Q Network for OpenAIs Car Racing Game

2020 ◽  
Author(s):  
Ali Fakhry
Keyword(s):  
Machine Learning ◽  
Reinforcement Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Learning Techniques ◽  
Car Racing ◽  
Custom Made ◽  
Learning Technique ◽  
Reward Threshold

The applications of Deep Q-Networks are seen throughout the field of reinforcement learning, a large subsect of machine learning. Using a classic environment from OpenAI, CarRacing-v0, a 2D car racing environment, alongside a custom based modification of the environment, a DQN, Deep Q-Network, was created to solve both the classic and custom environments. The environments are tested using custom made CNN architectures and applying transfer learning from Resnet18. While DQNs were state of the art years ago, using it for CarRacing-v0 appears somewhat unappealing and not as effective as other reinforcement learning techniques. Overall, while the model did train and the agent learned various parts of the environment, attempting to reach the reward threshold for the environment with this reinforcement learning technique seems problematic and difficult as other techniques would be more useful.

scholarly journals A transfer learning framework based on motor imagery rehabilitation for stroke

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Fangzhou Xu ◽  
Yunjing Miao ◽  
Yanan Sun ◽  
Dongju Guo ◽  
Jiali Xu ◽  
...  
Keyword(s):  
Transfer Learning ◽  
Motor Imagery ◽  
Stroke Rehabilitation ◽  
Transfer Functions ◽  
Model Parameters ◽  
Transfer Model ◽  
Learning Networks ◽  
Training Time ◽  
Fine Tune ◽  
Bci System

AbstractDeep learning networks have been successfully applied to transfer functions so that the models can be adapted from the source domain to different target domains. This study uses multiple convolutional neural networks to decode the electroencephalogram (EEG) of stroke patients to design effective motor imagery (MI) brain-computer interface (BCI) system. This study has introduced ‘fine-tune’ to transfer model parameters and reduced training time. The performance of the proposed framework is evaluated by the abilities of the models for two-class MI recognition. The results show that the best framework is the combination of the EEGNet and ‘fine-tune’ transferred model. The average classification accuracy of the proposed model for 11 subjects is 66.36%, and the algorithm complexity is much lower than other models.These good performance indicate that the EEGNet model has great potential for MI stroke rehabilitation based on BCI system. It also successfully demonstrated the efficiency of transfer learning for improving the performance of EEG-based stroke rehabilitation for the BCI system.

Sign in / Sign up

Export Citation Format

Share Document