Deep Transfer Learning for COVID-19 Prediction: Case Study for Limited Data Problems

Objective: Automatic prediction of COVID-19 using deep convolution neural networks based pre-trained transfer models and Chest X-ray images. Method: This research employs the advantages of computer vision and medical image analysis to develop an automated model that has the clinical potential for early detection of the disease. Using Deep Learning models, the research aims at evaluating the effectiveness and accuracy of different convolutional neural networks models in the automatic diagnosis of COVID-19 from X-ray images as compared to diagnosis performed by experts in the medical community. Result: Due to the fact that the dataset available for COVID-19 is still limited, the best model to use is the InceptionNetV3. Performance results show that the InceptionNetV3 model yielded the highest accuracy of 98.63% (with data augmentation) and 98.90% (without data augmentation) among the three models designed. However, as the dataset gets bigger, the Inception ResNetV2 and NASNetlarge will do a better job of classification. All the performed networks tend to over-fit when data augmentation is not used, this is due to the small amount of data used for training and validation. Conclusion: A deep transfer learning is proposed to detecting the COVID-19 automatically from chest X-ray by training it with X-ray images gotten from both COVID-19 patients and people with normal chest Xrays. The study is aimed at helping doctors in making decisions in their clinical practice due its high performance and effectiveness, the study also gives an insight to how transfer learning was used to automatically detect the COVID-19.

Download Full-text

Diagnostic Approach for Accurate Diagnosis of COVID-19 Employing Deep Learning and Transfer Learning Techniques through Chest X-ray Images Clinical Data in E-Healthcare

Sensors ◽

10.3390/s21248219 ◽

2021 ◽

Vol 21 (24) ◽

pp. 8219

Author(s):

Amin Ul Haq ◽

Jian Ping Li ◽

Sultan Ahmad ◽

Shakir Khan ◽

Mohammed Ali Alshara ◽

...

Keyword(s):

Transfer Learning ◽

Classification Accuracy ◽

High Performance ◽

Data Augmentation ◽

Early Stage ◽

Accurate Diagnosis ◽

Fine Tuning ◽

Data Set ◽

X Ray ◽

Chest X Ray

COVID-19 is a transferable disease that is also a leading cause of death for a large number of people worldwide. This disease, caused by SARS-CoV-2, spreads very rapidly and quickly affects the respiratory system of the human being. Therefore, it is necessary to diagnosis this disease at the early stage for proper treatment, recovery, and controlling the spread. The automatic diagnosis system is significantly necessary for COVID-19 detection. To diagnose COVID-19 from chest X-ray images, employing artificial intelligence techniques based methods are more effective and could correctly diagnosis it. The existing diagnosis methods of COVID-19 have the problem of lack of accuracy to diagnosis. To handle this problem we have proposed an efficient and accurate diagnosis model for COVID-19. In the proposed method, a two-dimensional Convolutional Neural Network (2DCNN) is designed for COVID-19 recognition employing chest X-ray images. Transfer learning (TL) pre-trained ResNet-50 model weight is transferred to the 2DCNN model to enhanced the training process of the 2DCNN model and fine-tuning with chest X-ray images data for final multi-classification to diagnose COVID-19. In addition, the data augmentation technique transformation (rotation) is used to increase the data set size for effective training of the R2DCNNMC model. The experimental results demonstrated that the proposed (R2DCNNMC) model obtained high accuracy and obtained 98.12% classification accuracy on CRD data set, and 99.45% classification accuracy on CXI data set as compared to baseline methods. This approach has a high performance and could be used for COVID-19 diagnosis in E-Healthcare systems.

Download Full-text

Evaluating Deep Neural Network Architectures with Transfer Learning for Pneumonitis Diagnosis

Computational and Mathematical Methods in Medicine ◽

10.1155/2021/8036304 ◽

2021 ◽

Vol 2021 ◽

pp. 1-12

Author(s):

Surya Krishnamurthy ◽

Kathiravan Srinivasan ◽

Saeed Mian Qaisar ◽

P. M. Durai Raj Vincent ◽

Chuan-Yu Chang

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Large Scale ◽

Data Augmentation ◽

Medical Image Analysis ◽

Predictive Performance ◽

X Ray ◽

Recent Developments ◽

Life Threatening ◽

Chest X Ray

Pneumonitis is an infectious disease that causes the inflammation of the air sac. It can be life-threatening to the very young and elderly. Detection of pneumonitis from X-ray images is a significant challenge. Early detection and assistance with diagnosis can be crucial. Recent developments in the field of deep learning have significantly improved their performance in medical image analysis. The superior predictive performance of the deep learning methods makes them ideal for pneumonitis classification from chest X-ray images. However, training deep learning models can be cumbersome and resource-intensive. Reusing knowledge representations of public models trained on large-scale datasets through transfer learning can help alleviate these challenges. In this paper, we compare various image classification models based on transfer learning with well-known deep learning architectures. The Kaggle chest X-ray dataset was used to evaluate and compare our models. We apply basic data augmentation and fine-tune our feed-forward classification head on the models pretrained on the ImageNet dataset. We observed that the DenseNet201 model outperforms other models with an AUROC score of 0.966 and a recall score of 0.99. We also visualize the class activation maps from the DenseNet201 model to interpret the patterns recognized by the model for prediction.

Download Full-text

Classification of COVID-19 from Chest X-ray images using Deep Convolutional Neural Networks

10.1101/2020.05.01.20088211 ◽

2020 ◽

Cited By ~ 4

Author(s):

Sohaib Asif ◽

Yi Wenhui ◽

Hou Jin ◽

Yi Tao ◽

Si Jinhai

Keyword(s):

Neural Networks ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Well Being ◽

Deep Convolutional Neural Networks ◽

X Ray ◽

Digital Chest ◽

Normal Chest ◽

Chest X Ray

AbstractThe COVID-19 pandemic continues to have a devastating effect on the health and well-being of the global population. A vital step in the combat towards COVID-19 is a successful screening of contaminated patients, with one of the key screening approaches being radiological imaging using chest radiography. This study aimed to automatically detect COVID‐ 19 pneumonia patients using digital chest x‐ ray images while maximizing the accuracy in detection using deep convolutional neural networks (DCNN). The dataset consists of 864 COVID‐ 19, 1345 viral pneumonia and 1341 normal chest x‐ ray images. In this study, DCNN based model Inception V3 with transfer learning have been proposed for the detection of coronavirus pneumonia infected patients using chest X-ray radiographs and gives a classification accuracy of more than 98% (training accuracy of 97% and validation accuracy of 93%). The results demonstrate that transfer learning proved to be effective, showed robust performance and easily deployable approach for COVID-19 detection.

Download Full-text

Detection of coronavirus disease from X-ray images using deep learning and transfer learning algorithms

Journal of X-Ray Science and Technology ◽

10.3233/xst-200720 ◽

2020 ◽

Vol 28 (5) ◽

pp. 841-850

Author(s):

Saleh Albahli ◽

Waleed Albattah

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Medical Image Analysis ◽

Image Data ◽

Network Models ◽

Learning Models ◽

X Ray ◽

Study Results ◽

Chest X Ray

OBJECTIVE: This study aims to employ the advantages of computer vision and medical image analysis to develop an automated model that has the clinical potential for early detection of novel coronavirus (COVID-19) infected disease. METHOD: This study applied transfer learning method to develop deep learning models for detecting COVID-19 disease. Three existing state-of-the-art deep learning models namely, Inception ResNetV2, InceptionNetV3 and NASNetLarge, were selected and fine-tuned to automatically detect and diagnose COVID-19 disease using chest X-ray images. A dataset involving 850 images with the confirmed COVID-19 disease, 500 images of community-acquired (non-COVID-19) pneumonia cases and 915 normal chest X-ray images was used in this study. RESULTS: Among the three models, InceptionNetV3 yielded the best performance with accuracy levels of 98.63% and 99.02% with and without using data augmentation in model training, respectively. All the performed networks tend to overfitting (with high training accuracy) when data augmentation is not used, this is due to the limited amount of image data used for training and validation. CONCLUSION: This study demonstrated that a deep transfer learning is feasible to detect COVID-19 disease automatically from chest X-ray by training the learning model with chest X-ray images mixed with COVID-19 patients, other pneumonia affected patients and people with healthy lungs, which may help doctors more effectively make their clinical decisions. The study also gives an insight to how transfer learning was used to automatically detect the COVID-19 disease. In future studies, as the amount of available dataset increases, different convolution neutral network models could be designed to achieve the goal more efficiently.

Download Full-text

Concatenation of Pre-Trained Convolutional Neural Networks for Enhanced COVID-19 Screening Using Transfer Learning Technique

Electronics ◽

10.3390/electronics11010103 ◽

2021 ◽

Vol 11 (1) ◽

pp. 103

Author(s):

Oussama El Gannour ◽

Soufiane Hamida ◽

Bouchaib Cherradi ◽

Mohammed Al-Sarem ◽

Abdelhadi Raihani ◽

...

Keyword(s):

Neural Networks ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Diagnostic Methods ◽

Medical Community ◽

Severe Respiratory Distress ◽

X Ray ◽

General Evaluation ◽

Proposed Model ◽

Chest X Ray

Coronavirus (COVID-19) is the most prevalent coronavirus infection with respiratory symptoms such as fever, cough, dyspnea, pneumonia, and weariness being typical in the early stages. On the other hand, COVID-19 has a direct impact on the circulatory and respiratory systems as it causes a failure to some human organs or severe respiratory distress in extreme circumstances. Early diagnosis of COVID-19 is extremely important for the medical community to limit its spread. For a large number of suspected cases, manual diagnostic methods based on the analysis of chest images are insufficient. Faced with this situation, artificial intelligence (AI) techniques have shown great potential in automatic diagnostic tasks. This paper aims at proposing a fast and precise medical diagnosis support system (MDSS) that can distinguish COVID-19 precisely in chest-X-ray images. This MDSS uses a concatenation technique that aims to combine pre-trained convolutional neural networks (CNN) depend on the transfer learning (TL) technique to build a highly accurate model. The models enable storage and application of knowledge learned from a pre-trained CNN to a new task, viz., COVID-19 case detection. For this purpose, we employed the concatenation method to aggregate the performances of numerous pre-trained models to confirm the reliability of the proposed method for identifying the patients with COVID-19 disease from X-ray images. The proposed system was trialed on a dataset that included four classes: normal, viral-pneumonia, tuberculosis, and COVID-19 cases. Various general evaluation methods were used to evaluate the effectiveness of the proposed model. The first proposed model achieved an accuracy rate of 99.80% while the second model reached an accuracy of 99.71%.

Download Full-text

COVID-19 and Pneumonia Diagnosis in X-Ray Images Using Convolutional Neural Networks

Mathematical Problems in Engineering ◽

10.1155/2021/3281135 ◽

2021 ◽

Vol 2021 ◽

pp. 1-14

Author(s):

Rahib H. Abiyev ◽

Abdullahi Ismail

Keyword(s):

Neural Networks ◽

Early Diagnosis ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Binary Classification ◽

Cost Effective ◽

X Ray ◽

Human Lungs ◽

Normal Chest ◽

Chest X Ray

This paper proposes a Convolutional Neural Networks (CNN) based model for the diagnosis of COVID-19 and non-COVID-19 viral pneumonia diseases. These diseases affect and damage the human lungs. Early diagnosis of patients infected by the virus can help save the patient’s life and prevent the further spread of the virus. The CNN model is used to help in the early diagnosis of the virus using chest X-ray images, as it is one of the fastest and most cost-effective ways of diagnosing the disease. We proposed two convolutional neural networks (CNN) models, which were trained using two different datasets. The first model was trained for binary classification with one of the datasets that only included pneumonia cases and normal chest X-ray images. The second model made use of the knowledge learned by the first model using transfer learning and trained for 3 class classifications on COVID-19, pneumonia, and normal cases based on the second dataset that included chest X-ray (CXR) images. The effect of transfer learning on model constriction has been demonstrated. The model gave promising results in terms of accuracy, recall, precision, and F1_score with values of 98.3%, 97.9%, 98.3%, and 98.0%, respectively, on the test data. The proposed model can diagnose the presence of COVID-19 in CXR images; hence, it will help radiologists make diagnoses easily and more accurately.

Download Full-text

Reliable Learning with PDE-Based CNNs and DenseNets for Detecting COVID-19, Pneumonia, and Tuberculosis from Chest X-Ray Images

Mathematics ◽

10.3390/math9040434 ◽

2021 ◽

Vol 9 (4) ◽

pp. 434

Author(s):

Anca Nicoleta Marginean ◽

Delia Doris Muntean ◽

George Adrian Muntean ◽

Adelina Priscu ◽

Adrian Groza ◽

...

Keyword(s):

Transfer Learning ◽

Negative Impact ◽

X Ray ◽

Domain Specific ◽

Direct Training ◽

Public Data ◽

Normal Chest ◽

Chest X Ray ◽

The Stability ◽

Definition Of

It has recently been shown that the interpretation by partial differential equations (PDEs) of a class of convolutional neural networks (CNNs) supports definition of architectures such as parabolic and hyperbolic networks. These networks have provable properties regarding the stability against the perturbations of the input features. Aiming for robustness, we tackle the problem of detecting changes in chest X-ray images that may be suggestive of COVID-19 with parabolic and hyperbolic CNNs and with domain-specific transfer learning. To this end, we compile public data on patients diagnosed with COVID-19, pneumonia, and tuberculosis, along with normal chest X-ray images. The negative impact of the small number of COVID-19 images is reduced by applying transfer learning in several ways. For the parabolic and hyperbolic networks, we pretrain the networks on normal and pneumonia images and further use the obtained weights as the initializers for the networks to discriminate between COVID-19, pneumonia, tuberculosis, and normal aspects. For DenseNets, we apply transfer learning twice. First, the ImageNet pretrained weights are used to train on the CheXpert dataset, which includes 14 common radiological observations (e.g., lung opacity, cardiomegaly, fracture, support devices). Then, the weights are used to initialize the network which detects COVID-19 and the three other classes. The resulting networks are compared in terms of how well they adapt to the small number of COVID-19 images. According to our quantitative and qualitative analysis, the resulting networks are more reliable compared to those obtained by direct training on the targeted dataset.

Download Full-text

Detection of COVID-19 Using Transfer Learning and Grad-CAM Visualization on Indigenously Collected X-ray Dataset

Sensors ◽

10.3390/s21175813 ◽

2021 ◽

Vol 21 (17) ◽

pp. 5813

Author(s):

Muhammad Umair ◽

Muhammad Shahbaz Khan ◽

Fawad Ahmed ◽

Fatmah Baothman ◽

Fehaid Alqahtani ◽

...

Keyword(s):

Transfer Learning ◽

Input Image ◽

Fine Tuning ◽

Feature Maps ◽

Virus Family ◽

X Ray ◽

Normal Chest ◽

Chest X Ray ◽

Confusion Matrices

The COVID-19 outbreak began in December 2019 and has dreadfully affected our lives since then. More than three million lives have been engulfed by this newest member of the corona virus family. With the emergence of continuously mutating variants of this virus, it is still indispensable to successfully diagnose the virus at early stages. Although the primary technique for the diagnosis is the PCR test, the non-contact methods utilizing the chest radiographs and CT scans are always preferred. Artificial intelligence, in this regard, plays an essential role in the early and accurate detection of COVID-19 using pulmonary images. In this research, a transfer learning technique with fine tuning was utilized for the detection and classification of COVID-19. Four pre-trained models i.e., VGG16, DenseNet-121, ResNet-50, and MobileNet were used. The aforementioned deep neural networks were trained using the dataset (available on Kaggle) of 7232 (COVID-19 and normal) chest X-ray images. An indigenous dataset of 450 chest X-ray images of Pakistani patients was collected and used for testing and prediction purposes. Various important parameters, e.g., recall, specificity, F1-score, precision, loss graphs, and confusion matrices were calculated to validate the accuracy of the models. The achieved accuracies of VGG16, ResNet-50, DenseNet-121, and MobileNet are 83.27%, 92.48%, 96.49%, and 96.48%, respectively. In order to display feature maps that depict the decomposition process of an input image into various filters, a visualization of the intermediate activations is performed. Finally, the Grad-CAM technique was applied to create class-specific heatmap images in order to highlight the features extracted in the X-ray images. Various optimizers were used for error minimization purposes. DenseNet-121 outperformed the other three models in terms of both accuracy and prediction.

Download Full-text

USE OF CONVOLUTIONAL NEURAL NETWORKS FOR X-RAY IMAGE ORIENTATION DETERMINATION

10.46793/iccbi21.263bs ◽

2021 ◽

Author(s):

Sandi Baressi Šegota ◽

◽

Simon Lysdahlgaard ◽

Søren Hess ◽

Ronald Antulov

Keyword(s):

Neural Networks ◽

Convolutional Neural Networks ◽

High Performance ◽

Data Augmentation ◽

Classification Model ◽

Orientation Sensitivity ◽

X Ray ◽

Artificial Neural Network Ann ◽

Image Orientation ◽

Single Orientation

The fact that Artificial Intelligence (AI) based algorithms exhibit a high performance on image classification tasks has been shown many times. Still, certain issues exist with the application of machine learning (ML) artificial neural network (ANN) algorithms. The best known is the need for a large amount of statistically varied data, which can be addressed with expanded collection or data augmentation. Other issues are also present. Convolutional neural networks (CNNs) show extremely high performance on image-shaped data. Despite their performance, CNNs exhibit a large issue which is the sensitivity to image orientation. Previous research shows that varying the orientation of images may greatly lower the performance of the trained CNN. This is especially problematic in certain applications, such as X-ray radiography, an example of which is presented here. Previous research shows that the performance of CNNs is higher when used on images in a single orientation (left or right), as opposed to the combination of both. This means that the data needs to be differentiated before it enters the classification model. In this paper, the CNN-based model for differentiation between left and right-oriented images is presented. Multiple CNNs are trained and tested, with the highest performing being the VGG16 architecture which achieved an Accuracy of 0.99 (+/- 0.01), and an AUC of 0.98 (+/- 0.01). These results show that CNNs can be used to address the issue of orientation sensitivity by splitting the data in advance of being used in classification models.

Download Full-text

Pneumonia Detection using Artificial Neural Networks and Transfer Learning Model

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.b1026.0782s419 ◽

2019 ◽

Vol 8 (2S4) ◽

pp. 149-151

Keyword(s):

Neural Networks ◽

Artificial Neural Networks ◽

Transfer Learning ◽

Learning Model ◽

High Accuracy ◽

Lung Region ◽

X Ray ◽

Otsu Thresholding ◽

Chest X Ray ◽

Healthy Lung

Developing a system that helps in detecting pneumonia in chest x-ray images of lungs at a high accuracy. Firstly, a raw image is being preprocessed with the help of Otsu Thresholding and an equalizer. This helps in detecting pneumonia clouds and identifying the ratio of healthy lung region to the total region minimum. The above task is determined by importing the original chest x-ray images in the dataset and then calculating the ratio. The preprocessed data is then fed into Inception V3 model that accurately predicts the percentage of how much pneumonia is spread. This helps in identifying pneumonia present in that area and helps determining the prescribed drugs to help them clear off the symptoms.

Download Full-text