Evaluating Deep Neural Network Architectures with Transfer Learning for Pneumonitis Diagnosis

Pneumonitis is an infectious disease that causes the inflammation of the air sac. It can be life-threatening to the very young and elderly. Detection of pneumonitis from X-ray images is a significant challenge. Early detection and assistance with diagnosis can be crucial. Recent developments in the field of deep learning have significantly improved their performance in medical image analysis. The superior predictive performance of the deep learning methods makes them ideal for pneumonitis classification from chest X-ray images. However, training deep learning models can be cumbersome and resource-intensive. Reusing knowledge representations of public models trained on large-scale datasets through transfer learning can help alleviate these challenges. In this paper, we compare various image classification models based on transfer learning with well-known deep learning architectures. The Kaggle chest X-ray dataset was used to evaluate and compare our models. We apply basic data augmentation and fine-tune our feed-forward classification head on the models pretrained on the ImageNet dataset. We observed that the DenseNet201 model outperforms other models with an AUROC score of 0.966 and a recall score of 0.99. We also visualize the class activation maps from the DenseNet201 model to interpret the patterns recognized by the model for prediction.

Download Full-text

Detection of coronavirus disease from X-ray images using deep learning and transfer learning algorithms

Journal of X-Ray Science and Technology ◽

10.3233/xst-200720 ◽

2020 ◽

Vol 28 (5) ◽

pp. 841-850

Author(s):

Saleh Albahli ◽

Waleed Albattah

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Medical Image Analysis ◽

Image Data ◽

Network Models ◽

Learning Models ◽

X Ray ◽

Study Results ◽

Chest X Ray

OBJECTIVE: This study aims to employ the advantages of computer vision and medical image analysis to develop an automated model that has the clinical potential for early detection of novel coronavirus (COVID-19) infected disease. METHOD: This study applied transfer learning method to develop deep learning models for detecting COVID-19 disease. Three existing state-of-the-art deep learning models namely, Inception ResNetV2, InceptionNetV3 and NASNetLarge, were selected and fine-tuned to automatically detect and diagnose COVID-19 disease using chest X-ray images. A dataset involving 850 images with the confirmed COVID-19 disease, 500 images of community-acquired (non-COVID-19) pneumonia cases and 915 normal chest X-ray images was used in this study. RESULTS: Among the three models, InceptionNetV3 yielded the best performance with accuracy levels of 98.63% and 99.02% with and without using data augmentation in model training, respectively. All the performed networks tend to overfitting (with high training accuracy) when data augmentation is not used, this is due to the limited amount of image data used for training and validation. CONCLUSION: This study demonstrated that a deep transfer learning is feasible to detect COVID-19 disease automatically from chest X-ray by training the learning model with chest X-ray images mixed with COVID-19 patients, other pneumonia affected patients and people with healthy lungs, which may help doctors more effectively make their clinical decisions. The study also gives an insight to how transfer learning was used to automatically detect the COVID-19 disease. In future studies, as the amount of available dataset increases, different convolution neutral network models could be designed to achieve the goal more efficiently.

Download Full-text

Deep Transfer Learning for COVID-19 Prediction: Case Study for Limited Data Problems

Current Medical Imaging Formerly Current Medical Imaging Reviews ◽

10.2174/1573405616666201123120417 ◽

2020 ◽

Vol 16 ◽

Author(s):

Saleh Albahli ◽

Waleed Albattah

Keyword(s):

Neural Networks ◽

Transfer Learning ◽

High Performance ◽

Data Augmentation ◽

Medical Image Analysis ◽

Medical Community ◽

X Ray ◽

Normal Chest ◽

Chest X Ray ◽

Performance Results

Objective: Automatic prediction of COVID-19 using deep convolution neural networks based pre-trained transfer models and Chest X-ray images. Method: This research employs the advantages of computer vision and medical image analysis to develop an automated model that has the clinical potential for early detection of the disease. Using Deep Learning models, the research aims at evaluating the effectiveness and accuracy of different convolutional neural networks models in the automatic diagnosis of COVID-19 from X-ray images as compared to diagnosis performed by experts in the medical community. Result: Due to the fact that the dataset available for COVID-19 is still limited, the best model to use is the InceptionNetV3. Performance results show that the InceptionNetV3 model yielded the highest accuracy of 98.63% (with data augmentation) and 98.90% (without data augmentation) among the three models designed. However, as the dataset gets bigger, the Inception ResNetV2 and NASNetlarge will do a better job of classification. All the performed networks tend to over-fit when data augmentation is not used, this is due to the small amount of data used for training and validation. Conclusion: A deep transfer learning is proposed to detecting the COVID-19 automatically from chest X-ray by training it with X-ray images gotten from both COVID-19 patients and people with normal chest Xrays. The study is aimed at helping doctors in making decisions in their clinical practice due its high performance and effectiveness, the study also gives an insight to how transfer learning was used to automatically detect the COVID-19.

Download Full-text

A Novel and Robust Approach to Detect Tuberculosis Using Transfer Learning

Journal of Healthcare Engineering ◽

10.1155/2021/1002799 ◽

2021 ◽

Vol 2021 ◽

pp. 1-10

Author(s):

Omar Faruk ◽

Eshan Ahmed ◽

Sakil Ahmed ◽

Anika Tabassum ◽

Tahia Tazin ◽

...

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Computer Assisted ◽

Promising Technique ◽

Suggested Approach ◽

X Ray ◽

Chest X Ray ◽

Deep Learning Model

Deep learning has emerged as a promising technique for a variety of elements of infectious disease monitoring and detection, including tuberculosis. We built a deep convolutional neural network (CNN) model to assess the generalizability of the deep learning model using a publicly accessible tuberculosis dataset. This study was able to reliably detect tuberculosis (TB) from chest X-ray images by utilizing image preprocessing, data augmentation, and deep learning classification techniques. Four distinct deep CNNs (Xception, InceptionV3, InceptionResNetV2, and MobileNetV2) were trained, validated, and evaluated for the classification of tuberculosis and nontuberculosis cases using transfer learning from their pretrained starting weights. With an F1-score of 99 percent, InceptionResNetV2 had the highest accuracy. This research is more accurate than earlier published work. Additionally, it outperforms all other models in terms of reliability. The suggested approach, with its state-of-the-art performance, may be helpful for computer-assisted rapid TB detection.

Download Full-text

COVID-19 Pneumonia Detection Using Optimized Deep Learning Techniques

Diagnostics ◽

10.3390/diagnostics11111972 ◽

2021 ◽

Vol 11 (11) ◽

pp. 1972

Author(s):

Abul Bashar ◽

Ghazanfar Latif ◽

Ghassen Ben Brahim ◽

Nazeeruddin Mohammad ◽

Jaafar Alghazo

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Learning Algorithm ◽

The Body ◽

X Rays ◽

X Ray ◽

Clinical Observations ◽

Dataset Size ◽

Chest X Ray

It became apparent that mankind has to learn to live with and adapt to COVID-19, especially because the developed vaccines thus far do not prevent the infection but rather just reduce the severity of the symptoms. The manual classification and diagnosis of COVID-19 pneumonia requires specialized personnel and is time consuming and very costly. On the other hand, automatic diagnosis would allow for real-time diagnosis without human intervention resulting in reduced costs. Therefore, the objective of this research is to propose a novel optimized Deep Learning (DL) approach for the automatic classification and diagnosis of COVID-19 pneumonia using X-ray images. For this purpose, a publicly available dataset of chest X-rays on Kaggle was used in this study. The dataset was developed over three stages in a quest to have a unified COVID-19 entities dataset available for researchers. The dataset consists of 21,165 anterior-to-posterior and posterior-to-anterior chest X-ray images classified as: Normal (48%), COVID-19 (17%), Lung Opacity (28%) and Viral Pneumonia (6%). Data Augmentation was also applied to increase the dataset size to enhance the reliability of results by preventing overfitting. An optimized DL approach is implemented in which chest X-ray images go through a three-stage process. Image Enhancement is performed in the first stage, followed by Data Augmentation stage and in the final stage the results are fed to the Transfer Learning algorithms (AlexNet, GoogleNet, VGG16, VGG19, and DenseNet) where the images are classified and diagnosed. Extensive experiments were performed under various scenarios, which led to achieving the highest classification accuracy of 95.63% through the application of VGG16 transfer learning algorithm on the augmented enhanced dataset with freeze weights. This accuracy was found to be better as compared to the results reported by other methods in the recent literature. Thus, the proposed approach proved superior in performance as compared with that of other similar approaches in the extant literature, and it made a valuable contribution to the body of knowledge. Although the results achieved so far are promising, further work is planned to correlate the results of the proposed approach with clinical observations to further enhance the efficiency and accuracy of COVID-19 diagnosis.

Download Full-text

Automated pneumonia detection on chest X-ray images: A deep learning approach with different optimizers and transfer learning architectures

Measurement ◽

10.1016/j.measurement.2021.109953 ◽

2021 ◽

pp. 109953

Author(s):

Adhiyaman Manickam ◽

Jianmin Jiang ◽

Yu Zhou ◽

Abhinav Sagar ◽

Rajkumar Soundrapandiyan ◽

...

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Learning Approach ◽

X Ray ◽

Chest X Ray ◽

Learning Architectures

Download Full-text

Evaluation of Scalability and Degree of Fine-Tuning of Deep Convolutional Neural Networks for COVID-19 Screening on Chest X-ray Images Using Explainable Deep-Learning Algorithm

Journal of Personalized Medicine ◽

10.3390/jpm10040213 ◽

2020 ◽

Vol 10 (4) ◽

pp. 213 ◽

Cited By ~ 1

Author(s):

Ki-Sun Lee ◽

Jae Young Kim ◽

Eun-tae Jeon ◽

Won Suk Choi ◽

Nan Hee Kim ◽

...

Keyword(s):

Deep Learning ◽

Learning Strategies ◽

Transfer Learning ◽

Learning Algorithm ◽

Fine Tuning ◽

Deep Convolutional Neural Networks ◽

X Ray ◽

Backbone Network ◽

Deep Learning Algorithm ◽

Chest X Ray

According to recent studies, patients with COVID-19 have different feature characteristics on chest X-ray (CXR) than those with other lung diseases. This study aimed at evaluating the layer depths and degree of fine-tuning on transfer learning with a deep convolutional neural network (CNN)-based COVID-19 screening in CXR to identify efficient transfer learning strategies. The CXR images used in this study were collected from publicly available repositories, and the collected images were classified into three classes: COVID-19, pneumonia, and normal. To evaluate the effect of layer depths of the same CNN architecture, CNNs called VGG-16 and VGG-19 were used as backbone networks. Then, each backbone network was trained with different degrees of fine-tuning and comparatively evaluated. The experimental results showed the highest AUC value to be 0.950 concerning COVID-19 classification in the experimental group of a fine-tuned with only 2/5 blocks of the VGG16 backbone network. In conclusion, in the classification of medical images with a limited number of data, a deeper layer depth may not guarantee better results. In addition, even if the same pre-trained CNN architecture is used, an appropriate degree of fine-tuning can help to build an efficient deep learning model.

Download Full-text

An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare

Journal of Healthcare Engineering ◽

10.1155/2019/4180949 ◽

2019 ◽

Vol 2019 ◽

pp. 1-7 ◽

Cited By ~ 44

Author(s):

Okeke Stephen ◽

Mangal Sain ◽

Uchenna Joseph Maduh ◽

Do-Un Jeong

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Network Model ◽

Neural Network Model ◽

Data Augmentation ◽

Classification Performance ◽

Learning Approaches ◽

X Ray ◽

Chest X Ray

This study proposes a convolutional neural network model trained from scratch to classify and detect the presence of pneumonia from a collection of chest X-ray image samples. Unlike other methods that rely solely on transfer learning approaches or traditional handcrafted techniques to achieve a remarkable classification performance, we constructed a convolutional neural network model from scratch to extract features from a given chest X-ray image and classify it to determine if a person is infected with pneumonia. This model could help mitigate the reliability and interpretability challenges often faced when dealing with medical imagery. Unlike other deep learning classification tasks with sufficient image repository, it is difficult to obtain a large amount of pneumonia dataset for this classification task; therefore, we deployed several data augmentation algorithms to improve the validation and classification accuracy of the CNN model and achieved remarkable validation accuracy.

Download Full-text

Deep-learning convolutional neural networks with transfer learning accurately classify COVID-19 lung infection on portable chest radiographs

PeerJ ◽

10.7717/peerj.10309 ◽

2020 ◽

Vol 8 ◽

pp. e10309

Author(s):

Shreeja Kikkisetti ◽

Jocelyn Zhu ◽

Beiyi Shen ◽

Haifang Li ◽

Tim Q. Duong

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Bacterial Pneumonia ◽

Lung Infection ◽

Accurate Diagnosis ◽

Viral Pneumonia ◽

X Ray ◽

Portable Chest ◽

Chest X Ray ◽

Lung Infections

Portable chest X-ray (pCXR) has become an indispensable tool in the management of Coronavirus Disease 2019 (COVID-19) lung infection. This study employed deep-learning convolutional neural networks to classify COVID-19 lung infections on pCXR from normal and related lung infections to potentially enable more timely and accurate diagnosis. This retrospect study employed deep-learning convolutional neural network (CNN) with transfer learning to classify based on pCXRs COVID-19 pneumonia (N = 455) on pCXR from normal (N = 532), bacterial pneumonia (N = 492), and non-COVID viral pneumonia (N = 552). The data was randomly split into 75% training and 25% testing, randomly. A five-fold cross-validation was used for the testing set separately. Performance was evaluated using receiver-operating curve analysis. Comparison was made with CNN operated on the whole pCXR and segmented lungs. CNN accurately classified COVID-19 pCXR from those of normal, bacterial pneumonia, and non-COVID-19 viral pneumonia patients in a multiclass model. The overall sensitivity, specificity, accuracy, and AUC were 0.79, 0.93, and 0.79, 0.85 respectively (whole pCXR), and were 0.91, 0.93, 0.88, and 0.89 (CXR of segmented lung). The performance was generally better using segmented lungs. Heatmaps showed that CNN accurately localized areas of hazy appearance, ground glass opacity and/or consolidation on the pCXR. Deep-learning convolutional neural network with transfer learning accurately classifies COVID-19 on portable chest X-ray against normal, bacterial pneumonia or non-COVID viral pneumonia. This approach has the potential to help radiologists and frontline physicians by providing more timely and accurate diagnosis.

Download Full-text

Deep Learning to Improve COVID-19 Detection: Using CNN-Based Transfer Learning from Chest X-Ray Images

10.1145/3492547.3492616 ◽

2021 ◽

Author(s):

Aya Elagili Elagili ◽

Ibrahim Ighneiwa Ighneiwa ◽

Zakariya Rajab Rajab

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

X Ray ◽

Chest X Ray

Download Full-text

Diagnostic Approach for Accurate Diagnosis of COVID-19 Employing Deep Learning and Transfer Learning Techniques through Chest X-ray Images Clinical Data in E-Healthcare

Sensors ◽

10.3390/s21248219 ◽

2021 ◽

Vol 21 (24) ◽

pp. 8219

Author(s):

Amin Ul Haq ◽

Jian Ping Li ◽

Sultan Ahmad ◽

Shakir Khan ◽

Mohammed Ali Alshara ◽

...

Keyword(s):

Transfer Learning ◽

Classification Accuracy ◽

High Performance ◽

Data Augmentation ◽

Early Stage ◽

Accurate Diagnosis ◽

Fine Tuning ◽

Data Set ◽

X Ray ◽

Chest X Ray

COVID-19 is a transferable disease that is also a leading cause of death for a large number of people worldwide. This disease, caused by SARS-CoV-2, spreads very rapidly and quickly affects the respiratory system of the human being. Therefore, it is necessary to diagnosis this disease at the early stage for proper treatment, recovery, and controlling the spread. The automatic diagnosis system is significantly necessary for COVID-19 detection. To diagnose COVID-19 from chest X-ray images, employing artificial intelligence techniques based methods are more effective and could correctly diagnosis it. The existing diagnosis methods of COVID-19 have the problem of lack of accuracy to diagnosis. To handle this problem we have proposed an efficient and accurate diagnosis model for COVID-19. In the proposed method, a two-dimensional Convolutional Neural Network (2DCNN) is designed for COVID-19 recognition employing chest X-ray images. Transfer learning (TL) pre-trained ResNet-50 model weight is transferred to the 2DCNN model to enhanced the training process of the 2DCNN model and fine-tuning with chest X-ray images data for final multi-classification to diagnose COVID-19. In addition, the data augmentation technique transformation (rotation) is used to increase the data set size for effective training of the R2DCNNMC model. The experimental results demonstrated that the proposed (R2DCNNMC) model obtained high accuracy and obtained 98.12% classification accuracy on CRD data set, and 99.45% classification accuracy on CXI data set as compared to baseline methods. This approach has a high performance and could be used for COVID-19 diagnosis in E-Healthcare systems.

Download Full-text