scholarly journals Problems of Deploying CNN Transfer Learning to Detect COVID-19 from Chest X-rays

Author(s):  
Taban Majeed ◽  
Rasber Rashid ◽  
Dashti Ali ◽  
Aras Asaad

AbstractThe Covid-19 first occurs in Wuhan, China in December 2019. After that the virus spread all around the world and at the time of writing this paper the total number of confirmed cases are above 4.7 million with over 315000 deaths. Machine learning algorithms built on radiography images can be used as a decision support mechanism to aid radiologists to speed up the diagnostic process. The aim of this work is to conduct a critical analysis to investigate the applicability of convolutional neural networks (CNNs) for the purpose of COVID-19 detection in chest X-ray images and highlight the issues of using CNN directly on the whole image. To achieve this task, we first use 12-off-the-shelf CNN architectures in transfer learning mode on 3 publicly available chest X-ray databases together with proposing a shallow CNN architecture in which we train it from scratch. Chest X-ray images fed into CNN models without any preprocessing to follow the many of researches using chest X-rays in this manner. Next, a qualitative investigation performed to inspect the decisions made by CNNs using a technique known as class activation maps (CAM). Using CAMs, one can map the activations contributed most to the decision of CNNs back to the original image to visualize the most discriminating regions on the input image.We conclude that CNN decisions should not be taken into consideration, despite their high classification accuracy, until clinicians can visually inspect, and approve, the region(s) of the input image used by CNNs that lead to its prediction.

Author(s):  
Ahmed Hashem El Fiky ◽  

The COVID-19 will take place for the first time in December 2019 in Wuhan, China. After that, the virus spread all over the world, with over 4.7 million confirmed cases and over 315000 deaths as of the time of writing this report. Radiologists can employ machine learning algorithms developed on radiography pictures as a decision support mechanism to help them speed up the diagnostic process. The goal of this study is to conduct a quantitative evaluation of six off-the-shelf convolutional neural networks (CNNs) for COVID-19 X-ray image analysis. Due to the limited amount of images available for analysis, the CNN transfer learning approach was used. We also developed a simple CNN architecture with a modest number of parameters that does a good job of differentiating COVID-19 from regular X-rays. in this paper, we are used large dataset which contained CXR images of normal patients and patients with COVID-19. the number of CXR images for normal patients are 10,192 image and the number of CXR images for COVID-19 patients are 3,616 images. The results of experiments show the effectiveness and robustness of Deep-COVID-19 and pretrained models like VGG16, VGG19, and MobileNets. Our proposed Model Deep-COVID-19 achieved over 94.5% accuracy.


Sensors ◽  
2021 ◽  
Vol 21 (17) ◽  
pp. 5813
Author(s):  
Muhammad Umair ◽  
Muhammad Shahbaz Khan ◽  
Fawad Ahmed ◽  
Fatmah Baothman ◽  
Fehaid Alqahtani ◽  
...  

The COVID-19 outbreak began in December 2019 and has dreadfully affected our lives since then. More than three million lives have been engulfed by this newest member of the corona virus family. With the emergence of continuously mutating variants of this virus, it is still indispensable to successfully diagnose the virus at early stages. Although the primary technique for the diagnosis is the PCR test, the non-contact methods utilizing the chest radiographs and CT scans are always preferred. Artificial intelligence, in this regard, plays an essential role in the early and accurate detection of COVID-19 using pulmonary images. In this research, a transfer learning technique with fine tuning was utilized for the detection and classification of COVID-19. Four pre-trained models i.e., VGG16, DenseNet-121, ResNet-50, and MobileNet were used. The aforementioned deep neural networks were trained using the dataset (available on Kaggle) of 7232 (COVID-19 and normal) chest X-ray images. An indigenous dataset of 450 chest X-ray images of Pakistani patients was collected and used for testing and prediction purposes. Various important parameters, e.g., recall, specificity, F1-score, precision, loss graphs, and confusion matrices were calculated to validate the accuracy of the models. The achieved accuracies of VGG16, ResNet-50, DenseNet-121, and MobileNet are 83.27%, 92.48%, 96.49%, and 96.48%, respectively. In order to display feature maps that depict the decomposition process of an input image into various filters, a visualization of the intermediate activations is performed. Finally, the Grad-CAM technique was applied to create class-specific heatmap images in order to highlight the features extracted in the X-ray images. Various optimizers were used for error minimization purposes. DenseNet-121 outperformed the other three models in terms of both accuracy and prediction.


2020 ◽  
Author(s):  
Terry Gao ◽  
Grace Wang

Abstract To speed up the discovery of COVID-19 disease mechanisms, this research developed a new diagnosis platform using a deep convolutional neural network (CNN) that is able to assist radiologists with diagnosis by distinguishing COVID-19 pneumonia from non-COVID-19 pneumonia in patients at Middlemore Hospital based on chest X-ray classification and analysis. Such a tool can save time in interpreting chest X-rays and increase the accuracy and thereby enhance our medical capacity for the detection and diagnosis of COVID-19. The research idea is that a set of X-ray medical lung images (which include normal, infected by bacteria, infected by virus including COVID-19) were used to train a deep CNN that can distinguish between the noise and the useful information and then uses this training to interpret new images by recognizing patterns that indicate certain diseases such as coronavirus infection in the individual images. The supervised learning method is used as the process of learning from the training dataset and can be thought of as a doctor supervising the learning process. It becomes more accurate as the number of analyzed images grows. In this way, it imitates the training for a doctor, but the theory is that since it is capable of learning from a far larger set of images than any human, it can have the potential of being more accurate.


2020 ◽  
Vol 10 (8) ◽  
pp. 2908 ◽  
Author(s):  
Juan Luján-García ◽  
Cornelio Yáñez-Márquez ◽  
Yenny Villuendas-Rey ◽  
Oscar Camacho-Nieto

Pneumonia is an infectious disease that affects the lungs and is one of the principal causes of death in children under five years old. The Chest X-ray images technique is one of the most used for diagnosing pneumonia. Several Machine Learning algorithms have been successfully used in order to provide computer-aided diagnosis by automatic classification of medical images. For its remarkable results, the Convolutional Neural Networks (models based on Deep Learning) that are widely used in Computer Vision tasks, such as classification of injuries and brain abnormalities, among others, stand out. In this paper, we present a transfer learning method that automatically classifies between 3883 chest X-ray images characterized as depicting pneumonia and 1349 labeled as normal. The proposed method uses the Xception Network pre-trained weights on ImageNet as an initialization. Our model is competitive with respect to state-of-the-art proposals. To make comparisons with other models, we have used four well-known performance measures, obtaining the following results: precision (0.84), recall (0.99), F1-score (0.91) and area under the ROC curve (0.97). These positive results allow us to consider our proposal as an alternative that can be useful in countries with a lack of equipment and specialized radiologists.


Author(s):  
Tahmina Zebin ◽  
Shahadate Rezvy

Abstract Chest X-rays are playing an important role in the testing and diagnosis of COVID-19 disease in the recent pandemic. However, due to the limited amount of labelled medical images, automated classification of these images for positive and negative cases remains the biggest challenge in their reliable use in diagnosis and disease progression. We implemented a transfer learning pipeline for classifying COVID-19 chest X-ray images from two publicly available chest X-ray datasets1,2. The classifier effectively distinguishes inflammation in lungs due to COVID-19 and Pneumonia from the ones with no infection (normal). We have used multiple pre-trained convolutional backbones as the feature extractor and achieved an overall detection accuracy of 90%, 94.3%, and 96.8% for the VGG16, ResNet50, and EfficientNetB0 backbones respectively. Additionally, we trained a generative adversarial framework (a CycleGAN) to generate and augment the minority COVID-19 class in our approach. For visual explanations and interpretation purposes, we implemented a gradient class activation mapping technique to highlight the regions of the input image that are important for predictions. Additionally, these visualizations can be used to monitor the affected lung regions during disease progression and severity stages.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Jie Hou ◽  
Terry Gao

AbstractTo speed up the discovery of COVID-19 disease mechanisms by X-ray images, this research developed a new diagnosis platform using a deep convolutional neural network (DCNN) that is able to assist radiologists with diagnosis by distinguishing COVID-19 pneumonia from non-COVID-19 pneumonia in patients based on chest X-ray classification and analysis. Such a tool can save time in interpreting chest X-rays and increase the accuracy and thereby enhance our medical capacity for the detection and diagnosis of COVID-19. The explainable method is also used in the DCNN to select instances of the X-ray dataset images to explain the behavior of training-learning models to achieve higher prediction accuracy. The average accuracy of our method is above 96%, which can replace manual reading and has the potential to be applied to large-scale rapid screening of COVID-9 for widely use cases.


2021 ◽  
Vol 8 (1) ◽  
pp. 9
Author(s):  
Buyut Khoirul Umri ◽  
Ema Utami ◽  
Mei P Kurniawan

Covid-19 menyerang sel-sel epitel yang melapisi saluran pernapasan sehingga dalam kasus ini dapat memanfaatkan gambar x-ray dada untuk menganalisis kesehatan paru-paru pada pasien. Menggunakan x-ray dalam bidang medis merupakan metode yang lebih cepat, lebih mudah dan tidak berbahaya yang dapat dimanfaatkan pada banyak hal. Salah satu metode yang paling sering digunakan dalam klasifikasi gambar adalah convolutional neural networks (CNN). CNN merupahan jenis neural network yang sering digunakan dalam data gambar dan sering digunakan dalam mendeteksi dan mengenali object pada sebuah gambar. Model arsitektur pada metode CNN juga dapat dikembangkan dengan transfer learning yang merupakan proses menggunakan kembali model pre-trained yang dilatih pada dataset besar, biasanya pada tugas klasifikasi gambar berskala besar. Tinjauan literature review ini digunakan untuk menganalisis penggunaan transfer learning pada CNN sebagai metode yang dapat digunakan untuk mendeteksi covid-19 pada gambar x-ray dada. Hasil sistematis review menunjukkan bahwa algoritma CNN dapat digunakan dengan akruasi yang baik dalam mendeteksi covid-19 pada gambar x-ray dada dan dengan pengembangan model transfer learning mampu mendapatkan performa yang maksimal dengan dataset yang besar maupun kecil.Kata Kunci—CNN, transfer learning, deteksi, covid-19Covid-19 attacks the epithelial cells lining the respiratory tract so that in this case it can utilize chest x-ray images to analyze the health of the lungs in patients. Using x-rays in the medical field is a faster, easier and harmless method that can be utilized in many ways. One of the most frequently used methods in image classification is convolutional neural networks (CNN). CNN is a type of neural network that is often used in image data and is often used in detecting and recognizing objects in an image. The architectural model in the CNN method can also be developed with transfer learning which is the process of reusing pre-trained models that are trained on large datasets, usually on the task of classifying large-scale images. This literature review review is used to analyze the use of transfer learning on CNN as a method that can be used to detect covid-19 on chest x-ray images. The systematic review results show that the CNN algorithm can be used with good accuracy in detecting covid-19 on chest x-ray images and by developing transfer learning models able to get maximum performance with large and small datasets.Keywords—CNN, transfer learning, detection, covid-19


2020 ◽  
Author(s):  
Terry Gao

Abstract To speed up the discovery of COVID-19 disease mechanisms by X-ray images, this research developed a new diagnosis platform using a deep convolutional neural network (CNN) that is able to assist radiologists with diagnosis by distinguishing COVID-19 pneumonia from non-COVID-19 pneumonia in patients based on chest X-ray classification and analysis. Such a tool can save time in interpreting chest X-rays and increase the accuracy and thereby enhance our medical capacity for the detection and diagnosis of COVID-19. The research idea is that a set of X-ray medical lung images (which include normal, infected by bacteria, infected by virus including COVID-19) are used to train a deep CNN that can distinguish between the noise and the useful information and then uses this training to interpret new images by recognizing patterns that indicate certain diseases such as coronavirus infection in the individual images. The supervised learning method is used as the process of learning from the training dataset and can be thought of as a doctor supervising the learning process. It becomes more accurate as the number of analyzed images grows, and the average accuracy is above 95%. In this way, it imitates the training for a doctor, but the theory is that since it is capable of learning from a far larger set of images than any human, it can have the potential of being more accurate.


2020 ◽  
Vol 10 (9) ◽  
pp. 3233 ◽  
Author(s):  
Tawsifur Rahman ◽  
Muhammad E. H. Chowdhury ◽  
Amith Khandakar ◽  
Khandaker R. Islam ◽  
Khandaker F. Islam ◽  
...  

Pneumonia is a life-threatening disease, which occurs in the lungs caused by either bacterial or viral infection. It can be life-endangering if not acted upon at the right time and thus the early diagnosis of pneumonia is vital. The paper aims to automatically detect bacterial and viral pneumonia using digital x-ray images. It provides a detailed report on advances in accurate detection of pneumonia and then presents the methodology adopted by the authors. Four different pre-trained deep Convolutional Neural Network (CNN): AlexNet, ResNet18, DenseNet201, and SqueezeNet were used for transfer learning. A total of 5247 chest X-ray images consisting of bacterial, viral, and normal chest x-rays images were preprocessed and trained for the transfer learning-based classification task. In this study, the authors have reported three schemes of classifications: normal vs. pneumonia, bacterial vs. viral pneumonia, and normal, bacterial, and viral pneumonia. The classification accuracy of normal and pneumonia images, bacterial and viral pneumonia images, and normal, bacterial, and viral pneumonia were 98%, 95%, and 93.3%, respectively. This is the highest accuracy, in any scheme, of the accuracies reported in the literature. Therefore, the proposed study can be useful in more quickly diagnosing pneumonia by the radiologist and can help in the fast airport screening of pneumonia patients.


2020 ◽  
Author(s):  
Terry Gao

AbstractTo speed up the discovery of COVID-19 disease mechanisms by X-ray images, this research developed a new diagnosis platform using a deep convolutional neural network (CNN) that is able to assist radiologists with diagnosis by distinguishing COVID-19 pneumonia from non-COVID-19 pneumonia in patients based on chest X-ray classification and analysis. Such a tool can save time in interpreting chest X-rays and increase the accuracy and thereby enhance our medical capacity for the detection and diagnosis of COVID-19. The research idea is that a set of X-ray medical lung images (which include normal, infected by bacteria, infected by virus including COVID-19) are used to train a deep CNN that can distinguish between the noise and the useful information and then uses this training to interpret new images by recognizing patterns that indicate certain diseases such as coronavirus infection in the individual images. The supervised learning method is used as the process of learning from the training dataset and can be thought of as a doctor supervising the learning process. It becomes more accurate as the number of analyzed images grows, and the average accuracy is above 95%. In this way, it imitates the training for a doctor, but the theory is that since it is capable of learning from a far larger set of images than any human, it can have the potential of being more accurate.


Sign in / Sign up

Export Citation Format

Share Document