COVID-19 diagnosis from chest X-ray images using transfer learning: Enhanced performance by debiasing dataloader

BACKGROUND: Chest X-ray imaging has been proved as a powerful diagnostic method to detect and diagnose COVID-19 cases due to its easy accessibility, lower cost and rapid imaging time. OBJECTIVE: This study aims to improve efficacy of screening COVID-19 infected patients using chest X-ray images with the help of a developed deep convolutional neural network model (CNN) entitled nCoV-NET. METHODS: To train and to evaluate the performance of the developed model, three datasets were collected from resources of “ChestX-ray14”, “COVID-19 image data collection”, and “Chest X-ray collection from Indiana University,” respectively. Overall, 299 COVID-19 pneumonia cases and 1,522 non-COVID 19 cases are involved in this study. To overcome the probable bias due to the unbalanced cases in two classes of the datasets, ResNet, DenseNet, and VGG architectures were re-trained in the fine-tuning stage of the process to distinguish COVID-19 classes using a transfer learning method. Lastly, the optimized final nCoV-NET model was applied to the testing dataset to verify the performance of the proposed model. RESULTS: Although the performance parameters of all re-trained architectures were determined close to each other, the final nCOV-NET model optimized by using DenseNet-161 architecture in the transfer learning stage exhibits the highest performance for classification of COVID-19 cases with the accuracy of 97.1 %. The Activation Mapping method was used to create activation maps that highlights the crucial areas of the radiograph to improve causality and intelligibility. CONCLUSION: This study demonstrated that the proposed CNN model called nCoV-NET can be utilized for reliably detecting COVID-19 cases using chest X-ray images to accelerate the triaging and save critical time for disease control as well as assisting the radiologist to validate their initial diagnosis.

Download Full-text

Detection of COVID-19 Using Transfer Learning and Grad-CAM Visualization on Indigenously Collected X-ray Dataset

Sensors ◽

10.3390/s21175813 ◽

2021 ◽

Vol 21 (17) ◽

pp. 5813

Author(s):

Muhammad Umair ◽

Muhammad Shahbaz Khan ◽

Fawad Ahmed ◽

Fatmah Baothman ◽

Fehaid Alqahtani ◽

...

Keyword(s):

Transfer Learning ◽

Input Image ◽

Fine Tuning ◽

Feature Maps ◽

Virus Family ◽

X Ray ◽

Normal Chest ◽

Chest X Ray ◽

Confusion Matrices

The COVID-19 outbreak began in December 2019 and has dreadfully affected our lives since then. More than three million lives have been engulfed by this newest member of the corona virus family. With the emergence of continuously mutating variants of this virus, it is still indispensable to successfully diagnose the virus at early stages. Although the primary technique for the diagnosis is the PCR test, the non-contact methods utilizing the chest radiographs and CT scans are always preferred. Artificial intelligence, in this regard, plays an essential role in the early and accurate detection of COVID-19 using pulmonary images. In this research, a transfer learning technique with fine tuning was utilized for the detection and classification of COVID-19. Four pre-trained models i.e., VGG16, DenseNet-121, ResNet-50, and MobileNet were used. The aforementioned deep neural networks were trained using the dataset (available on Kaggle) of 7232 (COVID-19 and normal) chest X-ray images. An indigenous dataset of 450 chest X-ray images of Pakistani patients was collected and used for testing and prediction purposes. Various important parameters, e.g., recall, specificity, F1-score, precision, loss graphs, and confusion matrices were calculated to validate the accuracy of the models. The achieved accuracies of VGG16, ResNet-50, DenseNet-121, and MobileNet are 83.27%, 92.48%, 96.49%, and 96.48%, respectively. In order to display feature maps that depict the decomposition process of an input image into various filters, a visualization of the intermediate activations is performed. Finally, the Grad-CAM technique was applied to create class-specific heatmap images in order to highlight the features extracted in the X-ray images. Various optimizers were used for error minimization purposes. DenseNet-121 outperformed the other three models in terms of both accuracy and prediction.

Download Full-text

An Ensemble-based Approach by Fine-Tuning the Deep Transfer Learning Models to Classify Pneumonia from Chest X-Ray Images

Proceedings of the 13th International Conference on Agents and Artificial Intelligence ◽

10.5220/0010377403900401 ◽

2021 ◽

Author(s):

Sagar Kora Venu

Keyword(s):

Transfer Learning ◽

Fine Tuning ◽

Learning Models ◽

X Ray ◽

Chest X Ray

Download Full-text

Evaluation of Scalability and Degree of Fine-Tuning of Deep Convolutional Neural Networks for COVID-19 Screening on Chest X-ray Images Using Explainable Deep-Learning Algorithm

Journal of Personalized Medicine ◽

10.3390/jpm10040213 ◽

2020 ◽

Vol 10 (4) ◽

pp. 213 ◽

Cited By ~ 1

Author(s):

Ki-Sun Lee ◽

Jae Young Kim ◽

Eun-tae Jeon ◽

Won Suk Choi ◽

Nan Hee Kim ◽

...

Keyword(s):

Deep Learning ◽

Learning Strategies ◽

Transfer Learning ◽

Learning Algorithm ◽

Fine Tuning ◽

Deep Convolutional Neural Networks ◽

X Ray ◽

Backbone Network ◽

Deep Learning Algorithm ◽

Chest X Ray

According to recent studies, patients with COVID-19 have different feature characteristics on chest X-ray (CXR) than those with other lung diseases. This study aimed at evaluating the layer depths and degree of fine-tuning on transfer learning with a deep convolutional neural network (CNN)-based COVID-19 screening in CXR to identify efficient transfer learning strategies. The CXR images used in this study were collected from publicly available repositories, and the collected images were classified into three classes: COVID-19, pneumonia, and normal. To evaluate the effect of layer depths of the same CNN architecture, CNNs called VGG-16 and VGG-19 were used as backbone networks. Then, each backbone network was trained with different degrees of fine-tuning and comparatively evaluated. The experimental results showed the highest AUC value to be 0.950 concerning COVID-19 classification in the experimental group of a fine-tuned with only 2/5 blocks of the VGG16 backbone network. In conclusion, in the classification of medical images with a limited number of data, a deeper layer depth may not guarantee better results. In addition, even if the same pre-trained CNN architecture is used, an appropriate degree of fine-tuning can help to build an efficient deep learning model.

Download Full-text

Diagnostic Approach for Accurate Diagnosis of COVID-19 Employing Deep Learning and Transfer Learning Techniques through Chest X-ray Images Clinical Data in E-Healthcare

Sensors ◽

10.3390/s21248219 ◽

2021 ◽

Vol 21 (24) ◽

pp. 8219

Author(s):

Amin Ul Haq ◽

Jian Ping Li ◽

Sultan Ahmad ◽

Shakir Khan ◽

Mohammed Ali Alshara ◽

...

Keyword(s):

Transfer Learning ◽

Classification Accuracy ◽

High Performance ◽

Data Augmentation ◽

Early Stage ◽

Accurate Diagnosis ◽

Fine Tuning ◽

Data Set ◽

X Ray ◽

Chest X Ray

COVID-19 is a transferable disease that is also a leading cause of death for a large number of people worldwide. This disease, caused by SARS-CoV-2, spreads very rapidly and quickly affects the respiratory system of the human being. Therefore, it is necessary to diagnosis this disease at the early stage for proper treatment, recovery, and controlling the spread. The automatic diagnosis system is significantly necessary for COVID-19 detection. To diagnose COVID-19 from chest X-ray images, employing artificial intelligence techniques based methods are more effective and could correctly diagnosis it. The existing diagnosis methods of COVID-19 have the problem of lack of accuracy to diagnosis. To handle this problem we have proposed an efficient and accurate diagnosis model for COVID-19. In the proposed method, a two-dimensional Convolutional Neural Network (2DCNN) is designed for COVID-19 recognition employing chest X-ray images. Transfer learning (TL) pre-trained ResNet-50 model weight is transferred to the 2DCNN model to enhanced the training process of the 2DCNN model and fine-tuning with chest X-ray images data for final multi-classification to diagnose COVID-19. In addition, the data augmentation technique transformation (rotation) is used to increase the data set size for effective training of the R2DCNNMC model. The experimental results demonstrated that the proposed (R2DCNNMC) model obtained high accuracy and obtained 98.12% classification accuracy on CRD data set, and 99.45% classification accuracy on CXI data set as compared to baseline methods. This approach has a high performance and could be used for COVID-19 diagnosis in E-Healthcare systems.

Download Full-text

Tinjauan Literatur Sistematik tentang Deteksi Covid-19 menggunakan Convolutional Neural Networks

Creative Information Technology Journal ◽

10.24076/citec.2021v8i1.261 ◽

2021 ◽

Vol 8 (1) ◽

pp. 9

Author(s):

Buyut Khoirul Umri ◽

Ema Utami ◽

Mei P Kurniawan

Keyword(s):

Neural Network ◽

Neural Networks ◽

Literature Review ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Large Scale ◽

Image Data ◽

X Rays ◽

X Ray ◽

Chest X Ray

Covid-19 menyerang sel-sel epitel yang melapisi saluran pernapasan sehingga dalam kasus ini dapat memanfaatkan gambar x-ray dada untuk menganalisis kesehatan paru-paru pada pasien. Menggunakan x-ray dalam bidang medis merupakan metode yang lebih cepat, lebih mudah dan tidak berbahaya yang dapat dimanfaatkan pada banyak hal. Salah satu metode yang paling sering digunakan dalam klasifikasi gambar adalah convolutional neural networks (CNN). CNN merupahan jenis neural network yang sering digunakan dalam data gambar dan sering digunakan dalam mendeteksi dan mengenali object pada sebuah gambar. Model arsitektur pada metode CNN juga dapat dikembangkan dengan transfer learning yang merupakan proses menggunakan kembali model pre-trained yang dilatih pada dataset besar, biasanya pada tugas klasifikasi gambar berskala besar. Tinjauan literature review ini digunakan untuk menganalisis penggunaan transfer learning pada CNN sebagai metode yang dapat digunakan untuk mendeteksi covid-19 pada gambar x-ray dada. Hasil sistematis review menunjukkan bahwa algoritma CNN dapat digunakan dengan akruasi yang baik dalam mendeteksi covid-19 pada gambar x-ray dada dan dengan pengembangan model transfer learning mampu mendapatkan performa yang maksimal dengan dataset yang besar maupun kecil.Kata Kunci—CNN, transfer learning, deteksi, covid-19Covid-19 attacks the epithelial cells lining the respiratory tract so that in this case it can utilize chest x-ray images to analyze the health of the lungs in patients. Using x-rays in the medical field is a faster, easier and harmless method that can be utilized in many ways. One of the most frequently used methods in image classification is convolutional neural networks (CNN). CNN is a type of neural network that is often used in image data and is often used in detecting and recognizing objects in an image. The architectural model in the CNN method can also be developed with transfer learning which is the process of reusing pre-trained models that are trained on large datasets, usually on the task of classifying large-scale images. This literature review review is used to analyze the use of transfer learning on CNN as a method that can be used to detect covid-19 on chest x-ray images. The systematic review results show that the CNN algorithm can be used with good accuracy in detecting covid-19 on chest x-ray images and by developing transfer learning models able to get maximum performance with large and small datasets.Keywords—CNN, transfer learning, detection, covid-19

Download Full-text

Automatic Detection of COVID-19 and Pneumonia from Chest X-Ray using Transfer Learning

10.1101/2020.05.27.20100297 ◽

2020 ◽

Author(s):

Sarath Pathari ◽

Rahul U

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Clinical Picture ◽

Bacterial Pneumonia ◽

Automatic Detection ◽

Neural System ◽

Cutting Edge ◽

X Ray ◽

X Ray Imaging ◽

Chest X Ray

In this study, a dataset of X-ray images from patients with common viral pneumonia, bacterial pneumonia, confirmed Covid-19 disease was utilized for the automatic detection of the Coronavirus disease. The point of the investigation is to assess the exhibition of cutting edge convolutional neural system structures proposed over the ongoing years for clinical picture order. In particular, the system called Transfer Learning was received. With transfer learning, the location of different variations from the norm in little clinical picture datasets is a reachable objective, regularly yielding amazing outcomes. The datasets used in this trial. Firstly, a collection of 24000 X-ray images includes 6000 images for confirmed Covid-19 disease,6000 confirmed common bacterial pneumonia and 6000 images of normal conditions. The information was gathered and expanded from the accessible X-Ray pictures on open clinical stores. The outcomes recommend that Deep Learning with X-Ray imaging may separate noteworthy biomarkers identified with the Covid-19 sickness, while the best precision, affectability, and particularity acquired is 97.83%, 96.81%, and 98.56% individually.

Download Full-text

Detection of coronavirus disease from X-ray images using deep learning and transfer learning algorithms

Journal of X-Ray Science and Technology ◽

10.3233/xst-200720 ◽

2020 ◽

Vol 28 (5) ◽

pp. 841-850

Author(s):

Saleh Albahli ◽

Waleed Albattah

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Medical Image Analysis ◽

Image Data ◽

Network Models ◽

Learning Models ◽

X Ray ◽

Study Results ◽

Chest X Ray

OBJECTIVE: This study aims to employ the advantages of computer vision and medical image analysis to develop an automated model that has the clinical potential for early detection of novel coronavirus (COVID-19) infected disease. METHOD: This study applied transfer learning method to develop deep learning models for detecting COVID-19 disease. Three existing state-of-the-art deep learning models namely, Inception ResNetV2, InceptionNetV3 and NASNetLarge, were selected and fine-tuned to automatically detect and diagnose COVID-19 disease using chest X-ray images. A dataset involving 850 images with the confirmed COVID-19 disease, 500 images of community-acquired (non-COVID-19) pneumonia cases and 915 normal chest X-ray images was used in this study. RESULTS: Among the three models, InceptionNetV3 yielded the best performance with accuracy levels of 98.63% and 99.02% with and without using data augmentation in model training, respectively. All the performed networks tend to overfitting (with high training accuracy) when data augmentation is not used, this is due to the limited amount of image data used for training and validation. CONCLUSION: This study demonstrated that a deep transfer learning is feasible to detect COVID-19 disease automatically from chest X-ray by training the learning model with chest X-ray images mixed with COVID-19 patients, other pneumonia affected patients and people with healthy lungs, which may help doctors more effectively make their clinical decisions. The study also gives an insight to how transfer learning was used to automatically detect the COVID-19 disease. In future studies, as the amount of available dataset increases, different convolution neutral network models could be designed to achieve the goal more efficiently.

Download Full-text

The Diagnosis of COVID-19 through X-ray Images via Transfer Learning and Fine-Tuned Dense Layer on Pipeline

Mekatronika ◽

10.15282/mekatronika.v3i2.7161 ◽

2021 ◽

Vol 3 (2) ◽

pp. 19-24

Author(s):

Amiir Haamzah Mohamed Ismail ◽

Mohd Azraai Mohd Razman ◽

Ismail Mohd Khairuddin ◽

Muhammad Amirul Abdullah ◽

Rabiu Muazu Musa ◽

...

Keyword(s):

Machine Learning ◽

Transfer Learning ◽

Screening Method ◽

Learning Technologies ◽

Fine Tuning ◽

Dense Layer ◽

X Ray ◽

Chest X Ray ◽

The Common ◽

Fully Connected

X-ray is used in medical treatment as a method to diagnose the human body internally from diseases. Nevertheless, the development in machine learning technologies for pattern recognition have allowed machine learning of diagnosing diseases from chest X-ray images. One such diseases that are able to be detected by using X-ray is the COVID-19 coronavirus. This research investigates the diagnosis of COVID-19 through X-ray images by using transfer learning and fine-tuning of the fully connected layer. Next, hyperparameters such as dropout, p, number of neurons, and activation functions are investigated on which combinations of these hyperparameters will yield the highest classification accuracy model. InceptionV3 which is one of the common neural network is used for feature extraction from chest X-ray images. Subsequently, the loss and accuracy graphs are used to find the pipeline which performs the best in classification task. The findings in this research will open new possibilities in screening method for COVID-19.

Download Full-text