scholarly journals A Deep Learning Model with Self-Supervised Learning and Attention Mechanism for COVID-19 Diagnosis Using Chest X-ray Images

Electronics ◽  
2021 ◽  
Vol 10 (16) ◽  
pp. 1996
Author(s):  
Junghoon Park ◽  
Il-Youp Kwak ◽  
Changwon Lim
Keyword(s):  
Deep Learning ◽  
Supervised Learning ◽  
Learning Model ◽  
Fine Tuning ◽  
Classification Model ◽  
World Health ◽  
X Ray ◽  
Proposed Model ◽  
Chest X Ray ◽  
Deep Learning Model

The SARS-CoV-2 virus has spread worldwide, and the World Health Organization has declared COVID-19 pandemic, proclaiming that the entire world must overcome it together. The chest X-ray and computed tomography datasets of individuals with COVID-19 remain limited, which can cause lower performance of deep learning model. In this study, we developed a model for the diagnosis of COVID-19 by solving the classification problem using a self-supervised learning technique with a convolution attention module. Self-supervised learning using a U-shaped convolutional neural network model combined with a convolution block attention module (CBAM) using over 100,000 chest X-Ray images with structure similarity (SSIM) index captures image representations extremely well. The system we proposed consists of fine-tuning the weights of the encoder after a self-supervised learning pretext task, interpreting the chest X-ray representation in the encoder using convolutional layers, and diagnosing the chest X-ray image as the classification model. Additionally, considering the CBAM further improves the averaged accuracy of 98.6%, thereby outperforming the baseline model (97.8%) by 0.8%. The proposed model classifies the three classes of normal, pneumonia, and COVID-19 extremely accurately, along with other metrics such as specificity and sensitivity that are similar to accuracy. The average area under the curve (AUC) is 0.994 in the COVID-19 class, indicating that our proposed model exhibits outstanding classification performance.

scholarly journals Accessory pathway analysis using a multimodal deep learning model

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Makoto Nishimori ◽  
Kunihiko Kiuchi ◽  
Kunihiro Nishimura ◽  
Kengo Kusano ◽  
Akihiro Yoshida ◽  
...  
Keyword(s):  
Deep Learning ◽  
Electrophysiological Study ◽  
Accessory Pathway ◽  
Learning Model ◽  
X Rays ◽  
X Ray ◽  
Wpw Syndrome ◽  
Chest X Ray ◽  
Deep Learning Model ◽  
Ecg Data

AbstractCardiac accessory pathways (APs) in Wolff–Parkinson–White (WPW) syndrome are conventionally diagnosed with decision tree algorithms; however, there are problems with clinical usage. We assessed the efficacy of the artificial intelligence model using electrocardiography (ECG) and chest X-rays to identify the location of APs. We retrospectively used ECG and chest X-rays to analyse 206 patients with WPW syndrome. Each AP location was defined by an electrophysiological study and divided into four classifications. We developed a deep learning model to classify AP locations and compared the accuracy with that of conventional algorithms. Moreover, 1519 chest X-ray samples from other datasets were used for prior learning, and the combined chest X-ray image and ECG data were put into the previous model to evaluate whether the accuracy improved. The convolutional neural network (CNN) model using ECG data was significantly more accurate than the conventional tree algorithm. In the multimodal model, which implemented input from the combined ECG and chest X-ray data, the accuracy was significantly improved. Deep learning with a combination of ECG and chest X-ray data could effectively identify the AP location, which may be a novel deep learning model for a multimodal model.

scholarly journals ECOVNet: a highly effective ensemble based deep learning model for detecting COVID-19

2021 ◽  
Vol 7 ◽  
pp. e551
Author(s):  
Nihad Karim Chowdhury ◽  
Muhammad Ashad Kabir ◽  
Md. Muhtadir Rahman ◽  
Noortaz Rezoana
Keyword(s):  
Deep Learning ◽  
Detection System ◽  
Learning Model ◽  
Classification Performance ◽  
Data Sets ◽  
X Rays ◽  
Proposed Model ◽  
Highly Effective ◽  
Chest X Ray ◽  
Deep Learning Model

The goal of this research is to develop and implement a highly effective deep learning model for detecting COVID-19. To achieve this goal, in this paper, we propose an ensemble of Convolutional Neural Network (CNN) based on EfficientNet, named ECOVNet, to detect COVID-19 from chest X-rays. To make the proposed model more robust, we have used one of the largest open-access chest X-ray data sets named COVIDx containing three classes—COVID-19, normal, and pneumonia. For feature extraction, we have applied an effective CNN structure, namely EfficientNet, with ImageNet pre-training weights. The generated features are transferred into custom fine-tuned top layers followed by a set of model snapshots. The predictions of the model snapshots (which are created during a single training) are consolidated through two ensemble strategies, i.e., hard ensemble and soft ensemble, to enhance classification performance. In addition, a visualization technique is incorporated to highlight areas that distinguish classes, thereby enhancing the understanding of primal components related to COVID-19. The results of our empirical evaluations show that the proposed ECOVNet model outperforms the state-of-the-art approaches and significantly improves detection performance with 100% recall for COVID-19 and overall accuracy of 96.07%. We believe that ECOVNet can enhance the detection of COVID-19 disease, and thus, underpin a fully automated and efficacious COVID-19 detection system.

scholarly journals Using a Deep Learning Model to Explore the Impact of Clinical Data on COVID-19 Diagnosis Using Chest X-ray

Sensors ◽  
2022 ◽  
Vol 22 (2) ◽  
pp. 669
Author(s):  
Irfan Ullah Khan ◽  
Nida Aslam ◽  
Talha Anwar ◽  
Hind S. Alsaif ◽  
Sara Mhd. Bachar Chrouf ◽  
...  
Keyword(s):  
Deep Learning ◽  
Clinical Data ◽  
Disease Diagnosis ◽  
University Hospital ◽  
X Ray ◽  
Clinical Patient ◽  
Proposed Model ◽  
Chest X Ray ◽  
The Impact ◽  
Deep Learning Model

The coronavirus pandemic (COVID-19) is disrupting the entire world; its rapid global spread threatens to affect millions of people. Accurate and timely diagnosis of COVID-19 is essential to control the spread and alleviate risk. Due to the promising results achieved by integrating machine learning (ML), particularly deep learning (DL), in automating the multiple disease diagnosis process. In the current study, a model based on deep learning was proposed for the automated diagnosis of COVID-19 using chest X-ray images (CXR) and clinical data of the patient. The aim of this study is to investigate the effects of integrating clinical patient data with the CXR for automated COVID-19 diagnosis. The proposed model used data collected from King Fahad University Hospital, Dammam, KSA, which consists of 270 patient records. The experiments were carried out first with clinical data, second with the CXR, and finally with clinical data and CXR. The fusion technique was used to combine the clinical features and features extracted from images. The study found that integrating clinical data with the CXR improves diagnostic accuracy. Using the clinical data and the CXR, the model achieved an accuracy of 0.970, a recall of 0.986, a precision of 0.978, and an F-score of 0.982. Further validation was performed by comparing the performance of the proposed system with the diagnosis of an expert. Additionally, the results have shown that the proposed system can be used as a tool that can help the doctors in COVID-19 diagnosis.

scholarly journals On Teacher-Student Semi-Supervised Learning for Chest X-ray Image Classification

2021 ◽  
Author(s):  
Roberto Augusto Philippi Martins ◽  
Danilo Silva
Keyword(s):  
Deep Learning ◽  
Supervised Learning ◽  
Learning Algorithm ◽  
Unlabeled Data ◽  
Imaging Data ◽  
X Ray ◽  
Teacher Student ◽  
Chest X Ray ◽  
Deep Learning Model

The lack of labeled data is one of the main prohibiting issues on the development of deep learning models, as they rely on large labeled datasets in order to achieve high accuracy in complex tasks. Our objective is to evaluate the performance gain of having additional unlabeled data in the training of a deep learning model when working with medical imaging data. We present a semi-supervised learning algorithm that utilizes a teacher-student paradigm in order to leverage unlabeled data in the classification of chest X-ray images. Using our algorithm on the ChestX-ray14 dataset, we manage to achieve a substantial increase in performance when using small labeled datasets. With our method, a model achieves an AUROC of 0.822 with only 2% labeled data and 0.865 with 5% labeled data, while a fully supervised method achieves an AUROC of 0.807 with 5% labeled data and only 0.845 with 10%.

scholarly journals Metaheuristic-based Deep COVID-19 Screening Model from Chest X-Ray Images

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Manjit Kaur ◽  
Vijay Kumar ◽  
Vaishali Yadav ◽  
Dilbag Singh ◽  
Naresh Kumar ◽  
...  
Keyword(s):  
Deep Learning ◽  
Learning Models ◽  
Huge Number ◽  
X Ray ◽  
Screening Model ◽  
Proposed Model ◽  
Strength Pareto Evolutionary Algorithm ◽  
Chest X Ray ◽  
Deep Learning Model

COVID-19 has affected the whole world drastically. A huge number of people have lost their lives due to this pandemic. Early detection of COVID-19 infection is helpful for treatment and quarantine. Therefore, many researchers have designed a deep learning model for the early diagnosis of COVID-19-infected patients. However, deep learning models suffer from overfitting and hyperparameter-tuning issues. To overcome these issues, in this paper, a metaheuristic-based deep COVID-19 screening model is proposed for X-ray images. The modified AlexNet architecture is used for feature extraction and classification of the input images. Strength Pareto evolutionary algorithm-II (SPEA-II) is used to tune the hyperparameters of modified AlexNet. The proposed model is tested on a four-class (i.e., COVID-19, tuberculosis, pneumonia, or healthy) dataset. Finally, the comparisons are drawn among the existing and the proposed models.

scholarly journals A Deep Learning Approach to Detect COVID-19 Patients from Chest X-ray Images

AI ◽  
2020 ◽  
Vol 1 (3) ◽  
pp. 418-435
Author(s):  
Khandaker Haque ◽  
Ahmed Abdelgawad
Keyword(s):  
Deep Learning ◽  
World Health ◽  
X Rays ◽  
X Ray ◽  
Global Pandemic ◽  
Proposed Model ◽  
Dental Diseases ◽  
Chest X Ray ◽  
Artery Disease ◽  
Health Organization

Deep Learning has improved multi-fold in recent years and it has been playing a great role in image classification which also includes medical imaging. Convolutional Neural Networks (CNNs) have been performing well in detecting many diseases including coronary artery disease, malaria, Alzheimer’s disease, different dental diseases, and Parkinson’s disease. Like other cases, CNN has a substantial prospect in detecting COVID-19 patients with medical images like chest X-rays and CTs. Coronavirus or COVID-19 has been declared a global pandemic by the World Health Organization (WHO). As of 8 August 2020, the total COVID-19 confirmed cases are 19.18 M and deaths are 0.716 M worldwide. Detecting Coronavirus positive patients is very important in preventing the spread of this virus. On this conquest, a CNN model is proposed to detect COVID-19 patients from chest X-ray images. Two more CNN models with different number of convolution layers and three other models based on pretrained ResNet50, VGG-16 and VGG-19 are evaluated with comparative analytical analysis. All six models are trained and validated with Dataset 1 and Dataset 2. Dataset 1 has 201 normal and 201 COVID-19 chest X-rays whereas Dataset 2 is comparatively larger with 659 normal and 295 COVID-19 chest X-ray images. The proposed model performs with an accuracy of 98.3% and a precision of 96.72% with Dataset 2. This model gives the Receiver Operating Characteristic (ROC) curve area of 0.983 and F1-score of 98.3 with Dataset 2. Moreover, this work shows a comparative analysis of how change in convolutional layers and increase in dataset affect classifying performances.

COVID-19 Chest X-Ray Images Diagnosis: A Neutrosophic and Deep Transfer Learning Approach

2020 ◽  
Author(s):  
Nour Eldeen M. Khalifa ◽  
Florentin Smarandache ◽  
Mohamed Loey
Keyword(s):  
Deep Learning ◽  
Performance Metrics ◽  
World Health ◽  
Transfer Model ◽  
X Ray ◽  
Proposed Model ◽  
The World ◽  
Chest X Ray ◽  
Testing Accuracy ◽  
Transfer Models

Coronavirus, also known as COVID-19, has spread to several countries around the world. It was announced as a pandemic disease by The World Health Organization (WHO) in 2020 for its devastating impact on humans. With the advancements in computer science algorithms, the detection of this type of virus in the early stages is urgently needed for the fast recovery of patients. In this paper, a neutrosophic with a deep learning model for the detection of COVID-19 from chest X-ray medical digital images is presented. The proposed model relies on neutrosophic theory by converting the medical images from the grayscale spatial domain to the neutrosophic domain. The neutrosophic domain consists of three types of images and they are, the True (T) images, the Indeterminacy (I) images, and the Falsity (F) images. Using neutrosophic images has positively affected the accuracy of the proposed model. The dataset used in this research has been collected from different sources as there is no benchmark dataset for COVID-19 chest X-ray until the writing of this research. The dataset consists of four classes and they are COVID-19, Normal, Pneumonia bacterial, and Pneumonia virus. After the conversion to the neutrosophic domain, the images are fed into three different deep transfer models and they are Alexnet, Googlenet, and Restnet18. Those models are selected as they have a small number of layers on their architectures and they have been used with related work. To test the performance of the conversion to the neutrosophic domain, four scenarios have been tested. The first scenario is training the deep transfer models with True (T) neutrosophic images only. The second one is training on Indeterminacy (I) neutrosophic images, while the third scenario is training the deep models over the Falsity (F) neutrosophic images. The fourth scenario is training over the combined (T, I, F) neutrosophic images. According to the experimental results, the combined (T, I, F) neutrosophic images achieved the highest accuracy possible for the validation, testing and all performance metrics such Precision, Recall and F1 Score using Resnet18 as a deep transfer model. The proposed model achieved a testing accuracy with 78.70%. Furthermore, the proposed model using neutrosophic and Resnet18 had achieved superior testing accuracy with a related work which achieved 52.80% with the same experimental environmental setup and the same deep learning hyperparameters.

Sign in / Sign up

Export Citation Format

Share Document