scholarly journals Objective Evaluation of Deep Uncertainty Predictions for COVID-19 Detection

2021 ◽  
Author(s):  
Hamzeh Asgharnezhad ◽  
Afshar Shamsi ◽  
Roohallah Alizadehsani ◽  
Abbas Khosravi ◽  
Saeid Nahavandi ◽  
...  
Keyword(s):  
Uncertainty Quantification ◽  
Performance Metrics ◽  
Confusion Matrix ◽  
Objective Evaluation ◽  
X Rays ◽  
The Novel ◽  
X Ray ◽  
Uncertainty Estimates ◽  
Chest X Ray ◽  
Novel Concept

Abstract Deep neural networks (DNNs) have been widely applied for detecting COVID-19 in medical images. Existing studies mainly apply transfer learning and other data representation strategies to generate accurate point estimates. The generalization power of these networks is always questionable due to being developed using small datasets and failing to report their predictive confidence. Quantifying uncertainties associated with DNN predictions is a prerequisite for their trusted deployment in medical settings. Here we apply and evaluate three uncertainty quantification techniques for COVID-19 detection using chest X-Ray (CXR) images. The novel concept of uncertainty confusion matrix is proposed and new performance metrics for the objective evaluation of uncertainty estimates are introduced. Through comprehensive experiments, it is shown that networks pertained on CXR images outperform networks pretrained on natural image datasets such as ImageNet. Qualitatively and quantitatively evaluations also reveal that the predictive uncertainty estimates are statistically higher for erroneous predictions than correct predictions. Accordingly, uncertainty quantification methods are capable of flagging risky predictions with high uncertainty estimates. We also observe that ensemble methods more reliably capture uncertainties during the inference. DNN-based solutions for COVID-19 detection have been mainly proposed without any principled mechanism for risk mitigation. Previous studies have mainly focused on on generating single-valued predictions using pretrained DNNs. In this paper, we comprehensively apply and comparatively evaluate three uncertainty quantification techniques for COVID-19 detection using chest X-Ray images. The novel concept of uncertainty confusion matrix is proposed and new performance metrics for the objective evaluation of uncertainty estimates are introduced for the first time. Using these new uncertainty performance metrics, we quantitatively demonstrate where and when we could trust DNN predictions for COVID-19 detection from chest X-rays. It is important to note the proposed novel uncertainty evaluation metrics are generic and could be applied for evaluation of probabilistic forecasts in all classification problems.

scholarly journals Digital Image Segmentation Resulting from X-Rays of Covid Patients using K-Means and Extraction Features Method

2021 ◽  
Vol 3 (1) ◽  
pp. 25-28
Author(s):  
Dhian Satria Yudha Kartika ◽  
Anita Wulansari ◽  
Hendra Maulana ◽  
Eristya Maya Safitri ◽  
Faisal Muttaqin
Keyword(s):  
Digital Image ◽  
Confusion Matrix ◽  
Health Sector ◽  
X Rays ◽  
Social Psychological ◽  
Uniform Size ◽  
X Ray ◽  
X Ray Imaging ◽  
Standard Quality ◽  
Chest X Ray

The COVID-19 pandemic has significant impact on people's lives such as economic, social, psychological and health conditions. The health sector, which is spearheading the handling of the outbreak, has conducted a lot of research and trials related to COVID-19. Coughing is a common symptoms among humans affected by COVID-19 in earlier stage. The first step when a patient shows symptoms of COVID-19 was to conduct a chest x-ray imaging. The chest x-rayss can be used as a digital image dataset for analysing  the spread of the virus that enters the lungs or respiratory tract. In this study, 864 x-rays  were used as datasets. The images were still raw, taken directly from Covid-19 patients, so there were still a lot of noise. The process to remove unnecessary images would be carried out in the pre-processing stage. The images used as datasets were not mixed with the background which can reduce the value at the next stage. All datasets were made to have a uniform size and pixels to obtain a standard quality and size in order to support the next stage, namely segmentation. The segmentation stage of the x-ray datasets of Covid-19 patients was carried out using the k-means method and feature extraction. The Confusion Matrix method used as testing process. The accuracy value was 78.5%. The results of this testing process were 78.5% of precision value, 78% of recall and  79% for f-measure

Deep Neural Network-Based Screening Model for COVID-19-Infected Patients Using Chest X-Ray Images

2020 ◽  
pp. 2151004 ◽  
Author(s):  
Dilbag Singh ◽  
Vijay Kumar ◽  
Vaishali Yadav ◽  
Manjit Kaur
Keyword(s):  
Neural Network ◽  
Performance Metrics ◽  
Automated Analysis ◽  
X Rays ◽  
X Ray ◽  
Screening Model ◽  
X Ray Imaging ◽  
Adaptive Differential Evolution ◽  
Chest X Ray ◽  
Almost All

There are limited coronavirus disease 2019 (COVID-19) testing kits, therefore, development of other diagnosis approaches is desirable. The doctors generally utilize chest X-rays and Computed Tomography (CT) scans to diagnose pneumonia, lung inflammation, abscesses, and/or enlarged lymph nodes. Since COVID-19 attacks the epithelial cells that line our respiratory tract, therefore, X-ray images are utilized in this paper, to classify the patients with infected (COVID-19 [Formula: see text]ve) and uninfected (COVID-19 [Formula: see text]ve) lungs. Almost all hospitals have X-ray imaging machines, therefore, the chest X-ray images can be used to test for COVID-19 without utilizing any kind of dedicated test kits. However, the chest X-ray-based COVID-19 classification requires a radiology expert and significant time, which is precious when COVID-19 infection is increasing at a rapid rate. Therefore, the development of an automated analysis approach is desirable to save the medical professionals’ valuable time. In this paper, a deep convolutional neural network (CNN) approach is designed and implemented. Besides, the hyper-parameters of CNN are tuned using Multi-objective Adaptive Differential Evolution (MADE). Extensive experiments are performed by considering the benchmark COVID-19 dataset. Comparative analysis reveals that the proposed technique outperforms the competitive machine learning models in terms of various performance metrics.

scholarly journals Labelling chest x-ray reports using an open-source NLP and ML tool for text data binary classification

2019 ◽  
Author(s):  
Sohrab Towfighi ◽  
Arnav Agarwal ◽  
Denise Y. F. Mak ◽  
Amol Verma
Keyword(s):  
Internal Medicine ◽  
Language Processing ◽  
Performance Metrics ◽  
Random Search ◽  
General Medicine ◽  
X Rays ◽  
Text Data ◽  
X Ray ◽  
Radiology Reports ◽  
Chest X Ray

AbstractThe chest x-ray is a commonly requested diagnostic test on internal medicine wards which can diagnose many acute pathologies needing intervention. We developed a natural language processing (NLP) and machine learning (ML) model to identify the presence of opacities or endotracheal intubation on chest x-rays using only the radiology report. This a preliminary report of our work and findings. Using the General Medicine Inpatient Initiative (GEMINI) dataset, housing inpatient clinical and administrative data from 7 major hospitals, we retrieved 1000 plain film radiology reports which were classified according to 4 labels by an internal medicine resident. NLP/ML models were developed to identify the following on the radiograph reports: the report is that of a chest x-ray, there is definite absence of an opacity, there is definite presence of an opacity, the report is a follow-up report with minimal details in its text, and there is an endotracheal tube in place. Our NLP/ML model development methodology included a random search of either TF-IDF or bag-of-words for vectorization along with random search of various ML models. Our Python programming scripts were made publicly available on GitHub to allow other parties to train models using their own text data. 100 randomly generated ML pipelines were compared using 10-fold cross validation on 75% of the data, while 25% of the data was left out for generalizability testing. With respect to the question of whether a chest x-ray definitely lacks an opacity, the model’s performance metrics were accuracy of 0.84, precision of 0.94, recall of 0.81, and receiver operating characteristic area under curve of 0.86. Model performance was worse when trained against a highly imbalanced dataset despite the use of an advanced oversampling technique.

scholarly journals COVID-19 Detection Using Deep Learning Algorithm on Chest X-ray Images

Biology ◽  
2021 ◽  
Vol 10 (11) ◽  
pp. 1174
Author(s):  
Shamima Akter ◽  
F. M. Javed Mehedi Shamrat ◽  
Sovon Chakraborty ◽  
Asif Karim ◽  
Sami Azam
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Statistical Significance ◽  
Confusion Matrix ◽  
Original Data ◽  
Rank Test ◽  
X Rays ◽  
X Ray ◽  
Professional Exposure ◽  
Chest X Ray

COVID-19, regarded as the deadliest virus of the 21st century, has claimed the lives of millions of people around the globe in less than two years. Since the virus initially affects the lungs of patients, X-ray imaging of the chest is helpful for effective diagnosis. Any method for automatic, reliable, and accurate screening of COVID-19 infection would be beneficial for rapid detection and reducing medical or healthcare professional exposure to the virus. In the past, Convolutional Neural Networks (CNNs) proved to be quite successful in the classification of medical images. In this study, an automatic deep learning classification method for detecting COVID-19 from chest X-ray images is suggested using a CNN. A dataset consisting of 3616 COVID-19 chest X-ray images and 10,192 healthy chest X-ray images was used. The original data were then augmented to increase the data sample to 26,000 COVID-19 and 26,000 healthy X-ray images. The dataset was enhanced using histogram equalization, spectrum, grays, cyan and normalized with NCLAHE before being applied to CNN models. Initially using the dataset, the symptoms of COVID-19 were detected by employing eleven existing CNN models; VGG16, VGG19, MobileNetV2, InceptionV3, NFNet, ResNet50, ResNet101, DenseNet, EfficientNetB7, AlexNet, and GoogLeNet. From the models, MobileNetV2 was selected for further modification to obtain a higher accuracy of COVID-19 detection. Performance evaluation of the models was demonstrated using a confusion matrix. It was observed that the modified MobileNetV2 model proposed in the study gave the highest accuracy of 98% in classifying COVID-19 and healthy chest X-rays among all the implemented CNN models. The second-best performance was achieved from the pre-trained MobileNetV2 with an accuracy of 97%, followed by VGG19 and ResNet101 with 95% accuracy for both the models. The study compares the compilation time of the models. The proposed model required the least compilation time with 2 h, 50 min and 21 s. Finally, the Wilcoxon signed-rank test was performed to test the statistical significance. The results suggest that the proposed method can efficiently identify the symptoms of infection from chest X-ray images better than existing methods.

scholarly journals A Deep Neural Network for Detecting Coronavirus Disease Using Chest X-Ray Images

2022 ◽  
Vol 17 (2) ◽  
pp. 1-27
Author(s):  
Rajeev Kumar Gupta ◽  
Nilesh Kunhare ◽  
Rajesh Kumar Pateriya ◽  
Nikhlesh Pathik
Keyword(s):  
Preliminary Test ◽  
Vital Role ◽  
World Health ◽  
Test Accuracy ◽  
X Rays ◽  
The Novel ◽  
X Ray ◽  
Chest X Ray ◽  
Health Organization ◽  
The Comparative Study

The novel Covid-19 is one of the leading cause of death worldwide in the year 2020 and declared as a pandemic by world health organization (WHO). This virus affecting all countries across the world and 5 lakh people die as of June 2020 due to Covid-19. Due to the highly contagious nature, early detection of this virus plays a vital role to break Covid chain. Recent studies done by China says that chest CT and X-Ray image may be used as a preliminary test for Covid detection. Deep learning-based CNN model can use to detect Coronavirus automatically from the chest X-rays images. This paper proposed a transfer learning-based approach to detect Covid disease. Due to the less number of Covid chest images, we are using a pre-trained model to classify X-ray images into Covid and Normal class. This paper presents the comparative study of a various pre-trained model like VGGNet-19, ResNet50 and Inception_ResNet_V2. Experiment results show that Inception_ResNet_V2 gives the better result as compare to VGGNet and ResNet model with training and test accuracy of 99.26 and 94, respectively.

scholarly journals Comparison of Classification Models Based on Deep learning on COVID-19 Chest X-Rays

2022 ◽  
Vol 2161 (1) ◽  
pp. 012078
Author(s):  
Pallavi R Mane ◽  
Rajat Shenoy ◽  
Ghanashyama Prabhu
Keyword(s):  
Deep Learning ◽  
Transfer Learning ◽  
State Of The Art ◽  
Cost Effective ◽  
X Rays ◽  
The Novel ◽  
Learning Models ◽  
X Ray ◽  
Chest X Ray ◽  
Fine Tune

Abstract COVID -19, is a deadly, dangerous and contagious disease caused by the novel corona virus. It is very important to detect COVID-19 infection accurately as quickly as possible to avoid the spreading. Deep learning methods can significantly improve the efficiency and accuracy of reading Chest X-Rays (CXRs). The existing Deep learning models with further fine tune provide cost effective, rapid, and better classification results. This paper tries to deploy well studied AI tools with modification on X-ray images to classify COVID 19. This research performs five experiments to classify COVID-19 CXRs from Normal and Viral Pneumonia CXRs using Convolutional Neural Networks (CNN). Four experiments were performed on state-of-the-art pre-trained models using transfer learning and one experiment was performed using a CNN designed from scratch. Dataset used for the experiments consists of chest X-Ray images from the Kaggle dataset and other publicly accessible sources. The data was split into three parts while 90% retained for training the models, 5% each was used in validation and testing of the constructed models. The four transfer learning models used were Inception, Xception, ResNet, and VGG19, that resulted in the test accuracies of 93.07%, 94.8%, 67.5%, and 91.1% respectively and our CNN model resulted in 94.6%.

scholarly journals Deteksi COVID-19 Berdasarkan Hasil Rontgen Dada (Chest Xray) Menggunakan Python

2021 ◽  
Vol 1 (1) ◽  
pp. 58-67
Author(s):  
Pebri Andhi Herry Pratama ◽  
Rony Teguh ◽  
Abertun Sagit Sahay ◽  
Valencia Wilentine
Keyword(s):  
Confusion Matrix ◽  
X Rays ◽  
Chest Computed Tomography ◽  
X Ray ◽  
Data Prediction ◽  
Testing Stage ◽  
Architectural Model ◽  
Chest X Ray ◽  
Lung Infections

Chest X-ray have an important function in the three areas of healthcare, namely diagnosis, treatment and re-examination. Studies from China suggest Chest Radiographs (X-Ray) and Chest Computed Comography (CT) scans can help diagnose COVID-19. Therefore, chest x-rays (x-rays) and chest computed tomography (CT) are appropriate methods for lung infections due to COVID-19. Based on this, the authors tried to make a model for the classification of digital images of Chest X-Ray results with the labels of Normal, Pneumonia, Tuberculosis (TBC), and COVID-19. Through the resulting model, the best model to use will be compared. The method used to create this model is through training and testing the dataset using the Convolutional Neural Network (CNN) architectural model, namely VGG19, ResNet50, and InceptionV3. The number of images used is 1,000 Chest X-Ray images. The dataset is divided into training and validation datasets in several ratios of 20% : 80%, 50%: 50%, and 80%: 20%. While testing uses 10% from train datset chest x-ray images as a confusion matrix dataset and 4 chest x-ray images as a prediction dataset. From the results of the research that has been done, the best model is VGG19 at 41 of 61 epoch and a ratio of 20% : 80%. Where the VGG19 model produces 94.44% for accuracy and 0,1084 loss value for training. Whereas at the testing stage with a configuration matrix, 95% accuracy value was obtained. Then for testing the new data prediction produces the best accuracy with 98.97% accuracy for the Normal label, 99.16% for COVID-19, 99.56% for Pneumonia, and 99.79% for Tuberculosis (TBC).

scholarly journals Role of Hybrid Deep Neural Networks (HDNNs), Computed Tomography, and Chest X-rays for the Detection of COVID-19

2021 ◽  
Vol 18 (6) ◽  
pp. 3056
Author(s):  
Muhammad Irfan ◽  
Muhammad Aksam Iftikhar ◽  
Sana Yasin ◽  
Umar Draz ◽  
Tariq Ali ◽  
...  
Keyword(s):  
Neural Network ◽  
Computed Tomography ◽  
Neural Networks ◽  
Deep Neural Network ◽  
Deep Neural Networks ◽  
Confusion Matrix ◽  
X Rays ◽  
Data Repositories ◽  
X Ray ◽  
Chest X Ray

COVID-19 syndrome has extensively escalated worldwide with the induction of the year 2020 and has resulted in the illness of millions of people. COVID-19 patients bear an elevated risk once the symptoms deteriorate. Hence, early recognition of diseased patients can facilitate early intervention and avoid disease succession. This article intends to develop a hybrid deep neural networks (HDNNs), using computed tomography (CT) and X-ray imaging, to predict the risk of the onset of disease in patients suffering from COVID-19. To be precise, the subjects were classified into 3 categories namely normal, Pneumonia, and COVID-19. Initially, the CT and chest X-ray images, denoted as ‘hybrid images’ (with resolution 1080 × 1080) were collected from different sources, including GitHub, COVID-19 radiography database, Kaggle, COVID-19 image data collection, and Actual Med COVID-19 Chest X-ray Dataset, which are open source and publicly available data repositories. The 80% hybrid images were used to train the hybrid deep neural network model and the remaining 20% were used for the testing purpose. The capability and prediction accuracy of the HDNNs were calculated using the confusion matrix. The hybrid deep neural network showed a 99% classification accuracy on the test set data.

COVID-19 Detection Using Chest X-Ray and Transfer Learning

2021 ◽  
pp. 171-186
Author(s):  
Aditya Sharma ◽  
Arshdeep Singh Chudey ◽  
Mrityunjay Singh
Keyword(s):  
Performance Evaluation ◽  
Deep Learning ◽  
Confusion Matrix ◽  
Receiver Operating Curve ◽  
The Novel ◽  
Learning Models ◽  
X Ray ◽  
Major Outbreak ◽  
Chest X Ray ◽  
Novel Coronavirus

The novel coronavirus (COVID-19), which started in the Wuhan province of China, prompted a major outbreak that culminated in a worldwide pandemic. Several cases are being recorded across the globe, with deaths being close to 2.5 million. The increased number of cases and the newness of such a pandemic has resulted in the hospitals being under-equipped leading to problems in diagnosis of the disease. From previous studies, radiography has proved to be the fastest testing method. A screening test using the x-ray scan of the chest region has proved to be effective. For this method, a trained radiologist is needed to detect the disease. Automating this process using deep learning models can prove to be effective. Due to the lack of large dataset, pre-trained CNN models are used in this study. Several models have been employed like VGG-16, Resnet-50, InceptionV3, and InceptionResnetV2. Resnet-50 provided the best accuracy of 98.3%. The performance evaluation has been done using metrics like receiver operating curve and confusion matrix.

Spontaneous Pneumomediastinum: Uncommon Cause of Air Leak in Late Preterm Neonate

2021 ◽  
Vol 35 (2) ◽  
pp. 93-94
Author(s):  
Jyotsna Bhushan ◽  
Shagufta Iqbal ◽  
Abhishek Chopra
Keyword(s):  
Respiratory Distress ◽  
Conservative Management ◽  
Preterm Neonate ◽  
Late Preterm ◽  
Intravenous Fluids ◽  
X Rays ◽  
Blood Gas ◽  
X Ray ◽  
Spontaneous Pneumomediastinum ◽  
Chest X Ray

A clinical case report of spontaneous pneumomediastinum in a late-preterm neonate, chest x-ray showing classical “spinnaker sail sign,” which was managed conservatively and had excellent prognosis on conservative management. Respiratory distress in a preterm neonate is a common clinical finding. Common causes include respiratory distress syndrome, transient tachypnea of the newborn, pneumonia, and pneumothorax. Pneumomediastinum is not very common cause of respiratory distress and more so spontaneous pneumomediastinum. We report here a preterm neonate with spontaneous pneumomediastinum who had excellent clinical recovery with conservative management. A male baby was delivered to G3P1A1 mother at 34 + 6 weeks through caesarean section done due to abruptio placenta. Apgar scores were 8 and 9. Maternal antenatal history was uneventful and there were no risk factors for early onset sepsis. Baby had respiratory distress soon after birth with Silverman score being 2/10. Baby was started on oxygen (O2) by nasal prongs through blender 0.5 l/min, FiO2 25%, and intravenous fluids. Blood gas done was normal. Possibility of transient tachypnea of newborn or mild hyaline membrane disease was kept. Respiratory distress increased at 20 h of life (Silverman score: 5), urgent chest x-ray done revealed “spinnaker sign” suggestive of pneumomediastinum, so baby was shifted to O2 by hood with FiO2 being 70%. Blood gas repeated was normal. Baby was managed conservatively on intravenous fluids and O2 by hood. Baby was gradually weaned off from O2 over next 5 days. As respiratory distress decreased, baby was started on orogastric feed, which baby tolerated well and then was switched to oral feeds. Serial x-rays showed resolution of pneumomediastinum. Baby was discharged on day 7 of life in stable condition on breast feeds and room air.

Sign in / Sign up

Export Citation Format

Share Document