Diagnosing heart failure from chest X-ray images using deep learning

Abstract The development of deep learning technology has enabled machines to achieve high-level accuracy in interpreting medical images. While many previous studies have examined the detection of pulmonary nodules and cardiomegaly in chest X-rays using deep learning, the application of this technology to heart failure remains rare. In this study, we investigated the performance of a deep learning algorithm in terms of diagnosing heart failure using images obtained from chest X-rays. We used 952 chest X-ray images from a labeled database published by the National Institutes of Health. Two cardiologists respectively verified and relabeled these images, for a total of 260 “normal” and 378 “heart failure” images, and the remainder were discarded because they had been incorrectly labeled. In this study “heart failure” was defined as “cardiomegaly or congestion”, in a chest X-ray with cardiothoracic ratio (CTR) over 50% or radiographic presence of pulmonary edema. To enable the machine to extract a sufficient number of features from the images, we used the general machine learning approach called data augmentation and transfer learning. Owing mostly to this technique and the adequate relabeling process, we established a model to detect heart failure in chest X-ray by applying deep learning, and obtained an accuracy of 82%. Sensitivity and specificity to heart failure were 75% and 94.4%, respectively. Furthermore, heatmap imaging allowed us to visualize decisions made by the machine. The figure shows randomly selected examples of the prediction probabilities and heatmaps of the chest X-rays from the dataset. The original image is on the left and its heatmap is on the right, with its prediction probability written below. The red areas on the heatmaps show important regions, according to which the machine determined the classification. While some images with ambiguous radiolucency such as (e) and (f) were prone to be misdiagnosed by this model, most of the images like (a)–(d) were diagnosed correctly. Deep learning can thus help support the diagnosis of heart failure using chest X-ray images. Heatmaps and probabilities of prediction Funding Acknowledgement Type of funding source: Public grant(s) – National budget only. Main funding source(s): JSPS KAKENHI

Download Full-text

COVID-19 Pneumonia Detection Using Optimized Deep Learning Techniques

Diagnostics ◽

10.3390/diagnostics11111972 ◽

2021 ◽

Vol 11 (11) ◽

pp. 1972

Author(s):

Abul Bashar ◽

Ghazanfar Latif ◽

Ghassen Ben Brahim ◽

Nazeeruddin Mohammad ◽

Jaafar Alghazo

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Data Augmentation ◽

Learning Algorithm ◽

The Body ◽

X Rays ◽

X Ray ◽

Clinical Observations ◽

Dataset Size ◽

Chest X Ray

It became apparent that mankind has to learn to live with and adapt to COVID-19, especially because the developed vaccines thus far do not prevent the infection but rather just reduce the severity of the symptoms. The manual classification and diagnosis of COVID-19 pneumonia requires specialized personnel and is time consuming and very costly. On the other hand, automatic diagnosis would allow for real-time diagnosis without human intervention resulting in reduced costs. Therefore, the objective of this research is to propose a novel optimized Deep Learning (DL) approach for the automatic classification and diagnosis of COVID-19 pneumonia using X-ray images. For this purpose, a publicly available dataset of chest X-rays on Kaggle was used in this study. The dataset was developed over three stages in a quest to have a unified COVID-19 entities dataset available for researchers. The dataset consists of 21,165 anterior-to-posterior and posterior-to-anterior chest X-ray images classified as: Normal (48%), COVID-19 (17%), Lung Opacity (28%) and Viral Pneumonia (6%). Data Augmentation was also applied to increase the dataset size to enhance the reliability of results by preventing overfitting. An optimized DL approach is implemented in which chest X-ray images go through a three-stage process. Image Enhancement is performed in the first stage, followed by Data Augmentation stage and in the final stage the results are fed to the Transfer Learning algorithms (AlexNet, GoogleNet, VGG16, VGG19, and DenseNet) where the images are classified and diagnosed. Extensive experiments were performed under various scenarios, which led to achieving the highest classification accuracy of 95.63% through the application of VGG16 transfer learning algorithm on the augmented enhanced dataset with freeze weights. This accuracy was found to be better as compared to the results reported by other methods in the recent literature. Thus, the proposed approach proved superior in performance as compared with that of other similar approaches in the extant literature, and it made a valuable contribution to the body of knowledge. Although the results achieved so far are promising, further work is planned to correlate the results of the proposed approach with clinical observations to further enhance the efficiency and accuracy of COVID-19 diagnosis.

Download Full-text

COVID-19 Detection Using Deep Learning Algorithm on Chest X-ray Images

Biology ◽

10.3390/biology10111174 ◽

2021 ◽

Vol 10 (11) ◽

pp. 1174

Author(s):

Shamima Akter ◽

F. M. Javed Mehedi Shamrat ◽

Sovon Chakraborty ◽

Asif Karim ◽

Sami Azam

Keyword(s):

Deep Learning ◽

Learning Algorithm ◽

Statistical Significance ◽

Confusion Matrix ◽

Original Data ◽

Rank Test ◽

X Rays ◽

X Ray ◽

Professional Exposure ◽

Chest X Ray

COVID-19, regarded as the deadliest virus of the 21st century, has claimed the lives of millions of people around the globe in less than two years. Since the virus initially affects the lungs of patients, X-ray imaging of the chest is helpful for effective diagnosis. Any method for automatic, reliable, and accurate screening of COVID-19 infection would be beneficial for rapid detection and reducing medical or healthcare professional exposure to the virus. In the past, Convolutional Neural Networks (CNNs) proved to be quite successful in the classification of medical images. In this study, an automatic deep learning classification method for detecting COVID-19 from chest X-ray images is suggested using a CNN. A dataset consisting of 3616 COVID-19 chest X-ray images and 10,192 healthy chest X-ray images was used. The original data were then augmented to increase the data sample to 26,000 COVID-19 and 26,000 healthy X-ray images. The dataset was enhanced using histogram equalization, spectrum, grays, cyan and normalized with NCLAHE before being applied to CNN models. Initially using the dataset, the symptoms of COVID-19 were detected by employing eleven existing CNN models; VGG16, VGG19, MobileNetV2, InceptionV3, NFNet, ResNet50, ResNet101, DenseNet, EfficientNetB7, AlexNet, and GoogLeNet. From the models, MobileNetV2 was selected for further modification to obtain a higher accuracy of COVID-19 detection. Performance evaluation of the models was demonstrated using a confusion matrix. It was observed that the modified MobileNetV2 model proposed in the study gave the highest accuracy of 98% in classifying COVID-19 and healthy chest X-rays among all the implemented CNN models. The second-best performance was achieved from the pre-trained MobileNetV2 with an accuracy of 97%, followed by VGG19 and ResNet101 with 95% accuracy for both the models. The study compares the compilation time of the models. The proposed model required the least compilation time with 2 h, 50 min and 21 s. Finally, the Wilcoxon signed-rank test was performed to test the statistical significance. The results suggest that the proposed method can efficiently identify the symptoms of infection from chest X-ray images better than existing methods.

Download Full-text

CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV

npj Digital Medicine ◽

10.1038/s41746-020-00322-2 ◽

2020 ◽

Vol 3 (1) ◽

Author(s):

Pranav Rajpurkar ◽

Chloe O’Connell ◽

Amit Schechter ◽

Nishit Asnani ◽

Jason Li ◽

...

Keyword(s):

Deep Learning ◽

Learning Algorithm ◽

Clinical Information ◽

Hiv Positive ◽

X Rays ◽

Web Based ◽

X Ray ◽

Deep Learning Algorithm ◽

Learning Assistance ◽

Chest X Ray

Abstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortages in regions where co-infection is most common. We developed a deep learning algorithm to diagnose TB using clinical information and chest x-ray images from 677 HIV-positive patients with suspected TB from two hospitals in South Africa. We then sought to determine whether the algorithm could assist clinicians in the diagnosis of TB in HIV-positive patients as a web-based diagnostic assistant. Use of the algorithm resulted in a modest but statistically significant improvement in clinician accuracy (p = 0.002), increasing the mean clinician accuracy from 0.60 (95% CI 0.57, 0.63) without assistance to 0.65 (95% CI 0.60, 0.70) with assistance. However, the accuracy of assisted clinicians was significantly lower (p < 0.001) than that of the stand-alone algorithm, which had an accuracy of 0.79 (95% CI 0.77, 0.82) on the same unseen test cases. These results suggest that deep learning assistance may improve clinician accuracy in TB diagnosis using chest x-rays, which would be valuable in settings with a high burden of HIV/TB co-infection. Moreover, the high accuracy of the stand-alone algorithm suggests a potential value particularly in settings with a scarcity of radiological expertise.

Download Full-text

Improved COVID-19 detection using data augmentation Deep Convolution GAN and classifier DenseNet.

10.21203/rs.3.rs-235624/v1 ◽

2021 ◽

Author(s):

Debmitra Ghosh

Keyword(s):

Neural Network ◽

Deep Learning ◽

Classification Accuracy ◽

Deep Neural Network ◽

Data Augmentation ◽

Training Data ◽

X Rays ◽

X Ray ◽

Chest X Ray ◽

Synthetic Images

Abstract SARS-CoV-2 or severe acute respiratory syndrome coronavirus 2 is considered to be the cause of Coronavirus (COVID-19) which is a viral disease. The rapid spread of COVID-19 is having a detrimental effect on the global economy and health. A chest X-ray of infected patients can be considered as a crucial step in the battle against COVID-19. On retrospections, it is found that abnormalities exist in chest X-rays of patients suggestive of COVID-19. This sparked the introduction of a variety of deep learning systems and studies which have shown that the accuracy of COVID-19 patient detection through the use of chest X-rays is strongly optimistic. Although there are certain shortcomings like deep learning networks like convolutional neural networks (CNNs) need a substantial amount of training data but the outbreak is recent, so it is large datasets of radiographic images of the COVID-19 infected patients are not available in such a short time. Here, in this research, we present a method to generate synthetic chest X-ray (CXR) images by developing a Deep Convolution Generative Adversarial Network-based model. In addition, we demonstrate that the synthetic images produced from DCGAN can be utilized to enhance the performance of CNN for COVID-19 detection. Classification using CNN alone yielded 85% accuracy. Although there are several models available, we chose MobileNet as it is a lightweight deep neural network, with fewer parameters and higher classification accuracy. Here we are using a deep neural network-based model to diagnose COVID-19 infected patients through radiological imaging of 5,859 Chest X-Ray images. We are using a Deep Convolutional Neural Network and a pre-trained model “DenseNet 121” for two new label classes (COVID-19 and Normal). To improve the classification accuracy, in our work we have further reduced the number of network parameters by introducing dense blocks that are proposed in DenseNets into MobileNet. By adding synthetic images produced by DCGAN, the accuracy increased to 97%. Our goal is to use this method to speed up COVID-19 detection and lead to more robust systems of radiology.

Download Full-text

Accessory pathway analysis using a multimodal deep learning model

Scientific Reports ◽

10.1038/s41598-021-87631-y ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Makoto Nishimori ◽

Kunihiko Kiuchi ◽

Kunihiro Nishimura ◽

Kengo Kusano ◽

Akihiro Yoshida ◽

...

Keyword(s):

Deep Learning ◽

Electrophysiological Study ◽

Accessory Pathway ◽

Learning Model ◽

X Rays ◽

X Ray ◽

Wpw Syndrome ◽

Chest X Ray ◽

Deep Learning Model ◽

Ecg Data

AbstractCardiac accessory pathways (APs) in Wolff–Parkinson–White (WPW) syndrome are conventionally diagnosed with decision tree algorithms; however, there are problems with clinical usage. We assessed the efficacy of the artificial intelligence model using electrocardiography (ECG) and chest X-rays to identify the location of APs. We retrospectively used ECG and chest X-rays to analyse 206 patients with WPW syndrome. Each AP location was defined by an electrophysiological study and divided into four classifications. We developed a deep learning model to classify AP locations and compared the accuracy with that of conventional algorithms. Moreover, 1519 chest X-ray samples from other datasets were used for prior learning, and the combined chest X-ray image and ECG data were put into the previous model to evaluate whether the accuracy improved. The convolutional neural network (CNN) model using ECG data was significantly more accurate than the conventional tree algorithm. In the multimodal model, which implemented input from the combined ECG and chest X-ray data, the accuracy was significantly improved. Deep learning with a combination of ECG and chest X-ray data could effectively identify the AP location, which may be a novel deep learning model for a multimodal model.

Download Full-text

Evaluation of Scalability and Degree of Fine-Tuning of Deep Convolutional Neural Networks for COVID-19 Screening on Chest X-ray Images Using Explainable Deep-Learning Algorithm

Journal of Personalized Medicine ◽

10.3390/jpm10040213 ◽

2020 ◽

Vol 10 (4) ◽

pp. 213 ◽

Cited By ~ 1

Author(s):

Ki-Sun Lee ◽

Jae Young Kim ◽

Eun-tae Jeon ◽

Won Suk Choi ◽

Nan Hee Kim ◽

...

Keyword(s):

Deep Learning ◽

Learning Strategies ◽

Transfer Learning ◽

Learning Algorithm ◽

Fine Tuning ◽

Deep Convolutional Neural Networks ◽

X Ray ◽

Backbone Network ◽

Deep Learning Algorithm ◽

Chest X Ray

According to recent studies, patients with COVID-19 have different feature characteristics on chest X-ray (CXR) than those with other lung diseases. This study aimed at evaluating the layer depths and degree of fine-tuning on transfer learning with a deep convolutional neural network (CNN)-based COVID-19 screening in CXR to identify efficient transfer learning strategies. The CXR images used in this study were collected from publicly available repositories, and the collected images were classified into three classes: COVID-19, pneumonia, and normal. To evaluate the effect of layer depths of the same CNN architecture, CNNs called VGG-16 and VGG-19 were used as backbone networks. Then, each backbone network was trained with different degrees of fine-tuning and comparatively evaluated. The experimental results showed the highest AUC value to be 0.950 concerning COVID-19 classification in the experimental group of a fine-tuned with only 2/5 blocks of the VGG16 backbone network. In conclusion, in the classification of medical images with a limited number of data, a deeper layer depth may not guarantee better results. In addition, even if the same pre-trained CNN architecture is used, an appropriate degree of fine-tuning can help to build an efficient deep learning model.

Download Full-text

An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare

Journal of Healthcare Engineering ◽

10.1155/2019/4180949 ◽

2019 ◽

Vol 2019 ◽

pp. 1-7 ◽

Cited By ~ 44

Author(s):

Okeke Stephen ◽

Mangal Sain ◽

Uchenna Joseph Maduh ◽

Do-Un Jeong

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Network Model ◽

Neural Network Model ◽

Data Augmentation ◽

Classification Performance ◽

Learning Approaches ◽

X Ray ◽

Chest X Ray

This study proposes a convolutional neural network model trained from scratch to classify and detect the presence of pneumonia from a collection of chest X-ray image samples. Unlike other methods that rely solely on transfer learning approaches or traditional handcrafted techniques to achieve a remarkable classification performance, we constructed a convolutional neural network model from scratch to extract features from a given chest X-ray image and classify it to determine if a person is infected with pneumonia. This model could help mitigate the reliability and interpretability challenges often faced when dealing with medical imagery. Unlike other deep learning classification tasks with sufficient image repository, it is difficult to obtain a large amount of pneumonia dataset for this classification task; therefore, we deployed several data augmentation algorithms to improve the validation and classification accuracy of the CNN model and achieved remarkable validation accuracy.

Download Full-text

Detecting Coronavirus from Chest X-rays Using Transfer Learning

COVID ◽

10.3390/covid1010034 ◽

2021 ◽

Vol 1 (1) ◽

pp. 403-415

Author(s):

Abeer Badawi ◽

Khalid Elgazzar

Keyword(s):

Deep Learning ◽

Binary Classification ◽

Healthcare Providers ◽

Large Set ◽

X Rays ◽

Learning Models ◽

X Ray ◽

Chest X Ray ◽

Multi Class Classification ◽

Novel Coronavirus

Coronavirus disease (COVID-19) is an illness caused by a novel coronavirus family. One of the practical examinations for COVID-19 is chest radiography. COVID-19 infected patients show abnormalities in chest X-ray images. However, examining the chest X-rays requires a specialist with high experience. Hence, using deep learning techniques in detecting abnormalities in the X-ray images is presented commonly as a potential solution to help diagnose the disease. Numerous research has been reported on COVID-19 chest X-ray classification, but most of the previous studies have been conducted on a small set of COVID-19 X-ray images, which created an imbalanced dataset and affected the performance of the deep learning models. In this paper, we propose several image processing techniques to augment COVID-19 X-ray images to generate a large and diverse dataset to boost the performance of deep learning algorithms in detecting the virus from chest X-rays. We also propose innovative and robust deep learning models, based on DenseNet201, VGG16, and VGG19, to detect COVID-19 from a large set of chest X-ray images. A performance evaluation shows that the proposed models outperform all existing techniques to date. Our models achieved 99.62% on the binary classification and 95.48% on the multi-class classification. Based on these findings, we provide a pathway for researchers to develop enhanced models with a balanced dataset that includes the highest available COVID-19 chest X-ray images. This work is of high interest to healthcare providers, as it helps to better diagnose COVID-19 from chest X-rays in less time with higher accuracy.

Download Full-text

An Effective Convolutional Neural Network Model for the Early Detection of COVID-19 Using Chest X-ray Images

Applied Sciences ◽

10.3390/app112110301 ◽

2021 ◽

Vol 11 (21) ◽

pp. 10301

Author(s):

Muhammad Shoaib Farooq ◽

Attique Ur Rehman ◽

Muhammad Idrees ◽

Muhammad Ahsan Raza ◽

Jehad Ali ◽

...

Keyword(s):

Neural Network ◽

Deep Learning ◽

Convolutional Neural Network ◽

Real World ◽

Early Stage ◽

Binary Classification ◽

X Rays ◽

X Ray ◽

Proposed Model ◽

Chest X Ray

COVID-19 has been difficult to diagnose and treat at an early stage all over the world. The numbers of patients showing symptoms for COVID-19 have caused medical facilities at hospitals to become unavailable or overcrowded, which is a major challenge. Studies have recently allowed us to determine that COVID-19 can be diagnosed with the aid of chest X-ray images. To combat the COVID-19 outbreak, developing a deep learning (DL) based model for automated COVID-19 diagnosis on chest X-ray is beneficial. In this research, we have proposed a customized convolutional neural network (CNN) model to detect COVID-19 from chest X-ray images. The model is based on nine layers which uses a binary classification method to differentiate between COVID-19 and normal chest X-rays. It provides COVID-19 detection early so the patients can be admitted in a timely fashion. The proposed model was trained and tested on two publicly available datasets. Cross-dataset studies are used to assess the robustness in a real-world context. Six hundred X-ray images were used for training and two hundred X-rays were used for validation of the model. The X-ray images of the dataset were preprocessed to improve the results and visualized for better analysis. The developed algorithm reached 98% precision, recall and f1-score. The cross-dataset studies also demonstrate the resilience of deep learning algorithms in a real-world context with 98.5 percent accuracy. Furthermore, a comparison table was created which shows that our proposed model outperforms other relative models in terms of accuracy. The quick and high-performance of our proposed DL-based customized model identifies COVID-19 patients quickly, which is helpful in controlling the COVID-19 outbreak.

Download Full-text

Performance of a deep learning CNN model for the automated detection of 13 common conditions on Chest X-rays

10.36227/techrxiv.16725727 ◽

2021 ◽

Author(s):

Tirupathi Karthik ◽

Vijayalakshmi Kasiraman ◽

Bhavani Paski ◽

Kashyap Gurram ◽

Amit Talwar ◽

...

Keyword(s):

Deep Learning ◽

Learning Algorithm ◽

Delayed Diagnosis ◽

Cost Effective ◽

Radiology Workflow ◽

X Rays ◽

Term Care ◽

X Ray ◽

Intelligence System ◽

Deep Learning Algorithm

Background and aims: Chest X-rays are widely used, non-invasive, cost effective imaging tests. However, the complexity of interpretation and global shortage of radiologists have led to reporting backlogs, delayed diagnosis and a compromised quality of care. A fully automated, reliable artificial intelligence system that can quickly triage abnormal images for urgent radiologist review would be invaluable in the clinical setting. The aim was to develop and validate a deep learning Convoluted Neural Network algorithm to automate the detection of 13 common abnormalities found on Chest X-rays. Method: In this retrospective study, a VGG 16 deep learning model was trained on images from the Chest-ray 14, a large publicly available Chest X-ray dataset, containing over 112,120 images with annotations. Images were split into training, validation and testing sets and trained to identify 13 specific abnormalities. The primary performance measures were accuracy and precision. Results: The model demonstrated an overall accuracy of 88% in the identification of abnormal X-rays and 87% in the detection of 13 common chest conditions with no model bias. Conclusion: This study demonstrates that a well-trained deep learning algorithm can accurately identify multiple abnormalities on X-ray images. As such models get further refined, they can be used to ease radiology workflow bottlenecks and improve reporting efficiency. Napier Healthcare’s team that developed this model consists of medical IT professionals who specialize in AI and its practical application in acute & long-term care settings. This is currently being piloted in a few hospitals and diagnostic labs on a commercial basis.

Download Full-text