scholarly journals IMPLEMENTASI TRANSFER LEARNING PADA CONVOLUTIONAL NEURAL NETWORK UNTUK DIAGNOSIS COVID-19 DAN PNEUMONIA PADA CITRA X-RAY

2021 ◽  
Vol 2 (1) ◽  
pp. 10-15
Author(s):  
Alexander Eric Wijaya ◽  
Windra Swastika ◽  
Oesman Hendra Kelana
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Model ◽  
Head Model ◽  
X Ray

COVID-19 menjadi salah satu masalah yang besar bagi banyak negara di dunia sejak tahun 2020. COVID-19 dan Pneumonia memiliki kemiripan dalam hal gejala seperti batuk dan sesak napas. Upaya diagnosis COVID-19 dan Pneumonia dilakukan dengan pemeriksaan laboratorium dan juga rontgen dada. Citra hasil x-ray dada pasien COVID-19 memiliki kesamaan dengan hasil x-ray pasien Pneumonia tetapi ahli radiologi berhasil menemukan bahwa terdapat perbedaan antara citra x-ray dada penderita COVID-19 dengan citra x-ray dada pasien Pneumonia dimana terdapat pola seperti kaca yang ditumbuk pada hasil citra X-ray penderita virus Corona.Diagnosis pada citra x-ray dada pasien menggunakan model Deep Learning. Pada penelitian ini juga akan membandingkan performa model Xception menggunakan Transfer Learning dengan performa model Xception tanpa Transfer Learning. Terdapat 4 eksperimen konfigurasi pada model Xception tanpa Transfer yaitu konfigurasi pelatihan layer base model, pelatihan base model, pelatihan custom head model, dan pelatihan pada layer base model serta custom head model. Terdapat 2 eksperimen menggunakan model Resnet50 dan VGG16 tanpa Transfer Learning. Model Xception menggunakan Transfer Learning memiliki performa lebih baik daripada model Xception tanpa Transfer Learning. Keempat eksperimen model Xception tanpa Transfer Learning dan kedua eksperimen dengan model Resnet serta VGG16 memiliki akurasi diatas 85%. Namun keenam model tanpa Transfer Learning tersebut tidak mampu mengenali Pneumonia pada citra x-ray dada pasien.

scholarly journals Development and Validation of an Arterial Pressure-Based Cardiac Output Algorithm Using a Convolutional Neural Network: Retrospective Study Based on Prospective Registry Data

10.2196/24762 ◽  
2021 ◽  
Vol 9 (8) ◽  
pp. e24762
Author(s):  
Hyun-Lim Yang ◽  
Chul-Woo Jung ◽  
Seong Mi Yang ◽  
Min-Soo Kim ◽  
Sungho Shim ◽  
...  
Keyword(s):  
Neural Network ◽  
Cardiac Output ◽  
Deep Learning ◽  
Retrospective Study ◽  
Arterial Pressure ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Model ◽  
Learning Technique ◽  
Deep Learning Model

Background Arterial pressure-based cardiac output (APCO) is a less invasive method for estimating cardiac output without concerns about complications from the pulmonary artery catheter (PAC). However, inaccuracies of currently available APCO devices have been reported. Improvements to the algorithm by researchers are impossible, as only a subset of the algorithm has been released. Objective In this study, an open-source algorithm was developed and validated using a convolutional neural network and a transfer learning technique. Methods A retrospective study was performed using data from a prospective cohort registry of intraoperative bio-signal data from a university hospital. The convolutional neural network model was trained using the arterial pressure waveform as input and the stroke volume (SV) value as the output. The model parameters were pretrained using the SV values from a commercial APCO device (Vigileo or EV1000 with the FloTrac algorithm) and adjusted with a transfer learning technique using SV values from the PAC. The performance of the model was evaluated using absolute error for the PAC on the testing dataset from separate periods. Finally, we compared the performance of the deep learning model and the FloTrac with the SV values from the PAC. Results A total of 2057 surgical cases (1958 training and 99 testing cases) were used in the registry. In the deep learning model, the absolute errors of SV were 14.5 (SD 13.4) mL (10.2 [SD 8.4] mL in cardiac surgery and 17.4 [SD 15.3] mL in liver transplantation). Compared with FloTrac, the absolute errors of the deep learning model were significantly smaller (16.5 [SD 15.4] and 18.3 [SD 15.1], P<.001). Conclusions The deep learning–based APCO algorithm showed better performance than the commercial APCO device. Further improvement of the algorithm developed in this study may be helpful for estimating cardiac output accurately in clinical practice and optimizing high-risk patient care.

On The Effect Of Decomposition Granularity On DeTraC For COVID-19 Detection Using Chest X-Ray Images

2021 ◽  
Author(s):  
Nicole P. Mugova ◽  
Mohammed M. Abdelsamea ◽  
Mohamed M. Gaber
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Learning Model ◽  
Deep Convolutional Neural Network ◽  
Experimental Results ◽  
Number Of Clusters ◽  
X Ray ◽  
Chest X Ray ◽  
Deep Learning Model

Covid-19 is a growing issue in society and there is a need for resources to manage the disease. This paper looks at studying the effect of class decomposition in our previously proposed deep Convolutional Neural Network, called DeTraC (Decompose, Transfer and Compose). DeTraC has the ability to robustly detect and predict Covid-19 from chest X-ray images. The experimental results showed that changing the number of clusters affected the performance of DeTraC and influenced the accuracy of the model. As the number of clusters increased, the accuracy decreased for the shallow tuning mode but increased for the deep tuning mode. This shows the importance of using suitable hyperparameter settings in order to get the best results from a deep learning model. The highest accuracy obtained, in this study, was 98.33% from the deep tuning model.

scholarly journals Development and validation of an arterial pressure-based cardiac output algorithm using a convolutional neural network: Retrospective study based on prospective registry data (Preprint)

2020 ◽  
Author(s):  
Hyun-Lim Yang ◽  
Chul-Woo Jung ◽  
Seong Mi Yang ◽  
Min-Soo Kim ◽  
Sungho Shim ◽  
...  
Keyword(s):  
Neural Network ◽  
Cardiac Output ◽  
Deep Learning ◽  
Retrospective Study ◽  
Arterial Pressure ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Learning Model ◽  
Learning Technique ◽  
Deep Learning Model

BACKGROUND The arterial pressure-based cardiac output (APCO) is a less-invasive method for estimating the cardiac output without worries about complications from the pulmonary artery catheter (PAC). However, inaccuracies of the currently available APCO devices have been reported. Improvements of the algorithm by researchers are also impossible, since only a subset of the algorithm has been released. OBJECTIVE In this study, we developed and validated an open source APCO algorithm using convolutional neural network and the transfer learning technique. METHODS We did a retrospective study using data from a prospective cohort registry of intraoperative bio-signal data at a university hospital. The convolutional neural network model was trained using the arterial pressure waveform as input and the stroke volume (SV) value as output. The model parameters were pre-trained using the SV values from a commercial APCO device (Vigileo™ or EV1000™ with FloTrac™ algorithm) and adjusted by a transfer learning technique using SV values from the PAC. The performance of the model was evaluated by using absolute error for the PAC on the testing dataset from separate periods. Finally, we compared the performance of the deep learning model and the FloTrac with SV values from the PAC. RESULTS We used 2,057 surgical cases (1,958 training and 99 testing) in the registry for modelling. In the deep learning model, the absolute errors of SV were 14.5 ± 13.4 mL (10.2 ± 8.4 mL and 17.4 ± 15.3 in cardiac surgery and liver transplantation, respectively). In the comparison with FloTrac, the absolute errors of the deep learning model were significantly smaller than those of the FloTrac (16.5 ± 15.4 and 18.3 ± 15.1, respectively, P < .001). CONCLUSIONS The deep learning-based APCO algorithm showed better performance than the commercial APCO device. Further improvement of the algorithm developed in this study may be helpful for estimating cardiac output accurately in clinical practice and optimizing high-risk patient care. CLINICALTRIAL Not applicable.

scholarly journals Effectiveness of transfer learning for enhancing tumor classification with a convolutional neural network on frozen sections

2020 ◽  
Vol 10 (1) ◽  
Author(s):  
Young-Gon Kim ◽  
Sungchul Kim ◽  
Cristina Eunbee Cho ◽  
In Hye Song ◽  
Hee Jin Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Frozen Section ◽  
Medical Center ◽  
External Validation ◽  
Model Performance ◽  
Classification Model ◽  
Training Dataset

AbstractFast and accurate confirmation of metastasis on the frozen tissue section of intraoperative sentinel lymph node biopsy is an essential tool for critical surgical decisions. However, accurate diagnosis by pathologists is difficult within the time limitations. Training a robust and accurate deep learning model is also difficult owing to the limited number of frozen datasets with high quality labels. To overcome these issues, we validated the effectiveness of transfer learning from CAMELYON16 to improve performance of the convolutional neural network (CNN)-based classification model on our frozen dataset (N = 297) from Asan Medical Center (AMC). Among the 297 whole slide images (WSIs), 157 and 40 WSIs were used to train deep learning models with different dataset ratios at 2, 4, 8, 20, 40, and 100%. The remaining, i.e., 100 WSIs, were used to validate model performance in terms of patch- and slide-level classification. An additional 228 WSIs from Seoul National University Bundang Hospital (SNUBH) were used as an external validation. Three initial weights, i.e., scratch-based (random initialization), ImageNet-based, and CAMELYON16-based models were used to validate their effectiveness in external validation. In the patch-level classification results on the AMC dataset, CAMELYON16-based models trained with a small dataset (up to 40%, i.e., 62 WSIs) showed a significantly higher area under the curve (AUC) of 0.929 than those of the scratch- and ImageNet-based models at 0.897 and 0.919, respectively, while CAMELYON16-based and ImageNet-based models trained with 100% of the training dataset showed comparable AUCs at 0.944 and 0.943, respectively. For the external validation, CAMELYON16-based models showed higher AUCs than those of the scratch- and ImageNet-based models. Model performance for slide feasibility of the transfer learning to enhance model performance was validated in the case of frozen section datasets with limited numbers.

Automated detection of pneumonia cases using deep transfer learning with paediatric chest X-ray images

2021 ◽  
pp. 20201263
Author(s):  
Mohammad Salehi ◽  
Reza Mohammadi ◽  
Hamed Ghaffari ◽  
Nahid Sadighi ◽  
Reza Reiazi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Area Under Curve ◽  
Binary Classification ◽  
Classification Performance ◽  
Learning Approach ◽  
Insufficient Data ◽  
X Ray ◽  
Chest X Ray

Objective: Pneumonia is a lung infection and causes the inflammation of the small air sacs (Alveoli) in one or both lungs. Proper and faster diagnosis of pneumonia at an early stage is imperative for optimal patient care. Currently, chest X-ray is considered as the best imaging modality for diagnosing pneumonia. However, the interpretation of chest X-ray images is challenging. To this end, we aimed to use an automated convolutional neural network-based transfer-learning approach to detect pneumonia in paediatric chest radiographs. Methods: Herein, an automated convolutional neural network-based transfer-learning approach using four different pre-trained models (i.e. VGG19, DenseNet121, Xception, and ResNet50) was applied to detect pneumonia in children (1–5 years) chest X-ray images. The performance of different proposed models for testing data set was evaluated using five performances metrics, including accuracy, sensitivity/recall, Precision, area under curve, and F1 score. Results: All proposed models provide accuracy greater than 83.0% for binary classification. The pre-trained DenseNet121 model provides the highest classification performance of automated pneumonia classification with 86.8% accuracy, followed by Xception model with an accuracy of 86.0%. The sensitivity of the proposed models was greater than 91.0%. The Xception and DenseNet121 models achieve the highest classification performance with F1-score greater than 89.0%. The plotted area under curve of receiver operating characteristics of VGG19, Xception, ResNet50, and DenseNet121 models are 0.78, 0.81, 0.81, and 0.86, respectively. Conclusion: Our data showed that the proposed models achieve a high accuracy for binary classification. Transfer learning was used to accelerate training of the proposed models and resolve the problem associated with insufficient data. We hope that these proposed models can help radiologists for a quick diagnosis of pneumonia at radiology departments. Moreover, our proposed models may be useful to detect other chest-related diseases such as novel Coronavirus 2019. Advances in knowledge: Herein, we used transfer learning as a machine learning approach to accelerate training of the proposed models and resolve the problem associated with insufficient data. Our proposed models achieved accuracy greater than 83.0% for binary classification.

Using Convolutional Neural Networks for the Detection of Spinal Transverse Processes

2019 ◽  
Author(s):  
Victoria Wu
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Transverse Process ◽  
Classification Model ◽  
Ultrasound Images ◽  
Ultrasound Scan ◽  
X Ray ◽  
Scoliosis Screening

Introduction: Scoliosis, an excessive curvature of the spine, affects approximately 1 in 1,000 individuals. As a result, there have formerly been implementations of mandatory scoliosis screening procedures. Screening programs are no longer widely used as the harms often outweigh the benefits; it causes many adolescents to undergo frequent diagnosis X-ray procedure This makes spinal ultrasounds an ideal substitute for scoliosis screening in patients, as it does not expose them to those levels of radiation. Spinal curvatures can be accurately computed from the location of spinal transverse processes, by measuring the vertebral angle from a reference line [1]. However, ultrasound images are less clear than x-ray images, making it difficult to identify the spinal processes. To overcome this, we employ deep learning using a convolutional neural network, which is a powerful tool for computer vision and image classification [2]. Method: A total of 2,752 ultrasound images were recorded from a spine phantom to train a convolutional neural network. Subsequently, we took another recording of 747 images to be used for testing. All the ultrasound images from the scans were then segmented manually, using the 3D Slicer (www.slicer.org) software. Next, the dataset was fed through a convolutional neural network. The network used was a modified version of GoogLeNet (Inception v1), with 2 linearly stacked inception models. This network was chosen because it provided a balance between accurate performance, and time efficient computations. Results: Deep learning classification using the Inception model achieved an accuracy of 84% for the phantom scan.  Conclusion: The classification model performs with considerable accuracy. Better accuracy needs to be achieved, possibly with more available data and improvements in the classification model.  Acknowledgements: G. Fichtinger is supported as a Canada Research Chair in Computer-Integrated Surgery. This work was funded, in part, by NIH/NIBIB and NIH/NIGMS (via grant 1R01EB021396-01A1 - Slicer+PLUS: Point-of-Care Ultrasound) and by CANARIE’s Research Software Program.    Figure 1: Ultrasound scan containing a transverse process (left), and ultrasound scan containing no transverse process (right).                                Figure 2: Accuracy of classification for training (red) and validation (blue). References:           Ungi T, King F, Kempston M, Keri Z, Lasso A, Mousavi P, Rudan J, Borschneck DP, Fichtinger G. Spinal Curvature Measurement by Tracked Ultrasound Snapshots. Ultrasound in Medicine and Biology, 40(2):447-54, Feb 2014.           Krizhevsky A, Sutskeyer I, Hinton GE. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems 25:1097-1105. 

scholarly journals An Efficient Deep Learning Approach to Pneumonia Classification in Healthcare

2019 ◽  
Vol 2019 ◽  
pp. 1-7 ◽  
Author(s):  
Okeke Stephen ◽  
Mangal Sain ◽  
Uchenna Joseph Maduh ◽  
Do-Un Jeong
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Data Augmentation ◽  
Classification Performance ◽  
Learning Approaches ◽  
X Ray ◽  
Chest X Ray

This study proposes a convolutional neural network model trained from scratch to classify and detect the presence of pneumonia from a collection of chest X-ray image samples. Unlike other methods that rely solely on transfer learning approaches or traditional handcrafted techniques to achieve a remarkable classification performance, we constructed a convolutional neural network model from scratch to extract features from a given chest X-ray image and classify it to determine if a person is infected with pneumonia. This model could help mitigate the reliability and interpretability challenges often faced when dealing with medical imagery. Unlike other deep learning classification tasks with sufficient image repository, it is difficult to obtain a large amount of pneumonia dataset for this classification task; therefore, we deployed several data augmentation algorithms to improve the validation and classification accuracy of the CNN model and achieved remarkable validation accuracy.

Sign in / Sign up

Export Citation Format

Share Document