4S-DT: Self Supervised Super Sample Decomposition for Transfer learning with application to COVID-19 detection

ABSTRACTDue to the high availability of large-scale annotated image datasets, knowledge transfer from pre-trained models showed outstanding performance in medical image classification. However, building a robust image classification model for datasets with data irregularity or imbalanced classes can be a very challenging task, especially in the medical imaging domain. In this paper, we propose a novel deep convolutional neural network, we called Self Supervised Super Sample Decomposition for Transfer learning (4S-DT) model. 4S-DT encourages a coarse-to-fine transfer learning from large-scale image recognition tasks to a specific chest X-ray image classification task using a generic self-supervised sample decomposition approach. Our main contribution is a novel self-supervised learning mechanism guided by a super sample decomposition of unlabelled chest X-ray images. 4S-DT helps in improving the robustness of knowledge transformation via a downstream learning strategy with a class-decomposition layer to simplify the local structure of the data. 4S-DT can deal with any irregularities in the image dataset by investigating its class boundaries using a downstream class-decomposition mechanism. We used 50,000 unlabelled chest X-ray images to achieve our coarse-to-fine transfer learning with an application to COVID-19 detection, as an exemplar. 4S-DT has achieved an accuracy of 97.54% in the detection of COVID-19 cases on an extended test set enriched by augmented images, out of which all real COVID-19 cases were detected, which was the highest accuracy obtained when compared to other methods.

Download Full-text

A Transfer Learning Strategy for Owl Sound Classification by Using Image Classification Model with Audio Spectrogram

International Journal on Electrical Engineering and Informatics ◽

10.15676/ijeei.2021.13.3.3 ◽

2021 ◽

Vol 13 (3) ◽

pp. 546-553

Author(s):

Kevin William Gunawan ◽

◽

Alam Ahmad Hidayat ◽

Tjeng Wawan Cenggoro ◽

Bens Pardamean ◽

...

Keyword(s):

Image Classification ◽

Transfer Learning ◽

Learning Strategy ◽

Classification Model ◽

Sound Classification

Download Full-text

Tinjauan Literatur Sistematik tentang Deteksi Covid-19 menggunakan Convolutional Neural Networks

Creative Information Technology Journal ◽

10.24076/citec.2021v8i1.261 ◽

2021 ◽

Vol 8 (1) ◽

pp. 9

Author(s):

Buyut Khoirul Umri ◽

Ema Utami ◽

Mei P Kurniawan

Keyword(s):

Neural Network ◽

Neural Networks ◽

Literature Review ◽

Transfer Learning ◽

Convolutional Neural Networks ◽

Large Scale ◽

Image Data ◽

X Rays ◽

X Ray ◽

Chest X Ray

Covid-19 menyerang sel-sel epitel yang melapisi saluran pernapasan sehingga dalam kasus ini dapat memanfaatkan gambar x-ray dada untuk menganalisis kesehatan paru-paru pada pasien. Menggunakan x-ray dalam bidang medis merupakan metode yang lebih cepat, lebih mudah dan tidak berbahaya yang dapat dimanfaatkan pada banyak hal. Salah satu metode yang paling sering digunakan dalam klasifikasi gambar adalah convolutional neural networks (CNN). CNN merupahan jenis neural network yang sering digunakan dalam data gambar dan sering digunakan dalam mendeteksi dan mengenali object pada sebuah gambar. Model arsitektur pada metode CNN juga dapat dikembangkan dengan transfer learning yang merupakan proses menggunakan kembali model pre-trained yang dilatih pada dataset besar, biasanya pada tugas klasifikasi gambar berskala besar. Tinjauan literature review ini digunakan untuk menganalisis penggunaan transfer learning pada CNN sebagai metode yang dapat digunakan untuk mendeteksi covid-19 pada gambar x-ray dada. Hasil sistematis review menunjukkan bahwa algoritma CNN dapat digunakan dengan akruasi yang baik dalam mendeteksi covid-19 pada gambar x-ray dada dan dengan pengembangan model transfer learning mampu mendapatkan performa yang maksimal dengan dataset yang besar maupun kecil.Kata Kunci—CNN, transfer learning, deteksi, covid-19Covid-19 attacks the epithelial cells lining the respiratory tract so that in this case it can utilize chest x-ray images to analyze the health of the lungs in patients. Using x-rays in the medical field is a faster, easier and harmless method that can be utilized in many ways. One of the most frequently used methods in image classification is convolutional neural networks (CNN). CNN is a type of neural network that is often used in image data and is often used in detecting and recognizing objects in an image. The architectural model in the CNN method can also be developed with transfer learning which is the process of reusing pre-trained models that are trained on large datasets, usually on the task of classifying large-scale images. This literature review review is used to analyze the use of transfer learning on CNN as a method that can be used to detect covid-19 on chest x-ray images. The systematic review results show that the CNN algorithm can be used with good accuracy in detecting covid-19 on chest x-ray images and by developing transfer learning models able to get maximum performance with large and small datasets.Keywords—CNN, transfer learning, detection, covid-19

Download Full-text

CHEST X-RAY IMAGE CLASSIFICATION USING FASTER R-CNN

MALAYSIAN JOURNAL OF COMPUTING ◽

10.24191/mjoc.v4i1.6095 ◽

2019 ◽

Vol 4 (1) ◽

pp. 225

Author(s):

Azlan Ismail ◽

Taufik Rahmat ◽

Sharifah Aliman

Keyword(s):

Image Classification ◽

Computation Time ◽

Classification Model ◽

High Confidence ◽

X Ray ◽

Applied Model ◽

Reading Errors ◽

Normal Chest ◽

Chest X Ray ◽

The Common

Chest x-ray image analysis is the common medical imaging exam needed to assess different pathologies. Having an automated solution for the analysis can contribute to minimizing the workloads, improve efficiency and reduce the potential of reading errors. Many methods have been proposed to address chest x-ray image classification and detection. However, the application of regional-based convolutional neural networks (CNN) is currently limited. Thus, we propose an approach to classify chest x-ray images into either one of two categories, pathological or normal based on Faster Regional-CNN model. This model utilizes Region Proposal Network (RPN) to generate region proposals and perform image classification. By applying this model, we can potentially achieve two key goals, high confidence in the classification and reducing the computation time. The results show the applied model achieved higher accuracy as compared to the medical representatives on the random chest x-ray images. The classification model is also reasonably effective in classifying between finding and normal chest x-ray image captured through a live webcam.

Download Full-text

Evaluating Deep Neural Network Architectures with Transfer Learning for Pneumonitis Diagnosis

Computational and Mathematical Methods in Medicine ◽

10.1155/2021/8036304 ◽

2021 ◽

Vol 2021 ◽

pp. 1-12

Author(s):

Surya Krishnamurthy ◽

Kathiravan Srinivasan ◽

Saeed Mian Qaisar ◽

P. M. Durai Raj Vincent ◽

Chuan-Yu Chang

Keyword(s):

Deep Learning ◽

Transfer Learning ◽

Large Scale ◽

Data Augmentation ◽

Medical Image Analysis ◽

Predictive Performance ◽

X Ray ◽

Recent Developments ◽

Life Threatening ◽

Chest X Ray

Pneumonitis is an infectious disease that causes the inflammation of the air sac. It can be life-threatening to the very young and elderly. Detection of pneumonitis from X-ray images is a significant challenge. Early detection and assistance with diagnosis can be crucial. Recent developments in the field of deep learning have significantly improved their performance in medical image analysis. The superior predictive performance of the deep learning methods makes them ideal for pneumonitis classification from chest X-ray images. However, training deep learning models can be cumbersome and resource-intensive. Reusing knowledge representations of public models trained on large-scale datasets through transfer learning can help alleviate these challenges. In this paper, we compare various image classification models based on transfer learning with well-known deep learning architectures. The Kaggle chest X-ray dataset was used to evaluate and compare our models. We apply basic data augmentation and fine-tune our feed-forward classification head on the models pretrained on the ImageNet dataset. We observed that the DenseNet201 model outperforms other models with an AUROC score of 0.966 and a recall score of 0.99. We also visualize the class activation maps from the DenseNet201 model to interpret the patterns recognized by the model for prediction.

Download Full-text

Transfer Learning for COVID-19 Pneumonia Detection and Classification in Chest X-ray Images

10.1101/2020.12.14.20248158 ◽

2020 ◽

Author(s):

Iason Katsamenis ◽

Eftychios Protopapadakis ◽

Athanasios Voulodimos ◽

Anastasios Doulamis ◽

Nikolaos Doulamis

Keyword(s):

Neural Networks ◽

Transfer Learning ◽

Bacterial Pneumonia ◽

Large Scale ◽

Training Data ◽

Classification Models ◽

Automated Diagnosis ◽

X Ray ◽

Learning Framework ◽

Chest X Ray

We introduce a deep learning framework that can detect COVID-19 pneumonia in thoracic radiographs, as well as differentiate it from bacterial pneumonia infection. Deep classification models, such as convolutional neural networks (CNNs), require large-scale datasets in order to be trained and perform properly. Since the number of X-ray samples related to COVID-19 is limited, transfer learning (TL) appears as the go-to method to alleviate the demand for training data and develop accurate automated diagnosis models. In this context, networks are able to gain knowledge from pretrained networks on large-scale image datasets or alternative data-rich sources (i.e. bacterial and viral pneumonia radiographs). The experimental results indicate that the TL approach outperforms the performance obtained without TL, for the COVID-19 classification task in chest X-ray images.

Download Full-text