Deep Convolution Neural Network with 2-Stage Transfer Learning for Medical Image Classification

AbstractMedical image classification plays an essential role in clinical treatment and teaching tasks. However, the traditional method has reached its ceiling on performance. Moreover, by using them, much time and effort need to be spent on extracting and selecting classification features. The deep neural network is an emerging machine learning method that has proven its potential for different classification tasks. Notably, the convolutional neural network dominates with the best results on varying image classification tasks. However, medical image datasets are hard to collect because it needs a lot of professional expertise to label them. Therefore, this paper researches how to apply the convolutional neural network (CNN) based algorithm on a chest X-ray dataset to classify pneumonia. Three techniques are evaluated through experiments. These are linear support vector machine classifier with local rotation and orientation free features, transfer learning on two convolutional neural network models: Visual Geometry Group i.e., VGG16 and InceptionV3, and a capsule network training from scratch. Data augmentation is a data preprocessing method applied to all three methods. The results of the experiments show that data augmentation generally is an effective way for all three algorithms to improve performance. Also, Transfer learning is a more useful classification method on a small dataset compared to a support vector machine with oriented fast and rotated binary (ORB) robust independent elementary features and capsule network. In transfer learning, retraining specific features on a new target dataset is essential to improve performance. And, the second important factor is a proper network complexity that matches the scale of the dataset.

Download Full-text

Natural Images Allow Universal Adversarial Attacks on Medical Image Classification Using Deep Neural Networks with Transfer Learning

10.21203/rs.3.rs-757225/v1 ◽

2021 ◽

Author(s):

Akinori Minagi ◽

Hokuto Hirano ◽

Kazuhiro Takemoto

Keyword(s):

Neural Networks ◽

Image Classification ◽

Transfer Learning ◽

Medical Image ◽

Deep Neural Networks ◽

Disease Diagnosis ◽

Natural Images ◽

Fine Tuning ◽

Security And Privacy ◽

Medical Image Classification

Abstract Transfer learning from natural images is well used in deep neural networks (DNNs) for medical image classification to achieve computer-aided clinical diagnosis. Although the adversarial vulnerability of DNNs hinders practical applications owing to the high stakes of diagnosis, adversarial attacks are expected to be limited because training data — which are often required for adversarial attacks — are generally unavailable in terms of security and privacy preservation. Nevertheless, we hypothesized that adversarial attacks are also possible using natural images because pre-trained models do not change significantly after fine-tuning. We focused on three representative DNN-based medical image classification tasks (i.e., skin cancer, referable diabetic retinopathy, and pneumonia classifications) and investigated whether medical DNN models with transfer learning are vulnerable to universal adversarial perturbations (UAPs), generated using natural images. UAPs from natural images are useful for both non-targeted and targeted attacks. The performance of UAPs from natural images was significantly higher than that of random controls, although slightly lower than that of UAPs from training images. Vulnerability to UAPs from natural images was observed between different natural image datasets and between different model architectures. The use of transfer learning causes a security hole, which decreases the reliability and safety of computer-based disease diagnosis. Model training from random initialization (without transfer learning) reduced the performance of UAPs from natural images; however, it did not completely avoid vulnerability to UAPs. The vulnerability of UAPs from natural images will become a remarkable security threat.

Download Full-text

A VQA System for Medical Image Classification Using Transfer Learning

Advances in Intelligent Systems and Computing - Data Engineering and Intelligent Computing ◽

10.1007/978-981-16-0171-2_24 ◽

2021 ◽

pp. 249-257

Author(s):

C. Dhanush ◽

D. Pradeep Kumar ◽

Anita Kanavalli

Keyword(s):

Image Classification ◽

Transfer Learning ◽

Medical Image ◽

Medical Image Classification

Download Full-text

Hyperparameter Optimization of Deep Neural Network in Multimodality Fused Medical Image Classification for Medical and Industrial IoT

Internet of Things - Smart Sensors for Industrial Internet of Things ◽

10.1007/978-3-030-52624-5_9 ◽

2021 ◽

pp. 127-146

Author(s):

Velmurugan Subbiah Parvathy ◽

Sivakumar Pothiraj ◽

Jenyfal Sampson

Keyword(s):

Neural Network ◽

Image Classification ◽

Medical Image ◽

Deep Neural Network ◽

Hyperparameter Optimization ◽

Industrial Iot ◽

Medical Image Classification

Download Full-text

Recent Advances in Medical Image Processing

Acta Cytologica ◽

10.1159/000510992 ◽

2020 ◽

pp. 1-14

Author(s):

Zhen Huang ◽

Qiang Li ◽

Ju Lu ◽

Junlin Feng ◽

Jiajia Hu ◽

...

Keyword(s):

Neural Network ◽

Artificial Intelligence ◽

Machine Learning ◽

Image Processing ◽

Medical Imaging ◽

Medical Image ◽

Medical Image Processing ◽

Convolution Neural Network ◽

Artificial Intelligence Technology ◽

Deep Convolution Neural Network

Background: Application and development of the artificial intelligence technology have generated a profound impact in the field of medical imaging. It helps medical personnel to make an early and more accurate diagnosis. Recently, the deep convolution neural network is emerging as a principal machine learning method in computer vision and has received significant attention in medical imaging. Key Message: In this paper, we will review recent advances in artificial intelligence, machine learning, and deep convolution neural network, focusing on their applications in medical image processing. To illustrate with a concrete example, we discuss in detail the architecture of a convolution neural network through visualization to help understand its internal working mechanism. Summary: This review discusses several open questions, current trends, and critical challenges faced by medical image processing and artificial intelligence technology.

Download Full-text

Transfer Learning for Classification of 2D Brain MRI Images and Tumor Segmentation

International Journal of Recent Technology and Engineering - 2 ◽

10.35940/ijrte.f8321.038620 ◽

2020 ◽

Vol 8 (6) ◽

pp. 2016-2019

Keyword(s):

Neural Network ◽

Image Classification ◽

Transfer Learning ◽

Medical Image ◽

Brain Mri ◽

Acquisition Time ◽

Tumor Segmentation ◽

Exact Location ◽

Arduous Task

The focus of the paper is to classify the images into tumorous and non-tumorous and then locate the tumor. Amongst many medical imaging applications segmentation of Brain Tumors is an important and arduous task as the data acquired is disrupted due to artifacts being produced and acquisition time being very less, so classifying and finding the exact location of tumor is one of the most important jobs. In the paper, deep learning specifically the convolutional neural network is used to demonstrate its potential for image classification task. As the learning from available dataset will be low, so we use transfer learning [4] approach, as it is a developing AI strategy that overwhelms with the best outcomes on several image classification assignments because the pre-trained models have gained good knowledge about the features by training on a large number of images. Since, medical image datasets are hard to collect so transfer learning (Alexnet) [1] is used. Later on, after successful classification the aim is to find the exact location of the tumor and this is achieved using basics of image processing inspired by well-known technique of Mask R-CNN [9].

Download Full-text

Application Research of Deep Convolutional Neural Network in Computer Vision

Journal of Networking and Telecommunications ◽

10.18282/jnt.v2i2.886 ◽

2020 ◽

Vol 2 (2) ◽

pp. 23

Author(s):

Lei Wang

Keyword(s):

Neural Network ◽

Neural Networks ◽

Computer Vision ◽

Face Recognition ◽

Human Brain ◽

Image Classification ◽

Convolutional Neural Networks ◽

Convolution Neural Network ◽

Data Set ◽

Deep Convolution Neural Network

As an important research achievement in the field of brain like computing, deep convolution neural network has been widely used in many fields such as computer vision, natural language processing, information retrieval, speech recognition, semantic understanding and so on. It has set off a wave of neural network research in industry and academia and promoted the development of artificial intelligence. At present, the deep convolution neural network mainly simulates the complex hierarchical cognitive laws of the human brain by increasing the number of layers of the network, using a larger training data set, and improving the network structure or training learning algorithm of the existing neural network, so as to narrow the gap with the visual system of the human brain and enable the machine to acquire the capability of "abstract concepts". Deep convolution neural network has achieved great success in many computer vision tasks such as image classification, target detection, face recognition, pedestrian recognition, etc. Firstly, this paper reviews the development history of convolutional neural networks. Then, the working principle of the deep convolution neural network is analyzed in detail. Then, this paper mainly introduces the representative achievements of convolution neural network from the following two aspects, and shows the improvement effect of various technical methods on image classification accuracy through examples. From the aspect of adding network layers, the structures of classical convolutional neural networks such as AlexNet, ZF-Net, VGG, GoogLeNet and ResNet are discussed and analyzed. From the aspect of increasing the size of data set, the difficulties of manually adding labeled samples and the effect of using data amplification technology on improving the performance of neural network are introduced. This paper focuses on the latest research progress of convolution neural network in image classification and face recognition. Finally, the problems and challenges to be solved in future brain-like intelligence research based on deep convolution neural network are proposed.

Download Full-text