Knowledge Transferred Fine-Tuning for Anti-Aliased Convolutional Neural Network in Data-Limited Situation

2021 ◽  
Author(s):  
Satoshi Suzuki ◽  
Shoichiro Takeda ◽  
Ryuichi Tanida ◽  
Hideaki Kimata ◽  
Hayaru Shouno
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Fine Tuning

scholarly journals Research on Real-Time Multiple Single Garbage Classification Based on Convolutional Neural Network

2020 ◽  
Vol 2020 ◽  
pp. 1-6
Author(s):  
Jian-ye Yuan ◽  
Xin-yuan Nan ◽  
Cheng-rong Li ◽  
Le-le Sun
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Real Time ◽  
Environmental Science ◽  
Fine Tuning ◽  
Classification Model ◽  
Classification Models ◽  
Data Set ◽  
Classification Tasks ◽  
Accuracy Rates

Considering that the garbage classification is urgent, a 23-layer convolutional neural network (CNN) model is designed in this paper, with the emphasis on the real-time garbage classification, to solve the low accuracy of garbage classification and recycling and difficulty in manual recycling. Firstly, the depthwise separable convolution was used to reduce the Params of the model. Then, the attention mechanism was used to improve the accuracy of the garbage classification model. Finally, the model fine-tuning method was used to further improve the performance of the garbage classification model. Besides, we compared the model with classic image classification models including AlexNet, VGG16, and ResNet18 and lightweight classification models including MobileNetV2 and SuffleNetV2 and found that the model GAF_dense has a higher accuracy rate, fewer Params, and FLOPs. To further check the performance of the model, we tested the CIFAR-10 data set and found the accuracy rates of the model (GAF_dense) are 0.018 and 0.03 higher than ResNet18 and SufflenetV2, respectively. In the ImageNet data set, the accuracy rates of the model (GAF_dense) are 0.225 and 0.146 higher than Resnet18 and SufflenetV2, respectively. Therefore, the garbage classification model proposed in this paper is suitable for garbage classification and other classification tasks to protect the ecological environment, which can be applied to classification tasks such as environmental science, children’s education, and environmental protection.

scholarly journals "LeukNet" - A Model of Convolutional Neural Network for the Diagnosis of Leukemia

2020 ◽  
Author(s):  
Luis H. S. Vogado ◽  
Rodrigo M. S. Veras ◽  
Kelson R. T. Aires
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Cross Validation ◽  
Data Augmentation ◽  
Fine Tuning ◽  
Current State ◽  
Leukemia Diagnosis ◽  
New Guidelines ◽  
Texture Contrast ◽  
Tuning Methods

Leukemia is a disorder that affects the bone marrow, causing uncontrolled production of leukocytes, impairing the transport of oxygen and causing blood coagulation problems. In this article, we propose a new computational tool, named LeukNet, a Convolutional Neural Network (CNN) architecture based on the VGG-16 convolutional blocks, to facilitate the leukemia diagnosis from blood smear images. We evaluated different architectures and fine-tuning methods using 18 datasets containing 3536 images with distinct characteristics of color, texture, contrast, and resolution. Additionally, data augmentation operations were applied to increase the training set by up to 20 times. The k-fold cross-validation (k = 5) results achieved 98.28% of accuracy. A cross-dataset validation technique, named LeaveOne-Dataset-Out Cross-Validation (LODOCV), is also proposed to evaluate the developed model’s generalization capability. The accuracy of using LODOCV on the ALL-IDB 1, ALL-IDB 2, and UFG datasets was 97.04%, 82.46%, and 70.24%, respectively, overcoming the current state-of-the-art results and offering new guidelines for image-based computer-aided diagnosis (CAD) systems in this area.

scholarly journals Performance Evaluation of Fine-tuned Faster R-CNN on specific MS COCO Objects

2019 ◽  
Vol 9 (4) ◽  
pp. 2548
Author(s):  
Garima Devnani ◽  
Ayush Jaiswal ◽  
Roshni John ◽  
Rajat Chaurasia ◽  
Neha Tirpude
Keyword(s):  
Neural Network ◽  
Performance Evaluation ◽  
Convolutional Neural Network ◽  
Training Model ◽  
Fine Tuning ◽  
Training Process

<span lang="EN-US">Fine-tuning of a model is a method that is most often required to cater to the users’ explicit requirements. But the question remains whether the model is accurate enough to be used for a certain application. This paper strives to present the metrics used for performance evaluation of a Convolutional Neural Network (CNN) model. The evaluation is based on the training process which provides us with intermediate models after every 1000 iterations. While 1000 iterations are not substantial enough over the range of 490k iterations, the groups are sized with 100k iterations each. Now, the intention was to compare the recorded metrics to evaluate the model in terms of accuracy. The training model used the set of specific categories chosen from the Microsoft Common Objects in Context (MS COCO) dataset while allowing the users to use their externally available images to test the model’s accuracy. Our trained model ensured that all the objects are detected that are present in the image to depict the effect of precision.</span>

Tomato pest classification using deep convolutional neural network with transfer learning, fine tuning and scratch learning

2021 ◽  
pp. 1-10
Author(s):  
Gayatri Pattnaik ◽  
Vimal K. Shrivastava ◽  
K. Parvathi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Transfer Learning ◽  
Data Augmentation ◽  
State Of The Art ◽  
Deep Convolutional Neural Network ◽  
Fine Tuning ◽  
Tomato Plants ◽  
Random Weights

Pests are major threat to economic growth of a country. Application of pesticide is the easiest way to control the pest infection. However, excessive utilization of pesticide is hazardous to environment. The recent advances in deep learning have paved the way for early detection and improved classification of pest in tomato plants which will benefit the farmers. This paper presents a comprehensive analysis of 11 state-of-the-art deep convolutional neural network (CNN) models with three configurations: transfers learning, fine-tuning and scratch learning. The training in transfer learning and fine tuning initiates from pre-trained weights whereas random weights are used in case of scratch learning. In addition, the concept of data augmentation has been explored to improve the performance. Our dataset consists of 859 tomato pest images from 10 categories. The results demonstrate that the highest classification accuracy of 94.87% has been achieved in the transfer learning approach by DenseNet201 model with data augmentation.

scholarly journals A Technical Review of Convolutional Neural Network-Based Mammographic Breast Cancer Diagnosis

2019 ◽  
Vol 2019 ◽  
pp. 1-16 ◽  
Author(s):  
Lian Zou ◽  
Shaode Yu ◽  
Tiebao Meng ◽  
Zhicheng Zhang ◽  
Xiaokun Liang ◽  
...  
Keyword(s):  
Breast Cancer ◽  
Neural Network ◽  
Convolutional Neural Network ◽  
Cancer Diagnosis ◽  
Early Stage ◽  
Breast Cancer Diagnosis ◽  
Fine Tuning ◽  
Learning Tools ◽  
Pros And Cons ◽  
Future Work

This study reviews the technique of convolutional neural network (CNN) applied in a specific field of mammographic breast cancer diagnosis (MBCD). It aims to provide several clues on how to use CNN for related tasks. MBCD is a long-standing problem, and massive computer-aided diagnosis models have been proposed. The models of CNN-based MBCD can be broadly categorized into three groups. One is to design shallow or to modify existing models to decrease the time cost as well as the number of instances for training; another is to make the best use of a pretrained CNN by transfer learning and fine-tuning; the third is to take advantage of CNN models for feature extraction, and the differentiation of malignant lesions from benign ones is fulfilled by using machine learning classifiers. This study enrolls peer-reviewed journal publications and presents technical details and pros and cons of each model. Furthermore, the findings, challenges and limitations are summarized and some clues on the future work are also given. Conclusively, CNN-based MBCD is at its early stage, and there is still a long way ahead in achieving the ultimate goal of using deep learning tools to facilitate clinical practice. This review benefits scientific researchers, industrial engineers, and those who are devoted to intelligent cancer diagnosis.

scholarly journals Skin Lesion Classification With Deep Convolutional Neural Network: Process Development and Validation

10.2196/18438 ◽  
2020 ◽  
Vol 3 (1) ◽  
pp. e18438
Author(s):  
Arnab Ray ◽  
Aman Gupta ◽  
Amutha Al
Keyword(s):  
Neural Network ◽  
Skin Cancer ◽  
Skin Lesion ◽  
Convolutional Neural Network ◽  
Process Development ◽  
Early Stage ◽  
Deep Convolutional Neural Network ◽  
Fine Tuning ◽  
Network Process ◽  
Lesion Classification

Background Skin cancer is the most common cancer and is often ignored by people at an early stage. There are 5.4 million new cases of skin cancer worldwide every year. Deaths due to skin cancer could be prevented by early detection of the mole. Objective We propose a skin lesion classification system that has the ability to detect such moles at an early stage and is able to easily differentiate between a cancerous and noncancerous mole. Using this system, we would be able to save time and resources for both patients and practitioners. Methods We created a deep convolutional neural network using an Inceptionv3 and DenseNet-201 pretrained model. Results We found that using the concepts of fine-tuning and the ensemble learning model yielded superior results. Furthermore, fine-tuning the whole model helped models converge faster compared to fine-tuning only the top layers, giving better accuracy overall. Conclusions Based on our research, we conclude that deep learning algorithms are highly suitable for classifying skin cancer images.

scholarly journals Hybrid Convolutional Neural Network with PSO Based Severe Dengue Prognosis Method in Human Genome Data

2020 ◽  
Vol 1 (1) ◽  
pp. 22-28
Author(s):  
Mohammed Mustafa ◽  
◽  
Rihab Eltayeb Ahmed ◽  
Sarah Mustafa Eljack ◽  
◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Pso Algorithm ◽  
Weight Vector ◽  
Fine Tuning ◽  
Severe Dengue ◽  
Local Optimum ◽  
Genome Data ◽  
High Incidence ◽  
Human Genome Data

Dengue is one of the most significant diseases transmitted by arthropods in the world. Dengue phenotypes are focused on documented inaccuracies in the laboratory and clinical studies. In countries with a high incidence of this disease, early diagnosis of dengue is still a concern for public health. Deep learning has been developed as a highly versatile and accurate methodology for classification and regression, which requires small adjustment, interpretable results, and the prediction of risk for complex diseases. This work is motivated by the inclusion of the Particle Swarm Optimization (PSO) algorithm for the fine-tuning of the model's parameters in the convolutional neural network (CNN). The use of this PSO was used to forecast patients with extreme dengue, and to refine the input weight vector and CNN parameters to achieve anticipated precision, and to prevent premature convergence towards local optimum conditions.

scholarly journals A convolutional neural network for classifying cloud particles recorded by imaging probes

2020 ◽  
Vol 13 (5) ◽  
pp. 2219-2239 ◽  
Author(s):  
Georgios Touloupas ◽  
Annika Lauber ◽  
Jan Henneberger ◽  
Alexander Beck ◽  
Aurélien Lucchi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Nonlinear Models ◽  
Fine Tuning ◽  
Support Vector ◽  
Automated Classification ◽  
Cloud Particle ◽  
Imaging Probes ◽  
Regularization Techniques ◽  
Cloud Particles

Abstract. During typical field campaigns, millions of cloud particle images are captured with imaging probes. Our interest lies in classifying these particles in order to compute the statistics needed for understanding clouds. Given the large volume of collected data, this raises the need for an automated classification approach. Traditional classification methods that require extracting features manually (e.g., decision trees and support vector machines) show reasonable performance when trained and tested on data coming from a unique dataset. However, they often have difficulties in generalizing to test sets coming from other datasets where the distribution of the features might be significantly different. In practice, we found that for holographic imagers each new dataset requires labeling a huge amount of data by hand using those methods. Convolutional neural networks have the potential to overcome this problem due to their ability to learn complex nonlinear models directly from the images instead of pre-engineered features, as well as by relying on powerful regularization techniques. We show empirically that a convolutional neural network trained on cloud particles from holographic imagers generalizes well to unseen datasets. Moreover, fine tuning the same network with a small number (256) of training images improves the classification accuracy. Thus, the automated classification with a convolutional neural network not only reduces the hand-labeling effort for new datasets but is also no longer the main error source for the classification of small particles.

Sign in / Sign up

Export Citation Format

Share Document