scholarly journals A Convolutional Neural Network for Classifying Cloud Particles Recorded by Imaging Probes

2019 ◽  
Author(s):  
Georgios Touloupas ◽  
Annika Lauber ◽  
Jan Henneberger ◽  
Alexander Beck ◽  
Thomas Hofmann ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Linear Models ◽  
Fine Tuning ◽  
Support Vector ◽  
Automated Classification ◽  
Cloud Particle ◽  
Imaging Probes ◽  
Regularization Techniques ◽  
Cloud Particles

Abstract. During typical field campaigns, millions of cloud particle images are captured with imaging probes. Our interest lies in classifying these particles in order to compute the statistics needed for understanding clouds. Given the large volume of collected data, this raises the need for an automated classification approach. Traditional classification methods that require extracting features manually (e.g. decision trees and support vector machines) show reasonable performance when trained and tested on data coming from a unique dataset. However, they often have difficulties to generalize to test sets coming from other datasets where the distribution of the features might be significantly different. In practice, we found that each new dataset requires labeling a huge amount of data by hand using those methods. Convolutional neural networks have the potential to overcome this problem due to their ability to learn complex non-linear models directly from the images instead of pre-engineered features, as well as by relying on powerful regularization techniques. We show empirically that a convolutional neural network trained on cloud particles from holographic imagers generalizes well to unseen datasets. Moreover, fine-tuning the same network with a small number (256) of training images improves the classification accuracy. Thus, the automated classification with a convolutional neural network not only reduces the hand-labeling effort for new datasets but is also no longer the main error source for the classification of small particles.

scholarly journals A convolutional neural network for classifying cloud particles recorded by imaging probes

2020 ◽  
Vol 13 (5) ◽  
pp. 2219-2239 ◽  
Author(s):  
Georgios Touloupas ◽  
Annika Lauber ◽  
Jan Henneberger ◽  
Alexander Beck ◽  
Aurélien Lucchi
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Nonlinear Models ◽  
Fine Tuning ◽  
Support Vector ◽  
Automated Classification ◽  
Cloud Particle ◽  
Imaging Probes ◽  
Regularization Techniques ◽  
Cloud Particles

Abstract. During typical field campaigns, millions of cloud particle images are captured with imaging probes. Our interest lies in classifying these particles in order to compute the statistics needed for understanding clouds. Given the large volume of collected data, this raises the need for an automated classification approach. Traditional classification methods that require extracting features manually (e.g., decision trees and support vector machines) show reasonable performance when trained and tested on data coming from a unique dataset. However, they often have difficulties in generalizing to test sets coming from other datasets where the distribution of the features might be significantly different. In practice, we found that for holographic imagers each new dataset requires labeling a huge amount of data by hand using those methods. Convolutional neural networks have the potential to overcome this problem due to their ability to learn complex nonlinear models directly from the images instead of pre-engineered features, as well as by relying on powerful regularization techniques. We show empirically that a convolutional neural network trained on cloud particles from holographic imagers generalizes well to unseen datasets. Moreover, fine tuning the same network with a small number (256) of training images improves the classification accuracy. Thus, the automated classification with a convolutional neural network not only reduces the hand-labeling effort for new datasets but is also no longer the main error source for the classification of small particles.

scholarly journals An Automatic Mass Screening System for Cervical Cancer Detection Based on Convolutional Neural Network

2020 ◽  
Vol 2020 ◽  
pp. 1-14
Author(s):  
Aziz-ur -Rehman ◽  
Nabeel Ali ◽  
Imtiaz.A. Taj ◽  
Muhammad Sajid ◽  
Khasan S. Karimov
Keyword(s):  
Neural Network ◽  
Cervical Cancer ◽  
Convolutional Neural Network ◽  
Fine Tuning ◽  
Screening Tests ◽  
Support Vector ◽  
Screening System ◽  
Cervical Cells ◽  
Fully Connected ◽  
Testing Protocols

Cervical cancer is the fourth most common type of cancer and is also a leading cause of mortality among women across the world. Various types of screening tests are used for its diagnosis, but the most popular one is the Papanicolaou smear test, in which cell cytology is carried out. It is a reliable tool for early identification of cervical cancer, but there is always a chance of misdiagnosis because of possible errors in human observations. In this paper, an auto-assisted cervical cancer screening system is proposed that uses a convolutional neural network trained on Cervical Cells database. The training of the network is accomplished through transfer learning, whereby initializing weights are obtained from the training on ImageNet dataset. After fine-tuning the network on the Cervical Cells database, the feature vector is extracted from the last fully connected layer of convolutional neural network. For final classification/screening of the cell samples, three different classifiers are proposed including Softmax regression (SR), Support vector machine (SVM), and GentleBoost ensemble of decision trees (GEDT). The performance of the proposed screening system is evaluated for two different testing protocols, namely, 2-class problem and 7-class problem, on the Herlev database. Classification accuracies of SR, SVM, and GEDT for the 2-class problem are found to be 98.8%, 99.5%, and 99.6%, respectively, while for the 7-class problem, they are 97.21%, 98.12%, and 98.85%, respectively. These results show that the proposed system provides better performance than its previous counterparts under various testing conditions.

Urban management image classification approach based on deep learning

2021 ◽  
Vol 13 (5) ◽  
pp. 347-360
Author(s):  
Qinqing Kang ◽  
Xiong Ding
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Smart City ◽  
Management System ◽  
Road Traffic ◽  
Image Features ◽  
Fine Tuning ◽  
Support Vector ◽  
City Management

Based on the case images in the smart city management system, the advantage of deep learning is used to learn image features on its own, an improved deep convolutional neural network algorithm is proposed in this paper, and the algorithm is used to improve the smart city management system (hereinafter referred to as “Smart City Management”). These case images are quickly and accurately classified, the automatic classification of cases is completed in the city management system. ZCA (Zero-phase Component Analysis)-whitening is used to reduce the correlation between image data features, an eight-layer convolutional neural network model is built to classify the whitened images, and rectified linear unit (ReLU) is used in the convolutional layer to accelerate the training process, the dropout technology is used in the pooling layer, the algorithm is prevented from overfitting. Back Propagation (BP) algorithm is used for optimization in the network fine-tuning stage, the robustness of the algorithm is improved. Based on the above method, the two types of case images of road traffic and city appearance environment were subjected to two classification experiments. The accuracy has reached 97.5%, and the F1-Score has reached 0.98. The performance exceeded LSVM (Langrangian Support Vector Machine), SAE (Sparse autoencoder), and traditional CNN (Convolution Neural Network). At the same time, this method conducts four-classification experiments on four types of cases: electric vehicles, littering, illegal parking of motor vehicles, and mess around garbage bins. The accuracy is 90.5%, and the F1-Score is 0.91. The performance still exceeds LSVM, SAE and traditional CNN and other methods.

scholarly journals Deep Convolutional Neural Networks for Tea Tree Pest Recognition and Diagnosis

Symmetry ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 2140
Author(s):  
Jing Chen ◽  
Qi Liu ◽  
Lingwang Gao
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Deep Convolutional Neural Network ◽  
Fine Tuning ◽  
Support Vector ◽  
Tea Tree ◽  
Symmetry Properties ◽  
Tea Pests

Due to the benefits of convolutional neural networks (CNNs) in image classification, they have been extensively used in the computerized classification and focus of crop pests. The intention of the current find out about is to advance a deep convolutional neural network to mechanically identify 14 species of tea pests that possess symmetry properties. (1) As there are not enough tea pests images in the network to train the deep convolutional neural network, we proposes to classify tea pests images by fine-tuning the VGGNET-16 deep convolutional neural network. (2) Through comparison with traditional machine learning algorithms Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP), the performance of our method is evaluated (3) The three methods can identify tea tree pests well: the proposed convolutional neural network classification has accuracy up to 97.75%, while MLP and SVM have accuracies of 76.07% and 68.81%, respectively. Our proposed method performs the best of the assessed recognition algorithms. The experimental results also show that the fine-tuning method is a very powerful and efficient tool for small datasets in practical problems.

Single Channel EEG signal for Automatic Detection of Absence Seizure using Convolutional Neural Network

2019 ◽  
Vol 13 ◽  
Author(s):  
Niha Kamal Basha ◽  
Aisha Banu Wahab
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Convolutional Neural Network ◽  
Monitoring System ◽  
Single Channel ◽  
Confusion Matrix ◽  
Sudden Change ◽  
Automatic Detection ◽  
Support Vector ◽  
Absence Seizure

: Absence seizure is a type of brain disorder in which subject get into sudden lapses in attention. Which means sudden change in brain stimulation. Most of this type of disorder is widely found in children’s (5-18 years). These Electroencephalogram (EEG) signals are captured with long term monitoring system and are analyzed individually. In this paper, a Convolutional Neural Network to extract single channel EEG seizure features like Power, log sum of wavelet transform, cross correlation, and mean phase variance of each frame in a windows are extracted after pre-processing and classify them into normal or absence seizure class, is proposed as an empowerment of monitoring system by automatic detection of absence seizure. The training data is collected from the normal and absence seizure subjects in the form of Electroencephalogram. The objective is to perform automatic detection of absence seizure using single channel electroencephalogram signal as input. Here the data is used to train the proposed Convolutional Neural Network to extract and classify absence seizure. The Convolutional Neural Network consist of three layers 1] convolutional layer – which extract the features in the form of vector 2] Pooling layer – the dimensionality of output from convolutional layer is reduced and 3] Fully connected layer–the activation function called soft-max is used to find the probability distribution of output class. This paper goes through the automatic detection of absence seizure in detail and provide the comparative analysis of classification between Support Vector Machine and Convolutional Neural Network. The proposed approach outperforms the performance of Support Vector Machine by 80% in automatic detection of absence seizure and validated using confusion matrix.

Knowledge Transferred Fine-Tuning for Anti-Aliased Convolutional Neural Network in Data-Limited Situation

2021 ◽  
Author(s):  
Satoshi Suzuki ◽  
Shoichiro Takeda ◽  
Ryuichi Tanida ◽  
Hideaki Kimata ◽  
Hayaru Shouno
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Fine Tuning

A visual terrain classification method for mobile robots’ navigation based on convolutional neural network and support vector machine

2021 ◽  
pp. 014233122098791
Author(s):  
Wanli Wang ◽  
Botao Zhang ◽  
Kaiqi Wu ◽  
Sergey A Chepinskiy ◽  
Anton A Zhilenkov ◽  
...  
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Mobile Robots ◽  
Convolutional Neural Network ◽  
Hybrid Method ◽  
Classification Accuracy ◽  
Support Vector ◽  
High Classification Accuracy ◽  
Enhance Efficiency ◽  
Multi Class Classification

In this paper, a hybrid method based on deep learning is proposed to visually classify terrains encountered by mobile robots. Considering the limited computing resource on mobile robots and the requirement for high classification accuracy, the proposed hybrid method combines a convolutional neural network with a support vector machine to keep a high classification accuracy while improve work efficiency. The key idea is that the convolutional neural network is used to finish a multi-class classification and simultaneously the support vector machine is used to make a two-class classification. The two-class classification performed by the support vector machine is aimed at one kind of terrain that users are mostly concerned with. Results of the two classifications will be consolidated to get the final classification result. The convolutional neural network used in this method is modified for the on-board usage of mobile robots. In order to enhance efficiency, the convolutional neural network has a simple architecture. The convolutional neural network and the support vector machine are trained and tested by using RGB images of six kinds of common terrains. Experimental results demonstrate that this method can help robots classify terrains accurately and efficiently. Therefore, the proposed method has a significant potential for being applied to the on-board usage of mobile robots.

scholarly journals Early Detection of Plant Viral Disease Using Hyperspectral Imaging and Deep Learning

Sensors ◽  
2021 ◽  
Vol 21 (3) ◽  
pp. 742
Author(s):  
Canh Nguyen ◽  
Vasit Sagan ◽  
Matthew Maimaitiyiming ◽  
Maitiniyazi Maimaitijiang ◽  
Sourav Bhadra ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Early Detection ◽  
Convolutional Neural Network ◽  
Near Infrared ◽  
Hyperspectral Data ◽  
Viral Diseases ◽  
Support Vector ◽  
Spectral Features ◽  
Feature Spaces

Early detection of grapevine viral diseases is critical for early interventions in order to prevent the disease from spreading to the entire vineyard. Hyperspectral remote sensing can potentially detect and quantify viral diseases in a nondestructive manner. This study utilized hyperspectral imagery at the plant level to identify and classify grapevines inoculated with the newly discovered DNA virus grapevine vein-clearing virus (GVCV) at the early asymptomatic stages. An experiment was set up at a test site at South Farm Research Center, Columbia, MO, USA (38.92 N, −92.28 W), with two grapevine groups, namely healthy and GVCV-infected, while other conditions were controlled. Images of each vine were captured by a SPECIM IQ 400–1000 nm hyperspectral sensor (Oulu, Finland). Hyperspectral images were calibrated and preprocessed to retain only grapevine pixels. A statistical approach was employed to discriminate two reflectance spectra patterns between healthy and GVCV vines. Disease-centric vegetation indices (VIs) were established and explored in terms of their importance to the classification power. Pixel-wise (spectral features) classification was performed in parallel with image-wise (joint spatial–spectral features) classification within a framework involving deep learning architectures and traditional machine learning. The results showed that: (1) the discriminative wavelength regions included the 900–940 nm range in the near-infrared (NIR) region in vines 30 days after sowing (DAS) and the entire visual (VIS) region of 400–700 nm in vines 90 DAS; (2) the normalized pheophytization index (NPQI), fluorescence ratio index 1 (FRI1), plant senescence reflectance index (PSRI), anthocyanin index (AntGitelson), and water stress and canopy temperature (WSCT) measures were the most discriminative indices; (3) the support vector machine (SVM) was effective in VI-wise classification with smaller feature spaces, while the RF classifier performed better in pixel-wise and image-wise classification with larger feature spaces; and (4) the automated 3D convolutional neural network (3D-CNN) feature extractor provided promising results over the 2D convolutional neural network (2D-CNN) in learning features from hyperspectral data cubes with a limited number of samples.

scholarly journals Research on Automated Defect Classification Based on Visual Sensing and Convolutional Neural Network-Support Vector Machine for GTA-Assisted Droplet Deposition Manufacturing Process

Metals ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 639
Author(s):  
Chen Ma ◽  
Haifei Dang ◽  
Jun Du ◽  
Pengfei He ◽  
Minbo Jiang ◽  
...  
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Convolutional Neural Network ◽  
Manufacturing Process ◽  
Support Vector ◽  
Defect Classification ◽  
Droplet Deposition ◽  
Network Support ◽  
Visual Sensing ◽  
Low Efficiency

This paper proposes a novel metal additive manufacturing process, which is a composition of gas tungsten arc (GTA) and droplet deposition manufacturing (DDM). Due to complex physical metallurgical processes involved, such as droplet impact, spreading, surface pre-melting, etc., defects, including lack of fusion, overflow and discontinuity of deposited layers always occur. To assure the quality of GTA-assisted DDM-ed parts, online monitoring based on visual sensing has been implemented. The current study also focuses on automated defect classification to avoid low efficiency and bias of manual recognition by the way of convolutional neural network-support vector machine (CNN-SVM). The best accuracy of 98.9%, with an execution time of about 12 milliseconds to handle an image, proved our model can be enough to use in real-time feedback control of the process.

Sign in / Sign up

Export Citation Format

Share Document