Rapid and Accurate Varieties Identification of Different Crop Seeds Under Sample-Limited Condition Based on Hyperspectral Imaging and Deep Transfer Learning

2020 ◽  
Author(s):  
Na Wu ◽  
Fei Liu ◽  
Yidan Bao ◽  
Mu Li ◽  
Wei Huang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Hyperspectral Imaging ◽  
Transfer Learning ◽  
Large Scale ◽  
Learning Algorithm ◽  
Accurate Method ◽  
Accurate Identification ◽  
Screening Process ◽  
Limited Condition ◽  
Deep Learning Algorithm

Abstract Background: Varieties identification of crop seeds is significant for breeders to screen out seeds with specific traits and for market regulators to detect seeds purity. Hyperspectral imaging technology provides a fast and non-destructive means for varieties identification. And deep learning algorithm is suitable for effective analysis of redundant spectral data. However, deep learning algorithms have serious big data dependency, while collecting high-quality large-scale samples was high-cost in many cases. This made it difficult to build an accurate identification model. This study aimed to explore a rapid and accurate method for varieties identification of different crop seeds under sample-limited condition based on hyperspectral imaging and deep transfer learning.Results: Three deep neural networks with typical structures were designed based on a samples-rich Pea dataset. Obtained the highest accuracy of 99.57 %, VGG-MODEL was transferred to classify four target datasets (Rice, Oat, Wheat, Cotton) with limited samples. The accuracies of deep transferred model achieved 95 %, 99 %, 80.8 %, and 83.86 % on the four datasets, respectively. Using training sets with different sizes, deep transferred model could always obtain higher performance than other traditional methods. Visualization of training process and classification results confirmed the portability of common features of seed spectra and provided an interpreted method for rapid and accurate varieties identification of crop seeds.Conclusions: This study combined hyperspectral imaging and deep transfer learning to identify varieties of different crop seeds, which was proved to be efficient under sample-limited condition. This facilitated crop variety screening process under the scenario of sample scarcity. It also provided a new idea for the detection of other qualities of crop seeds based on hyperspectral imaging under sample-limited condition.

scholarly journals Rapid and Accurate Varieties Classification of Different Crop Seeds Under Sample-Limited Condition Based on Hyperspectral Imaging and Deep Transfer Learning

2021 ◽  
Vol 9 ◽  
Author(s):  
Na Wu ◽  
Fei Liu ◽  
Fanjia Meng ◽  
Mu Li ◽  
Chu Zhang ◽  
...  
Keyword(s):  
Hyperspectral Imaging ◽  
Transfer Learning ◽  
Large Scale ◽  
Accurate Method ◽  
Classification Model ◽  
Screening Process ◽  
Germplasm Screening ◽  
Limited Condition ◽  
Crop Germplasm

Rapid varieties classification of crop seeds is significant for breeders to screen out seeds with specific traits and market regulators to detect seed purity. However, collecting high-quality, large-scale samples takes high costs in some cases, making it difficult to build an accurate classification model. This study aimed to explore a rapid and accurate method for varieties classification of different crop seeds under the sample-limited condition based on hyperspectral imaging (HSI) and deep transfer learning. Three deep neural networks with typical structures were designed based on a sample-rich Pea dataset. Obtained the highest accuracy of 99.57%, VGG-MODEL was transferred to classify four target datasets (rice, oat, wheat, and cotton) with limited samples. Accuracies of the deep transferred model achieved 95, 99, 80.8, and 83.86% on the four datasets, respectively. Using training sets with different sizes, the deep transferred model could always obtain higher performance than other traditional methods. The visualization of the deep features and classification results confirmed the portability of the shared features of seed spectra, providing an interpreted method for rapid and accurate varieties classification of crop seeds. The overall results showed great superiority of HSI combined with deep transfer learning for seed detection under sample-limited condition. This study provided a new idea for facilitating a crop germplasm screening process under the scenario of sample scarcity and the detection of other qualities of crop seeds under sample-limited condition based on HSI.

scholarly journals Research on Efficient Deep Learning Algorithm Based on ShuffleGhost in the Field of Virtual Reality

2021 ◽  
Vol 2021 ◽  
pp. 1-11
Author(s):  
Bangtong Huang ◽  
Hongquan Zhang ◽  
Zihong Chen ◽  
Lingling Li ◽  
Lihua Shi
Keyword(s):  
Virtual Reality ◽  
Deep Learning ◽  
Large Scale ◽  
Learning Algorithm ◽  
Feature Maps ◽  
Embedded Devices ◽  
Feature Map ◽  
Deep Learning Algorithm ◽  
Proper Design ◽  
The Cost

Deep learning algorithms are facing the limitation in virtual reality application due to the cost of memory, computation, and real-time computation problem. Models with rigorous performance might suffer from enormous parameters and large-scale structure, and it would be hard to replant them onto embedded devices. In this paper, with the inspiration of GhostNet, we proposed an efficient structure ShuffleGhost to make use of the redundancy in feature maps to alleviate the cost of computations, as well as tackling some drawbacks of GhostNet. Since GhostNet suffers from high computation of convolution in Ghost module and shortcut, the restriction of downsampling would make it more difficult to apply Ghost module and Ghost bottleneck to other backbone. This paper proposes three new kinds of ShuffleGhost structure to tackle the drawbacks of GhostNet. The ShuffleGhost module and ShuffleGhost bottlenecks are utilized by the shuffle layer and group convolution from ShuffleNet, and they are designed to redistribute the feature maps concatenated from Ghost Feature Map and Primary Feature Map. Besides, they eliminate the gap of them and extract the features. Then, SENet layer is adopted to reduce the computation cost of group convolution, as well as evaluating the importance of the feature maps which concatenated from Ghost Feature Maps and Primary Feature Maps and giving proper weights for the feature maps. This paper conducted some experiments and proved that the ShuffleGhostV3 has smaller trainable parameters and FLOPs with the ensurance of accuracy. And with proper design, it could be more efficient in both GPU and CPU side.

scholarly journals A deep learning view of the census of galaxy clusters in IllustrisTNG

2020 ◽  
Vol 498 (4) ◽  
pp. 5620-5628
Author(s):  
Y Su ◽  
Y Zhang ◽  
G Liang ◽  
J A ZuHone ◽  
D J Barnes ◽  
...  
Keyword(s):  
Deep Learning ◽  
Galaxy Clusters ◽  
Large Scale ◽  
Learning Algorithm ◽  
X Ray ◽  
Deep Learning Algorithm ◽  
Cluster Evolution ◽  
Novel Method ◽  
Massive Clusters ◽  
Activation Mapping

ABSTRACT The origin of the diverse population of galaxy clusters remains an unexplained aspect of large-scale structure formation and cluster evolution. We present a novel method of using X-ray images to identify cool core (CC), weak cool core (WCC), and non-cool core (NCC) clusters of galaxies that are defined by their central cooling times. We employ a convolutional neural network, ResNet-18, which is commonly used for image analysis, to classify clusters. We produce mock Chandra X-ray observations for a sample of 318 massive clusters drawn from the IllustrisTNG simulations. The network is trained and tested with low-resolution mock Chandra images covering a central 1 Mpc square for the clusters in our sample. Without any spectral information, the deep learning algorithm is able to identify CC, WCC, and NCC clusters, achieving balanced accuracies (BAcc) of 92 per cent, 81 per cent, and 83 per cent, respectively. The performance is superior to classification by conventional methods using central gas densities, with an average ${\rm BAcc}=81{{\ \rm per\ cent}}$, or surface brightness concentrations, giving ${\rm BAcc}=73{{\ \rm per\ cent}}$. We use class activation mapping to localize discriminative regions for the classification decision. From this analysis, we observe that the network has utilized regions from cluster centres out to r ≈ 300 kpc and r ≈ 500 kpc to identify CC and NCC clusters, respectively. It may have recognized features in the intracluster medium that are associated with AGN feedback and disruptive major mergers.

scholarly journals Evaluation of Scalability and Degree of Fine-Tuning of Deep Convolutional Neural Networks for COVID-19 Screening on Chest X-ray Images Using Explainable Deep-Learning Algorithm

2020 ◽  
Vol 10 (4) ◽  
pp. 213 ◽  
Author(s):  
Ki-Sun Lee ◽  
Jae Young Kim ◽  
Eun-tae Jeon ◽  
Won Suk Choi ◽  
Nan Hee Kim ◽  
...  
Keyword(s):  
Deep Learning ◽  
Learning Strategies ◽  
Transfer Learning ◽  
Learning Algorithm ◽  
Fine Tuning ◽  
Deep Convolutional Neural Networks ◽  
X Ray ◽  
Backbone Network ◽  
Deep Learning Algorithm ◽  
Chest X Ray

According to recent studies, patients with COVID-19 have different feature characteristics on chest X-ray (CXR) than those with other lung diseases. This study aimed at evaluating the layer depths and degree of fine-tuning on transfer learning with a deep convolutional neural network (CNN)-based COVID-19 screening in CXR to identify efficient transfer learning strategies. The CXR images used in this study were collected from publicly available repositories, and the collected images were classified into three classes: COVID-19, pneumonia, and normal. To evaluate the effect of layer depths of the same CNN architecture, CNNs called VGG-16 and VGG-19 were used as backbone networks. Then, each backbone network was trained with different degrees of fine-tuning and comparatively evaluated. The experimental results showed the highest AUC value to be 0.950 concerning COVID-19 classification in the experimental group of a fine-tuned with only 2/5 blocks of the VGG16 backbone network. In conclusion, in the classification of medical images with a limited number of data, a deeper layer depth may not guarantee better results. In addition, even if the same pre-trained CNN architecture is used, an appropriate degree of fine-tuning can help to build an efficient deep learning model.

scholarly journals Determination of Probability of Causative Pathogen in Infectious Keratitis Using Deep Learning Algorithm of Slit-Lamp Images

2021 ◽  
Author(s):  
Ayumi Koyama ◽  
Dai Miyazaki ◽  
Yuji Nakagawa ◽  
Yuji Ayatsuka ◽  
Hitomi Miyake ◽  
...  
Keyword(s):  
Deep Learning ◽  
Learning Algorithm ◽  
Area Under The Curve ◽  
Accurate Method ◽  
Gradient Boosting ◽  
Computer Assisted ◽  
Causative Pathogen ◽  
Infectious Keratitis ◽  
Slit Lamp ◽  
Deep Learning Algorithm

Abstract Corneal opacities are an important cause of blindness, and its major etiology is infectious keratitis. Slit-lamp examinations are commonly used to determine the causative pathogen; however, their diagnostic accuracy is low even for experienced ophthalmologists. To characterize the “face” of an infected cornea, we have adapted a deep learning architecture used for facial recognition and applied it to determine a probability score for a specific pathogen causing keratitis. To record the diverse features and mitigate the uncertainty, batches of probability scores of 4 serial images taken from many angles or fluorescence staining were learned for score and decision level fusion using a gradient boosting decision tree. A total of 4306 slit-lamp images and 312 images obtained by internet publications on keratitis by bacteria, fungi, acanthamoeba, and herpes simplex virus (HSV) were studied. The created algorithm had a high overall accuracy of diagnosis, e.g., the accuracy/area under the curve (AUC) for acanthamoeba was 97.9%/0.995, bacteria was 90.7%/0.963, fungi was 95.0%/0.975, and HSV was 92.3%/0.946, by group K-fold validation, and it was robust to even the low resolution web images. We suggest that our hybrid deep learning-based algorithm be used as a simple and accurate method for computer-assisted diagnosis of infectious keratitis.

scholarly journals Selective Disinfection Based on Directional Ultraviolet Irradiation and Artificial Intelligence

Electronics ◽  
2021 ◽  
Vol 10 (20) ◽  
pp. 2557
Author(s):  
Ben Zierdt ◽  
Taichu Shi ◽  
Thomas DeGroat ◽  
Sam Furman ◽  
Nicholas Papas ◽  
...  
Keyword(s):  
Artificial Intelligence ◽  
Deep Learning ◽  
Ultraviolet Radiation ◽  
Ultraviolet Irradiation ◽  
Human Exposure ◽  
Large Scale ◽  
Learning Algorithm ◽  
Ultraviolet Disinfection ◽  
Time Efficiency ◽  
Deep Learning Algorithm

Ultraviolet disinfection has been proven to be effective for surface sanitation. Traditional ultraviolet disinfection systems generate omnidirectional radiation, which introduces safety concerns regarding human exposure. Large scale disinfection must be performed without humans present, which limits the time efficiency of disinfection. We propose and experimentally demonstrate a targeted ultraviolet disinfection system using a combination of robotics, lasers, and deep learning. The system uses a laser-galvo and a camera mounted on a two-axis gimbal running a custom deep learning algorithm. This allows ultraviolet radiation to be applied to any surface in the room where it is mounted, and the algorithm ensures that the laser targets the desired surfaces avoids others such as humans. Both the laser-galvo and the deep learning algorithm were tested for targeted disinfection.

scholarly journals Transfer Learning Strategies for Deep Learning-based PHM Algorithms

2020 ◽  
Vol 10 (7) ◽  
pp. 2361
Author(s):  
Fan Yang ◽  
Wenjin Zhang ◽  
Laifa Tao ◽  
Jian Ma
Keyword(s):  
Big Data ◽  
Deep Learning ◽  
Learning Strategies ◽  
Transfer Learning ◽  
High Speed ◽  
Health Management ◽  
Learning Algorithm ◽  
Learning Technology ◽  
Deep Learning Algorithm ◽  
Transfer Strategies

As we enter the era of big data, we have to face big data generated by industrial systems that are massive, diverse, high-speed, and variability. In order to effectively deal with big data possessing these characteristics, deep learning technology has been widely used. However, the existing methods require great human involvement that is heavily depend on domain expertise and may thus be non-representative and biased from task to similar task, so for a wide variety of prognostic and health management (PHM) tasks, how to apply the developed deep learning algorithms to similar tasks to reduce the amount of development and data collection costs has become an urgent problem. Based on the idea of transfer learning and the structures of deep learning PHM algorithms, this paper proposes two transfer strategies via transferring different elements of deep learning PHM algorithms, analyzes the possible transfer scenarios in practical application, and proposes transfer strategies applicable in each scenario. At the end of this paper, the deep learning algorithm of bearing fault diagnosis based on convolutional neural networks (CNN) is transferred based on the proposed method, which was carried out under different working conditions and for different objects, respectively. The experiments verify the value and effectiveness of the proposed method and give the best choice of transfer strategy.

scholarly journals Fully Convolutional Variational Autoencoder For Feature Extraction Of Fire Detection System

2020 ◽  
Vol 13 (1) ◽  
pp. 9
Author(s):  
Herminarto Nugroho ◽  
Meredita Susanty ◽  
Ade Irawan ◽  
Muhamad Koyimatu ◽  
Ariana Yunita
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Learning Algorithm ◽  
Detection System ◽  
Fire Detection ◽  
Features Extraction ◽  
Essential Information ◽  
Deep Learning Algorithm ◽  
Specific Direction ◽  
Variational Autoencoder

This paper proposes a fully convolutional variational autoencoder (VAE) for features extraction from a large-scale dataset of fire images. The dataset will be used to train the deep learning algorithm to detect fire and smoke. The features extraction is used to tackle the curse of dimensionality, which is the common issue in training deep learning with huge datasets. Features extraction aims to reduce the dimension of the dataset significantly without losing too much essential information. Variational autoencoders (VAEs) are powerfull generative model, which can be used for dimension reduction. VAEs work better than any other methods available for this purpose because they can explore variations on the data in a specific direction.

scholarly journals Structural damage detection using hybrid deep learning algorithm

2020 ◽  
Vol 14 (2) ◽  
pp. 53-64
Author(s):  
Dang Viet Hung ◽  
Ha Manh Hung ◽  
Pham Hoang Anh ◽  
Nguyen Truong Thang
Keyword(s):  
Deep Learning ◽  
Damage Detection ◽  
Data Storage ◽  
Structural Damage ◽  
Large Scale ◽  
Short Term Memory ◽  
Learning Algorithm ◽  
Vibration Sensor ◽  
Structural Damage Detection ◽  
Deep Learning Algorithm

Timely monitoring the large-scale civil structure is a tedious task demanding expert experience and significant economic resources. Towards a smart monitoring system, this study proposes a hybrid deep learning algorithm aiming for structural damage detection tasks, which not only reduces required resources, including computational complexity, data storage but also has the capability to deal with different damage levels. The technique combines the ability to capture local connectivity of Convolution Neural Network and the well-known performance in accounting for long-term dependencies of Long-Short Term Memory network, into a single end-to-end architecture using directly raw acceleration time-series without requiring any signal preprocessing step. The proposed approach is applied to a series of experimentally measured vibration data from a three-story frame and successful in providing accurate damage identification results. Furthermore, parametric studies are carried out to demonstrate the robustness of this hybrid deep learning method when facing data corrupted by random noises, which is unavoidable in reality. Keywords: structural damage detection; deep learning algorithm; vibration; sensor; signal processing.

Sign in / Sign up

Export Citation Format

Share Document