Applying LSTM and GAN to build a deep learning model (TGAN-TEC) for global ionospheric TEC

2020 ◽  
Author(s):  
zhou chen ◽  
Yue deng ◽  
Jing-Song wang
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Training Data ◽  
Spatial And Temporal Variation ◽  
Electron Content ◽  
Generative Adversarial Network ◽  
Total Electron ◽  
Adversarial Network ◽  
Short Time ◽  
Deep Learning Model

<p>TEC is very important ionospheric parameter, which is commonly used observation for studying various ionospheric physical mechanism and other technological related to ionosphere (i.e. Global Positioning). However, the variation of global TEC is very dynamic, and its spatiotemporal variation is extremely complicated. So in this paper, we try to build a novel global ionospheric TEC (total electron content) predicting model based on two deep learning algorithms: generative adversarial network (GAN) and long short-term memory (LSTM). Training data is from 10-year IGS TEC data, which provide plenty of data for the GAN and LSTM algorithm to obtain the spatial and temporal variation of TEC respectively. The prediction accuracy of this model have been calculated under different levels of geomagnetic activity. The statistic result suggest that the proposed ionospheric model can be used as an efficient tool for ionospheric TEC short-time prediction.</p>

AOHDL: Archimedes Optimization Based Hybrid Deep Learning Model for Soybean Plant Disease Classification

2021 ◽  
Author(s):  
J. Annrose ◽  
N. Herald Anantha Rufus ◽  
C. R. Edwin Selva Rex ◽  
D. Godwin Immanuel
Keyword(s):  
Deep Learning ◽  
Optimization Algorithm ◽  
Short Term Memory ◽  
Learning Model ◽  
Disease Classification ◽  
Training Data ◽  
Machine Learning Techniques ◽  
Soybean Plant ◽  
Lower Accuracy ◽  
Deep Learning Model

Abstract Bean which is botanically called Phaseolus vulgaris L belongs to the Fabaceae family.During bean disease identification, unnecessary economical losses occur due to the delay of the treatment period, incorrect treatment, and lack of knowledge. The existing deep learning and machine learning techniques met few issues such as high computational complexity, higher cost associated with the training data, more execution time, noise, feature dimensionality, lower accuracy, low speed, etc. To tackle these problems, we have proposed a hybrid deep learning model with an Archimedes optimization algorithm (HDL-AOA) for bean disease classification. In this work, there are five bean classes of which one is a healthy class whereas the remaining four classes indicate different diseases such as Bean halo blight, Pythium diseases, Rhizoctonia root rot, and Anthracnose abnormalities acquired from the Soybean (Large) Data Set.The hybrid deep learning technique is the combination of wavelet packet decomposition (WPD) and long short term memory (LSTM). Initially, the WPD decomposes the input images into four sub-series. For these sub-series, four LSTM networks were developed. During bean disease classification, an Archimedes optimization algorithm (AOA) enhances the classification accuracy for multiple single LSTM networks. MATLAB software implements the HDL-AOA model for bean disease classification. The proposed model accomplishes lower MAPE than other exiting methods. Finally, the proposed HDL-AOA model outperforms excellent classification results using different evaluation measures such as accuracy, specificity, sensitivity, precision, recall, and F-score.

scholarly journals Soybean Plant Disease Classification using Archimedes Optimization Algorithm based Hybrid Deep Learning Model

2021 ◽  
Author(s):  
J. Annrose ◽  
N. Herald Anantha Rufus ◽  
C. R. Edwin Selva Rex ◽  
D. Godwin Immanuel
Keyword(s):  
Deep Learning ◽  
Optimization Algorithm ◽  
Short Term Memory ◽  
Learning Model ◽  
Disease Classification ◽  
Training Data ◽  
Machine Learning Techniques ◽  
Soybean Plant ◽  
Lower Accuracy ◽  
Deep Learning Model

Abstract Bean which is botanically called Phaseolus vulgaris L belongs to the Fabaceae family.During bean disease identification, unnecessary economical losses occur due to the delay of the treatment period, incorrect treatment, and lack of knowledge. The existing deep learning and machine learning techniques met few issues such as high computational complexity, higher cost associated with the training data, more execution time, noise, feature dimensionality, lower accuracy, low speed, etc. To tackle these problems, we have proposed a hybrid deep learning model with an Archimedes optimization algorithm (HDL-AOA) for bean disease classification. In this work, there are five bean classes of which one is a healthy class whereas the remaining four classes indicate different diseases such as Bean halo blight, Pythium diseases, Rhizoctonia root rot, and Anthracnose abnormalities acquired from the Soybean (Large) Data Set.The hybrid deep learning technique is the combination of wavelet packet decomposition (WPD) and long short term memory (LSTM). Initially, the WPD decomposes the input images into four sub-series. For these sub-series, four LSTM networks were developed. During bean disease classification, an Archimedes optimization algorithm (AOA) enhances the classification accuracy for multiple single LSTM networks. MATLAB software implements the HDL-AOA model for bean disease classification. The proposed model accomplishes lower MAPE than other exiting methods. Finally, the proposed HDL-AOA model outperforms excellent classification results using different evaluation measures such as accuracy, specificity, sensitivity, precision, recall, and F-score.

scholarly journals INFRASTRUCTURE DEGRADATION AND POST-DISASTER DAMAGE DETECTION USING ANOMALY DETECTING GENERATIVE ADVERSARIAL NETWORKS

2020 ◽  
Vol V-2-2020 ◽  
pp. 573-582 ◽  
Author(s):  
S. M. Tilon ◽  
F. Nex ◽  
D. Duarte ◽  
N. Kerle ◽  
G. Vosselman
Keyword(s):  
Deep Learning ◽  
Damage Detection ◽  
Training Data ◽  
Generative Adversarial Networks ◽  
Generative Adversarial Network ◽  
Essential Information ◽  
Urban Scenes ◽  
Adversarial Network ◽  
Collapsed Buildings ◽  
Post Disaster

Abstract. Degradation and damage detection provides essential information to maintenance workers in routine monitoring and to first responders in post-disaster scenarios. Despite advance in Earth Observation (EO), image analysis and deep learning techniques, the quality and quantity of training data for deep learning is still limited. As a result, no robust method has been found yet that can transfer and generalize well over a variety of geographic locations and typologies of damages. Since damages can be seen as anomalies, occurring sparingly over time and space, we propose to use an anomaly detecting Generative Adversarial Network (GAN) to detect damages. The main advantages of using GANs are that only healthy unannotated images are needed, and that a variety of damages, including the never before seen damage, can be detected. In this study we aimed to investigate 1) the ability of anomaly detecting GANs to detect degradation (potholes and cracks) in asphalt road infrastructures using Mobile Mapper imagery and building damage (collapsed buildings, rubble piles) using post-disaster aerial imagery, and 2) the sensitivity of this method against various types of pre-processing. Our results show that we can detect damages in urban scenes at satisfying levels but not on asphalt roads. Future work will investigate how to further classify the found damages and how to improve damage detection for asphalt roads.

Development and investigation of a deep learning based method for TEC map completion

2020 ◽  
Author(s):  
Mingwu Jin ◽  
Yang Pan ◽  
Shunrong Zhang ◽  
Yue Deng
Keyword(s):  
Solar Activity ◽  
Mean Squared Error ◽  
Image Inpainting ◽  
Science Research ◽  
High Solar Activity ◽  
Electron Content ◽  
International Gnss Service ◽  
Generative Adversarial Network ◽  
Total Electron ◽  
Adversarial Network

<p>Because of the limited coverage of receiver stations, current measurements of Total Electron Content (TEC) by ground-based GNSS receivers are not complete with large portions of data gaps. The processing to obtain complete TEC maps for space science research is time consuming and needs the collaboration of five International GNSS Service (IGS) Ionosphere Associate Analysis Centers (IAACs) to use different data processing and filling algorithms and to consolidate their results into final IGS completed TEC maps. In this work, we developed a Deep Convolutional Generative Adversarial Network (DCGAN) and Poisson blending model (DCGAN-PB) to learn IGS completion process for automatic completion of TEC maps. Using 10-fold cross validation of 20-year IGS TEC data, DCGAN-PB achieves the average root mean squared error (RMSE) about 4 absolute TEC units (TECu) of the high solar activity years and around 2 TECu for low solar activity years, which is about 50% reduction of RMSE for recovered TEC values compared to two conventional single-image inpainting methods. The developed DCGAN-PB model can lead to an efficient automatic completion tool for TEC maps.</p>

scholarly journals Jamming Prediction for Radar Signals Using Machine Learning Methods

2020 ◽  
Vol 2020 ◽  
pp. 1-9 ◽  
Author(s):  
Gyeong-Hoon Lee ◽  
Jeil Jo ◽  
Cheong Hee Park
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Learning Model ◽  
Training Data ◽  
Electronic Warfare ◽  
New Type ◽  
Long Short Term Memory ◽  
Radar Signals ◽  
Feature Values ◽  
Deep Learning Model

Jamming is a form of electronic warfare where jammers radiate interfering signals toward an enemy radar, disrupting the receiver. The conventional method for determining an effective jamming technique corresponding to a threat signal is based on the library which stores the appropriate jamming method for signal types. However, there is a limit to the use of a library when a threat signal of a new type or a threat signal that has been altered differently from existing types is received. In this paper, we study two methods of predicting the appropriate jamming technique for a received threat signal using deep learning: using a deep neural network on feature values extracted manually from the PDW list and using long short-term memory (LSTM) which takes the PDW list as input. Using training data consisting of pairs of threat signals and corresponding jamming techniques, a deep learning model is trained which outputs jamming techniques for threat signal inputs. Training data are constructed based on the information in the library, but the trained deep learning model is used to predict jamming techniques for received threat signals without using the library. The prediction performance and time complexity of two proposed methods are compared. In particular, the ability to predict jamming techniques for unknown types of radar signals which are not used in the stage of training the model is analyzed.

scholarly journals A deep learning segmentation strategy that minimizes the amount of manually annotated images

F1000Research ◽  
2021 ◽  
Vol 10 ◽  
pp. 256
Author(s):  
Thierry Pécot ◽  
Alexander Alekseyenko ◽  
Kristin Wallace
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Training Data ◽  
Artificial Data ◽  
Deep Convolutional Neural Networks ◽  
Generative Adversarial Network ◽  
Data Set ◽  
Segmentation Strategy ◽  
Adversarial Network ◽  
The Impact

Deep learning has revolutionized the automatic processing of images. While deep convolutional neural networks have demonstrated astonishing segmentation results for many biological objects acquired with microscopy, this technology's good performance relies on large training datasets. In this paper, we present a strategy to minimize the amount of time spent in manually annotating images for segmentation. It involves using an efficient and open source annotation tool, the artificial increase of the training data set with data augmentation, the creation of an artificial data set with a conditional generative adversarial network and the combination of semantic and instance segmentations. We evaluate the impact of each of these approaches for the segmentation of nuclei in 2D widefield images of human precancerous polyp biopsies in order to define an optimal strategy.

scholarly journals The Comparison of Predicting Storm-Time Ionospheric TEC by Three Methods: ARIMA, LSTM, and Seq2Seq

Atmosphere ◽  
2020 ◽  
Vol 11 (4) ◽  
pp. 316 ◽  
Author(s):  
Rongxin Tang ◽  
Fantao Zeng ◽  
Zhou Chen ◽  
Jing-Song Wang ◽  
Chun-Ming Huang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Geomagnetic Storm ◽  
Space Weather ◽  
Short Term Memory ◽  
Geomagnetic Storms ◽  
Extreme Condition ◽  
Electron Content ◽  
Navigation Systems ◽  
Short Term ◽  
Total Electron

Ionospheric structure usually changes dramatically during a strong geomagnetic storm period, which will significantly affect the short-wave communication and satellite navigation systems. It is critically important to make accurate ionospheric predictions under the extreme space weather conditions. However, ionospheric prediction is always a challenge, and pure physical methods often fail to get a satisfactory result since the ionospheric behavior varies greatly with different geomagnetic storms. In this paper, in order to find an effective prediction method, one traditional mathematical method (autoregressive integrated moving average—ARIMA) and two deep learning algorithms (long short-term memory—LSTM and sequence-to-sequence—Seq2Seq) are investigated for the short-term predictions of ionospheric TEC (Total Electron Content) under different geomagnetic storm conditions based on the MIT (Massachusetts Institute of Technology) madrigal observation from 2001 to 2016. Under the extreme condition, the performance limitation of these methods can be found. When the storm is stronger, the effective prediction horizon of the methods will be shorter. The statistical analysis shows that the LSTM can achieve the best prediction accuracy and is robust for the accurate trend prediction of the strong geomagnetic storms. In contrast, ARIMA and Seq2Seq have relatively poor performance for the prediction of the strong geomagnetic storms. This study brings new insights to the deep learning applications in the space weather forecast.

scholarly journals Anomaly Detection Neural Network with Dual Auto-Encoders GAN and Its Industrial Inspection Applications

Sensors ◽  
2020 ◽  
Vol 20 (12) ◽  
pp. 3336 ◽  
Author(s):  
Ta-Wei Tang ◽  
Wei-Han Kuo ◽  
Jauh-Hsiang Lan ◽  
Chien-Fang Ding ◽  
Hakiem Hsu ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Anomaly Detection ◽  
Training Data ◽  
Labor Costs ◽  
Generative Adversarial Network ◽  
Detection Ability ◽  
Adversarial Network ◽  
Automated Optical Inspection ◽  
High Level

Recently, researchers have been studying methods to introduce deep learning into automated optical inspection (AOI) systems to reduce labor costs. However, the integration of deep learning in the industry may encounter major challenges such as sample imbalance (defective products that only account for a small proportion). Therefore, in this study, an anomaly detection neural network, dual auto-encoder generative adversarial network (DAGAN), was developed to solve the problem of sample imbalance. With skip-connection and dual auto-encoder architecture, the proposed method exhibited excellent image reconstruction ability and training stability. Three datasets, namely public industrial detection training set, MVTec AD, with mobile phone screen glass and wood defect detection datasets, were used to verify the inspection ability of DAGAN. In addition, training with a limited amount of data was proposed to verify its detection ability. The results demonstrated that the areas under the curve (AUCs) of DAGAN were better than previous generative adversarial network-based anomaly detection models in 13 out of 17 categories in these datasets, especially in categories with high variability or noise. The maximum AUC improvement was 0.250 (toothbrush). Moreover, the proposed method exhibited better detection ability than the U-Net auto-encoder, which indicates the function of discriminator in this application. Furthermore, the proposed method had a high level of AUCs when using only a small amount of training data. DAGAN can significantly reduce the time and cost of collecting and labeling data when it is applied to industrial detection.

scholarly journals 4-Class MI-EEG Signal Generation and Recognition with CVAE-GAN

2021 ◽  
Vol 11 (4) ◽  
pp. 1798
Author(s):  
Jun Yang ◽  
Huijuan Yu ◽  
Tao Shen ◽  
Yaolian Song ◽  
Zhuangfei Chen
Keyword(s):  
Deep Learning ◽  
Data Augmentation ◽  
Feature Matching ◽  
Continuous Optimization ◽  
Training Data ◽  
Small Scale ◽  
Eeg Signal ◽  
Generative Adversarial Network ◽  
The Real ◽  
Adversarial Network

As the capability of an electroencephalogram’s (EEG) measurement of the real-time electrodynamics of the human brain is known to all, signal processing techniques, particularly deep learning, could either provide a novel solution for learning but also optimize robust representations from EEG signals. Considering the limited data collection and inadequate concentration of during subjects testing, it becomes essential to obtain sufficient training data and useful features with a potential end-user of a brain–computer interface (BCI) system. In this paper, we combined a conditional variational auto-encoder network (CVAE) with a generative adversarial network (GAN) for learning latent representations from EEG brain signals. By updating the fine-tuned parameter fed into the resulting generative model, we could synthetize the EEG signal under a specific category. We employed an encoder network to obtain the distributed samples of the EEG signal, and applied an adversarial learning mechanism to continuous optimization of the parameters of the generator, discriminator and classifier. The CVAE was adopted to adjust the synthetics more approximately to the real sample class. Finally, we demonstrated our approach take advantages of both statistic and feature matching to make the training process converge faster and more stable and address the problem of small-scale datasets in deep learning applications for motor imagery tasks through data augmentation. The augmented training datasets produced by our proposed CVAE-GAN method significantly enhance the performance of MI-EEG recognition.

scholarly journals AI-driven deep learning method for diagnosing COVID-19 symptoms

2021 ◽  
pp. 34-49
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Generative Adversarial Network ◽  
Virus Eradication ◽  
The Public ◽  
Adversarial Network ◽  
Best Response ◽  
Medical Reports ◽  
Learning Machine ◽  
User Friendly

The outbreak of COVID-19 put the whole world in an unprecedentedly harsh situation, horribly disrupting life around the world and killing thousands. COVID-19 remains a real threat to the public health system as it spreads to 212 countries and territories and the number of cases of infection and deaths increases to 5,212,172 and 334,915 (as of May 22, 2020). This treatise provides a response to virus eradication via artificial intelligence (AI). Several deep learning (DL) methods have been described to achieve this goal, including GAN (Generative Adversarial Network), ELM (Extreme Learning Machine), and LSTM (Long / Short Term Memory). It describes an integrated bioinformatics approach that combines various aspects of information from a series of orthopedic and unstructured data sources to form a user-friendly platform for physicians and researchers. A major advantage of these AI-powered platforms is to facilitate the diagnosis and treatment process of the COVID-19 disease. The latest relevant publications and medical reports have been investigated to select inputs and targets for networks that will facilitate arriving at reliable artificial neural network-based tools for COVID-19-related challenges. There are also several specific inputs per platform, including clinical data and data in various formats, such as medical images, which can improve the performance of the introduced method for the best response in real application.

Sign in / Sign up

Export Citation Format

Share Document