scholarly journals Robust Approach to Supervised Deep Neural Network Training for Real-Time Object Classification in Cluttered Indoor Environment

2021 ◽  
Vol 11 (15) ◽  
pp. 7148
Author(s):  
Bedada Endale ◽  
Abera Tullu ◽  
Hayoung Shi ◽  
Beom-Soo Kang
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Input Data ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Object Classification ◽  
Training Data ◽  
Gradient Descent Algorithm

Unmanned aerial vehicles (UAVs) are being widely utilized for various missions: in both civilian and military sectors. Many of these missions demand UAVs to acquire artificial intelligence about the environments they are navigating in. This perception can be realized by training a computing machine to classify objects in the environment. One of the well known machine training approaches is supervised deep learning, which enables a machine to classify objects. However, supervised deep learning comes with huge sacrifice in terms of time and computational resources. Collecting big input data, pre-training processes, such as labeling training data, and the need for a high performance computer for training are some of the challenges that supervised deep learning poses. To address these setbacks, this study proposes mission specific input data augmentation techniques and the design of light-weight deep neural network architecture that is capable of real-time object classification. Semi-direct visual odometry (SVO) data of augmented images are used to train the network for object classification. Ten classes of 10,000 different images in each class were used as input data where 80% were for training the network and the remaining 20% were used for network validation. For the optimization of the designed deep neural network, a sequential gradient descent algorithm was implemented. This algorithm has the advantage of handling redundancy in the data more efficiently than other algorithms.

scholarly journals Urban Flood Prediction Using Deep Neural Network with Data Augmentation

Water ◽  
2020 ◽  
Vol 12 (3) ◽  
pp. 899 ◽  
Author(s):  
Hyun Il Kim ◽  
Kun Yeun Han
Keyword(s):  
Neural Network ◽  
Urban Areas ◽  
Input Data ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Numerical Models ◽  
Training Data ◽  
Data Driven ◽  
Statistical Characteristics ◽  
Flood Prediction

Data-driven models using an artificial neural network (ANN), deep learning (DL) and numerical models are applied in flood analysis of the urban watershed, which has a complex drainage system. In particular, data-driven models using neural networks can quickly present the results and be used for flood forecasting. However, not a lot of data with actual flood history and heavy rainfalls are available, it is difficult to conduct a preliminary analysis of flood in urban areas. In this study, a deep neural network (DNN) was used to predict the total accumulative overflow, and because of the insufficiency of observed rainfall data, 6 h of rainfall were surveyed nationwide in Korea. Statistical characteristics of each rainfall event were used as input data for the DNN. The target value of the DNN was the total accumulative overflow calculated from Storm Water Management Model (SWMM) simulations, and the methodology of data augmentation was applied to increase the input data. The SWMM is one-dimensional model for rainfall-runoff analysis. The data augmentation allowed enrichment of the training data for DNN. The data augmentation was applied ten times for each input combination, and the practicality of the data augmentation was determined by predicting the total accumulative overflow over the testing data and the observed rainfall. The prediction result of DNN was compared with the simulated result obtained using the SWMM model, and it was confirmed that the predictive performance was improved on applying data augmentation.

scholarly journals Improved COVID-19 detection using data augmentation Deep Convolution GAN and classifier DenseNet.

2021 ◽  
Author(s):  
Debmitra Ghosh
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Classification Accuracy ◽  
Deep Neural Network ◽  
Data Augmentation ◽  
Training Data ◽  
X Rays ◽  
X Ray ◽  
Chest X Ray ◽  
Synthetic Images

Abstract SARS-CoV-2 or severe acute respiratory syndrome coronavirus 2 is considered to be the cause of Coronavirus (COVID-19) which is a viral disease. The rapid spread of COVID-19 is having a detrimental effect on the global economy and health. A chest X-ray of infected patients can be considered as a crucial step in the battle against COVID-19. On retrospections, it is found that abnormalities exist in chest X-rays of patients suggestive of COVID-19. This sparked the introduction of a variety of deep learning systems and studies which have shown that the accuracy of COVID-19 patient detection through the use of chest X-rays is strongly optimistic. Although there are certain shortcomings like deep learning networks like convolutional neural networks (CNNs) need a substantial amount of training data but the outbreak is recent, so it is large datasets of radiographic images of the COVID-19 infected patients are not available in such a short time. Here, in this research, we present a method to generate synthetic chest X-ray (CXR) images by developing a Deep Convolution Generative Adversarial Network-based model. In addition, we demonstrate that the synthetic images produced from DCGAN can be utilized to enhance the performance of CNN for COVID-19 detection. Classification using CNN alone yielded 85% accuracy. Although there are several models available, we chose MobileNet as it is a lightweight deep neural network, with fewer parameters and higher classification accuracy. Here we are using a deep neural network-based model to diagnose COVID-19 infected patients through radiological imaging of 5,859 Chest X-Ray images. We are using a Deep Convolutional Neural Network and a pre-trained model “DenseNet 121” for two new label classes (COVID-19 and Normal). To improve the classification accuracy, in our work we have further reduced the number of network parameters by introducing dense blocks that are proposed in DenseNets into MobileNet. By adding synthetic images produced by DCGAN, the accuracy increased to 97%. Our goal is to use this method to speed up COVID-19 detection and lead to more robust systems of radiology.

scholarly journals A Frequency Pattern Mining Model Based on Deep Neural Network for Real-Time Classification of Heart Conditions

Healthcare ◽  
2020 ◽  
Vol 8 (3) ◽  
pp. 234 ◽  
Author(s):  
Hyun Yoo ◽  
Soyoung Han ◽  
Kyungyong Chung
Keyword(s):  
Neural Network ◽  
Big Data ◽  
Fourier Transform ◽  
Fast Fourier Transform ◽  
Real Time ◽  
Normal Control ◽  
Input Data ◽  
Deep Neural Network ◽  
Pattern Mining ◽  
F Measure

Recently, a massive amount of big data of bioinformation is collected by sensor-based IoT devices. The collected data are also classified into different types of health big data in various techniques. A personalized analysis technique is a basis for judging the risk factors of personal cardiovascular disorders in real-time. The objective of this paper is to provide the model for the personalized heart condition classification in combination with the fast and effective preprocessing technique and deep neural network in order to process the real-time accumulated biosensor input data. The model can be useful to learn input data and develop an approximation function, and it can help users recognize risk situations. For the analysis of the pulse frequency, a fast Fourier transform is applied in preprocessing work. With the use of the frequency-by-frequency ratio data of the extracted power spectrum, data reduction is performed. To analyze the meanings of preprocessed data, a neural network algorithm is applied. In particular, a deep neural network is used to analyze and evaluate linear data. A deep neural network can make multiple layers and can establish an operation model of nodes with the use of gradient descent. The completed model was trained by classifying the ECG signals collected in advance into normal, control, and noise groups. Thereafter, the ECG signal input in real time through the trained deep neural network system was classified into normal, control, and noise. To evaluate the performance of the proposed model, this study utilized a ratio of data operation cost reduction and F-measure. As a result, with the use of fast Fourier transform and cumulative frequency percentage, the size of ECG reduced to 1:32. According to the analysis on the F-measure of the deep neural network, the model had 83.83% accuracy. Given the results, the modified deep neural network technique can reduce the size of big data in terms of computing work, and it is an effective system to reduce operation time.

scholarly journals Comparison of Forecasting Models for Real-Time Monitoring of Water Quality Parameters Based on Hybrid Deep Learning Neural Networks

Water ◽  
2021 ◽  
Vol 13 (11) ◽  
pp. 1547
Author(s):  
Jian Sha ◽  
Xue Li ◽  
Man Zhang ◽  
Zhong-Liang Wang
Keyword(s):  
Neural Network ◽  
Water Quality ◽  
Deep Learning ◽  
Real Time ◽  
Best Management Practices ◽  
Input Data ◽  
Management Practices ◽  
Quality Parameters ◽  
Water Quality Parameters ◽  
Real Time Monitoring

Accurate real-time water quality prediction is of great significance for local environmental managers to deal with upcoming events and emergencies to develop best management practices. In this study, the performances in real-time water quality forecasting based on different deep learning (DL) models with different input data pre-processing methods were compared. There were three popular DL models concerned, including the convolutional neural network (CNN), long short-term memory neural network (LSTM), and hybrid CNN–LSTM. Two types of input data were applied, including the original one-dimensional time series and the two-dimensional grey image based on the complete ensemble empirical mode decomposition algorithm with adaptive noise (CEEMDAN) decomposition. Each type of input data was used in each DL model to forecast the real-time monitoring water quality parameters of dissolved oxygen (DO) and total nitrogen (TN). The results showed that (1) the performances of CNN–LSTM were superior to the standalone model CNN and LSTM; (2) the models used CEEMDAN-based input data performed much better than the models used the original input data, while the improvements for non-periodic parameter TN were much greater than that for periodic parameter DO; and (3) the model accuracies gradually decreased with the increase of prediction steps, while the original input data decayed faster than the CEEMDAN-based input data and the non-periodic parameter TN decayed faster than the periodic parameter DO. Overall, the input data preprocessed by the CEEMDAN method could effectively improve the forecasting performances of deep learning models, and this improvement was especially significant for non-periodic parameters of TN.

Oversampling Based on Data Augmentation in Convolutional Neural Network for Silicon Wafer Defect Classification

2020 ◽  
Author(s):  
Uzma Batool ◽  
Mohd Ibrahim Shapiai ◽  
Nordinah Ismail ◽  
Hilman Fauzi ◽  
Syahrizal Salleh
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Silicon Wafer ◽  
Data Augmentation ◽  
Imbalanced Data ◽  
Training Data ◽  
Defect Classification ◽  
Learning Method ◽  
Test Set

Silicon wafer defect data collected from fabrication facilities is intrinsically imbalanced because of the variable frequencies of defect types. Frequently occurring types will have more influence on the classification predictions if a model gets trained on such skewed data. A fair classifier for such imbalanced data requires a mechanism to deal with type imbalance in order to avoid biased results. This study has proposed a convolutional neural network for wafer map defect classification, employing oversampling as an imbalance addressing technique. To have an equal participation of all classes in the classifier’s training, data augmentation has been employed, generating more samples in minor classes. The proposed deep learning method has been evaluated on a real wafer map defect dataset and its classification results on the test set returned a 97.91% accuracy. The results were compared with another deep learning based auto-encoder model demonstrating the proposed method, a potential approach for silicon wafer defect classification that needs to be investigated further for its robustness.

scholarly journals Analysis of COVID-19 Infections on a CT Image Using DeepSense Model

2020 ◽  
Vol 8 ◽  
Author(s):  
Adil Khadidos ◽  
Alaa O. Khadidos ◽  
Srihari Kannan ◽  
Yuvaraj Natarajan ◽  
Sachi Nandan Mohanty ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Input Data ◽  
Training Data ◽  
Learning Framework ◽  
Learning Classifiers ◽  
Tomography Image ◽  
Mining Model ◽  
Deep Learning Model

In this paper, a data mining model on a hybrid deep learning framework is designed to diagnose the medical conditions of patients infected with the coronavirus disease 2019 (COVID-19) virus. The hybrid deep learning model is designed as a combination of convolutional neural network (CNN) and recurrent neural network (RNN) and named as DeepSense method. It is designed as a series of layers to extract and classify the related features of COVID-19 infections from the lungs. The computerized tomography image is used as an input data, and hence, the classifier is designed to ease the process of classification on learning the multidimensional input data using the Expert Hidden layers. The validation of the model is conducted against the medical image datasets to predict the infections using deep learning classifiers. The results show that the DeepSense classifier offers accuracy in an improved manner than the conventional deep and machine learning classifiers. The proposed method is validated against three different datasets, where the training data are compared with 70%, 80%, and 90% training data. It specifically provides the quality of the diagnostic method adopted for the prediction of COVID-19 infections in a patient.

Segmentation Neural Network Incorporating Scale-Space in the Application of Cardiac MRI

2020 ◽  
Vol 10 (7) ◽  
pp. 1494-1505
Author(s):  
Hyo-Hun Kim ◽  
Byung-Woo Hong
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Cardiac Mri ◽  
Network Architecture ◽  
Data Augmentation ◽  
Scale Space ◽  
Segmentation Algorithm ◽  
Training Data ◽  
Training Procedure ◽  
Whole Heart

In this work, we present an image segmentation algorithm based on the convolutional neural network framework where the scale space theory is incorporated in the course of training procedure. The construction of data augmentation is designed to apply the scale space to the training data in order to effectively deal with the variability of regions of interest in geometry and appearance such as shape and contrast. The proposed data augmentation algorithm via scale space is aimed to improve invariant features with respect to both geometry and appearance by taking into consideration of their diffusion process. We develop a segmentation algorithm based on the convolutional neural network framework where the network architecture consists of encoding and decoding substructures in combination with the data augmentation scheme via the scale space induced by the heat equation. The quantitative analysis using the cardiac MRI dataset indicates that the proposed algorithm achieves better accuracy in the delineation of the left ventricles, which demonstrates the potential of the algorithm in the application of the whole heart segmentation as a compute-aided diagnosis system for the cardiac diseases.

scholarly journals Application of deep learning technology for creating intellectual autonomous machines

2020 ◽  
pp. 407-418
Author(s):  
O.S. Bilokon ◽  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Machine Vision ◽  
Network Architecture ◽  
Intellectual Ability ◽  
Input Graph ◽  
Elementary Functions ◽  
Vision Systems ◽  
Gradient Descent Algorithm ◽  
Autonomous Machines

One of the most common tasks that arise in building intelligent machine vision systems for intellectually autonomous machines is the problems of classification and regression. Classification problems are used for the reflexive action of autonomous machines. Prediction tasks can be used to build machine vision systems to provide intelligent autonomous machines with environmental knowledge, which in turn is important for planned predictable movements. Defining a class of task instances is an important procedure for the effective design of deep learning systems. In this context, the possibility of using a multilayered neural network as a regressor to construct elementary functional mappings is explored for further prediction. The study outlines the peculiarities of functioning and configuration of a specialized robotics system, considered in this paper as an intelligent autonomous machine or physical agent, generates a set of data points for elementary functions, analytical modeling and modeling of training systems. Input graph was constructed, neural network architecture was defined, gradient descent algorithm was implemented, and output schedules were finally constructed: learning process, results prediction and comparative graph of predicted results superimposed on the input graph. As a result of the study, an assessment of the machine's intellectual ability to predict was made.

scholarly journals Application of deep learning methods to predict ionosphere parameters in real time

2020 ◽  
Vol 196 ◽  
pp. 02007
Author(s):  
Vladimir Mochalov ◽  
Anastasia Mochalova
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Architecture ◽  
Short Term Memory ◽  
Neural Network Architecture ◽  
Short Term ◽  
Learning Methods ◽  
Term Memory ◽  
Long Short Term Memory

In this paper, the previously obtained results on recognition of ionograms using deep learning are expanded to predict the parameters of the ionosphere. After the ionospheric parameters have been identified on the ionogram using deep learning in real time, we can predict the parameters for some time ahead on the basis of the new data obtained Examples of predicting the ionosphere parameters using an artificial recurrent neural network architecture long short-term memory are given. The place of the block for predicting the parameters of the ionosphere in the system for analyzing ionospheric data using deep learning methods is shown.

scholarly journals Efficient Deep Network Architecture for Vision-Based Vehicle Detection Keyvan Kasiri,

2017 ◽  
Vol 3 (1) ◽  
Author(s):  
Keyvan Kasiri ◽  
Mohammad Javad Shafiee ◽  
Francis Li ◽  
Alexander Wong ◽  
Justin Eichel
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Intelligent Transportation Systems ◽  
Network Architecture ◽  
Deep Neural Network ◽  
Vehicle Detection ◽  
Transportation Systems ◽  
Surveillance Systems ◽  
Performance Accuracy ◽  
Sparse Set

With the progress in intelligent transportation systems in smartcities, vision-based vehicle detection is becoming an important issuein the vision-based surveillance systems. With the advent ofthe big data era, deep learning methods have been increasinglyemployed in the detection, classification, and recognition applicationsdue to their performance accuracy, however, there are stillmajor concerns regarding deployment of such methods in embeddedapplications. This paper offers an efficient process leveragingthe idea of evolutionary deep intelligence on a state-of-the-art deepneural network. Using this approach, the deep neural network isevolved towards a highly sparse set of synaptic weights and clusters.Experimental results for the task of vehicle detection demonstratethat the evolved deep neural network can achieve a substantialimprovement in architecture efficiency adapting for GPUacceleratedapplications without significant sacrifices in detectionaccuracy. The architectural efficiency of ~4X-fold and ~2X-folddecrease is obtained in synaptic weights and clusters, respectively,while the accuracy of 92.8% (drop of less than 4% compared to theoriginal network model) is achieved. Detection results and networkefficiency for the vehicular application are promising, and opensthe door to a wider range of applications in deep learning.

Sign in / Sign up

Export Citation Format

Share Document