scholarly journals A LSTM-RNN-Based Fiber Optic Gyroscope Drift Compensation

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Ning Mao ◽  
Jiangning Xu ◽  
Jingshu Li ◽  
Hongyang He
Keyword(s):  
Neural Network ◽  
Fiber Optic ◽  
Short Term Memory ◽  
Moving Average ◽  
Regression Tree ◽  
Classification And Regression Tree ◽  
Measurement Unit ◽  
Support Vector ◽  
Fiber Optic Gyroscope ◽  
Temperature Drift

Fiber optic gyroscope (FOG) inertial measurement unit (IMU) containing a three-orthogonal gyroscope and three-orthogonal accelerometer has been widely utilized in positioning and navigation of military and aerospace fields, due to its simple structure, small size, and high accuracy. However, noise such as temperature drift will reduce the accuracy of FOG, which will affect the resolution accuracy of IMU. In order to reduce the FOG drift and improve the navigation accuracy, a long short-term memory recurrent neural network (LSTM-RNN) model is established, and a real-time acquisition method of the temperature change rate based on moving average is proposed. In addition, for comparative analysis, backpropagation (BP) neural network model, CART-Bagging, classification and regression tree (CART) model, and online support vector machine regression (Online-SVR) model are established to filter FOG outputs. Numerical simulation based on field test data in the range of -20°C to 50°C is employed to verify the effectiveness and superiority of the LSTM-RNN model. The results indicate that the LSTM-RNN model has better compensation accuracy and stability, which is suitable for online compensation. This proposed solution can be applied in military and aerospace fields.

scholarly journals A Novel Design of Classification of Coronary Artery Disease Using Deep Learning and Data Mining Algorithms

2021 ◽  
Vol 35 (3) ◽  
pp. 209-215
Author(s):  
Pratibha Verma ◽  
Vineet Kumar Awasthi ◽  
Sanat Kumar Sahu
Keyword(s):  
Neural Network ◽  
Data Mining ◽  
Deep Learning ◽  
Regression Tree ◽  
Principal Component ◽  
Classification And Regression Tree ◽  
Support Vector ◽  
Data Mining Algorithms ◽  
R Programming ◽  
Hidden Layer

Data mining techniques are included with Ensemble learning and deep learning for the classification. The methods used for classification are, Single C5.0 Tree (C5.0), Classification and Regression Tree (CART), kernel-based Support Vector Machine (SVM) with linear kernel, ensemble (CART, SVM, C5.0), Neural Network-based Fit single-hidden-layer neural network (NN), Neural Networks with Principal Component Analysis (PCA-NN), deep learning-based H2OBinomialModel-Deeplearning (HBM-DNN) and Enhanced H2OBinomialModel-Deeplearning (EHBM-DNN). In this study, experiments were conducted on pre-processed datasets using R programming and 10-fold cross-validation technique. The findings show that the ensemble model (CART, SVM and C5.0) and EHBM-DNN are more accurate for classification, compared with other methods.

scholarly journals An Innovative Wavelet Threshold Denoising Method for Environmental Drift of Fiber Optic Gyro

2016 ◽  
Vol 2016 ◽  
pp. 1-8 ◽  
Author(s):  
Qian Zhang ◽  
Lei Wang ◽  
Pengyu Gao ◽  
Zengjun Liu
Keyword(s):  
Neural Network ◽  
Fiber Optic ◽  
Back Propagation ◽  
Threshold Value ◽  
Allan Variance ◽  
Discrete Wavelet ◽  
Fiber Optic Gyroscope ◽  
Threshold Method ◽  
Temperature Drift ◽  
Denoising Method

Fiber optic gyroscope (FOG) is a core component in modern inertial technology. However, the precision and performance of FOG will be degraded by environmental drift, especially in complex temperature environment. As the modeling performance is affected by the noises in the output data of FOG, an improved wavelet threshold value based on Allan variance and Classical variance is proposed for discrete wavelet analysis to decompose the temperature drift trend item and noise items. Firstly, the relationship of Allan variance and Classical variance is introduced by analyzing the drawback of traditional wavelet threshold. Secondly, an improved threshold is put forward based on Allan variance and Classical variance which overcomes the shortcoming of traditional wavelet threshold method. Finally, the innovative threshold algorithm is experimentally evaluated on FOG. The mathematical evaluation results show that the new method can get better signal-to-noise ratio (SNR) and gain the reconstruction signal of the higher correlation coefficient (CC). As an experimental validation, the nonlinear capability of error back propagation neural network (BP neural network) is used to fit the drift trend item and find out the complex relationship between the FOG drift and temperature, and the final processing results indicate that the new denoising method can get better root of mean square error (MSE).

scholarly journals Data-Driven Stability Assessment of Multilayer Long Short-Term Memory Networks

2021 ◽  
Vol 11 (4) ◽  
pp. 1829
Author(s):  
Davide Grande ◽  
Catherine A. Harris ◽  
Giles Thomas ◽  
Enrico Anderlini
Keyword(s):  
Neural Network ◽  
Network Architecture ◽  
Short Term Memory ◽  
Moving Average ◽  
Machine Learning Algorithms ◽  
Physical Models ◽  
Data Driven ◽  
The Stability ◽  
And Control ◽  
Nonlinear Autoregressive

Recurrent Neural Networks (RNNs) are increasingly being used for model identification, forecasting and control. When identifying physical models with unknown mathematical knowledge of the system, Nonlinear AutoRegressive models with eXogenous inputs (NARX) or Nonlinear AutoRegressive Moving-Average models with eXogenous inputs (NARMAX) methods are typically used. In the context of data-driven control, machine learning algorithms are proven to have comparable performances to advanced control techniques, but lack the properties of the traditional stability theory. This paper illustrates a method to prove a posteriori the stability of a generic neural network, showing its application to the state-of-the-art RNN architecture. The presented method relies on identifying the poles associated with the network designed starting from the input/output data. Providing a framework to guarantee the stability of any neural network architecture combined with the generalisability properties and applicability to different fields can significantly broaden their use in dynamic systems modelling and control.

scholarly journals HARTH: A Human Activity Recognition Dataset for Machine Learning

Sensors ◽  
2021 ◽  
Vol 21 (23) ◽  
pp. 7853
Author(s):  
Aleksej Logacjov ◽  
Kerstin Bach ◽  
Atle Kongsvold ◽  
Hilde Bremseth Bårdstu ◽  
Paul Jarle Mork
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Support Vector Machine ◽  
Convolutional Neural Network ◽  
Activity Recognition ◽  
Human Activity ◽  
Short Term Memory ◽  
Human Activity Recognition ◽  
Support Vector ◽  
Free Living

Existing accelerometer-based human activity recognition (HAR) benchmark datasets that were recorded during free living suffer from non-fixed sensor placement, the usage of only one sensor, and unreliable annotations. We make two contributions in this work. First, we present the publicly available Human Activity Recognition Trondheim dataset (HARTH). Twenty-two participants were recorded for 90 to 120 min during their regular working hours using two three-axial accelerometers, attached to the thigh and lower back, and a chest-mounted camera. Experts annotated the data independently using the camera’s video signal and achieved high inter-rater agreement (Fleiss’ Kappa =0.96). They labeled twelve activities. The second contribution of this paper is the training of seven different baseline machine learning models for HAR on our dataset. We used a support vector machine, k-nearest neighbor, random forest, extreme gradient boost, convolutional neural network, bidirectional long short-term memory, and convolutional neural network with multi-resolution blocks. The support vector machine achieved the best results with an F1-score of 0.81 (standard deviation: ±0.18), recall of 0.85±0.13, and precision of 0.79±0.22 in a leave-one-subject-out cross-validation. Our highly professional recordings and annotations provide a promising benchmark dataset for researchers to develop innovative machine learning approaches for precise HAR in free living.

Categorizing Natural Language-Based Customer Satisfaction: An Implementation Method Using Support Vector Machine and Long Short-Term Memory Neural Network

2021 ◽  
Vol 13 (4) ◽  
Author(s):  
Ralph Sherwin A. Corpuz ◽  
Keyword(s):  
Neural Network ◽  
Support Vector Machine ◽  
Natural Language ◽  
Text Categorization ◽  
Short Term Memory ◽  
Support Vector ◽  
Feature Engineering ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Analyzing natural language-based Customer Satisfaction (CS) is a tedious process. This issue is practically true if one is to manually categorize large datasets. Fortunately, the advent of supervised machine learning techniques has paved the way toward the design of efficient categorization systems used for CS. This paper presents the feasibility of designing a text categorization model using two popular and robust algorithms – the Support Vector Machine (SVM) and Long Short-Term Memory (LSTM) Neural Network, in order to automatically categorize complaints, suggestions, feedbacks, and commendations. The study found that, in terms of training accuracy, SVM has best rating of 98.63% while LSTM has best rating of 99.32%. Such results mean that both SVM and LSTM algorithms are at par with each other in terms of training accuracy, but SVM is significantly faster than LSTM by approximately 35.47s. The training performance results of both algorithms are attributed on the limitations of the dataset size, high-dimensionality of both English and Tagalog languages, and applicability of the feature engineering techniques used. Interestingly, based on the results of actual implementation, both algorithms are found to be 100% effective in accurately predicting the correct CS categories. Hence, the extent of preference between the two algorithms boils down on the available dataset and the skill in optimizing these algorithms through feature engineering techniques and in implementing them toward actual text categorization applications.

Intelligent fault diagnosis algorithm for fiber optic current transformer

2020 ◽  
Vol 64 (1-4) ◽  
pp. 3-10
Author(s):  
Lihui Wang ◽  
Kai Zhao ◽  
Wenpeng Zhang ◽  
Jian Liu ◽  
Fubin Pang
Keyword(s):  
Fault Diagnosis ◽  
Fiber Optic ◽  
Short Term Memory ◽  
Current Transformer ◽  
Support Vector ◽  
Intelligent Fault Diagnosis ◽  
Signal Prediction ◽  
Residual Signal ◽  
Signal Characteristics ◽  
Diagnosis Algorithm

Affected by environmental factors, the performance of fiber optic current transformer (FOCT) will deteriorate over a long period of time. Intelligent fault diagnosis algorithm of Long-Short Term Memory (LSTM) combing with Support Vector Machine (SVM) is an effective way to deal with FOCT failures. According to the characteristics of LSTM, a signal prediction model in FOCT based on LSTM is proposed by analyzing the historical data. The residual signal can be obtained by the prediction signal and the observed signal. Set the residual threshold to determine whether the FOCT has fault. With the residual signal characteristics, a fault diagnosis model based on SVM is established. By analyzing the residual signal and extracting features, the diagnostic network can realize the pattern recognition and system fault diagnosis. Experiments demonstrate that the drift deviation fault, the ratio deviation fault and the fixed deviation fault can be diagnosed with an accuracy of 94.5%.

scholarly journals Explicitly Identifying the Desertification Change in CMREC Area Based on Multisource Remote Data

2020 ◽  
Vol 12 (19) ◽  
pp. 3170
Author(s):  
Zemeng Fan ◽  
Saibo Li ◽  
Haiyan Fang
Keyword(s):  
Climate Change ◽  
Human Activities ◽  
Vegetation Index ◽  
Normalized Difference Vegetation Index ◽  
Net Primary Productivity ◽  
Regression Tree ◽  
Google Earth ◽  
Classification And Regression Tree ◽  
Support Vector ◽  
Driving Mechanisms

Explicitly identifying the desertification changes and causes has been a hot issue of eco-environment sustainable development in the China–Mongolia–Russia Economic Corridor (CMREC) area. In this paper, the desertification change patterns between 2000 and 2015 were identified by operating the classification and regression tree (CART) method with multisource remote sensing datasets on Google Earth Engine (GEE), which has the higher overall accuracy (85%) than three other methods, namely support vector machine (SVM), random forest (RF) and Albedo-normalized difference vegetation index (NDVI) models. A contribution index of climate change and human activities on desertification was introduced to quantitatively explicate the driving mechanisms of desertification change based on the temporal datasets and net primary productivity (NPP). The results show that the area of slight desertification land had increased from 719,700 km2 to 948,000 km2 between 2000 and 2015. The area of severe desertification land decreased from 82,400 km2 to 71,200 km2. The area of desertification increased by 9.68%, in which 69.68% was mainly caused by human activities. Climate change and human activities accounted for 68.8% and 27.36%, respectively, in the area of desertification restoration. In general, the degree of desertification showed a decreasing trend, and climate change was the major driving factor in the CMREC area between 2000 and 2015.

scholarly journals Multi-Regional Online Car-Hailing Order Quantity Forecasting Based on the Convolutional Neural Network

Information ◽  
2019 ◽  
Vol 10 (6) ◽  
pp. 193 ◽  
Author(s):  
Zihao Huang ◽  
Gang Huang ◽  
Zhijun Chen ◽  
Chaozhong Wu ◽  
Xiaofeng Ma ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Travel Demand ◽  
Short Term Memory ◽  
Demand Forecasting ◽  
Image Feature ◽  
Support Vector ◽  
Data Set ◽  
Demand Distribution ◽  
Demand Forecasting Model

With the development of online cars, the demand for travel prediction is increasing in order to reduce the information asymmetry between passengers and drivers of online car-hailing. This paper proposes a travel demand forecasting model named OC-CNN based on the convolutional neural network to forecast the travel demand. In order to make full use of the spatial characteristics of the travel demand distribution, this paper meshes the prediction area and creates a travel demand data set of the graphical structure to preserve its spatial properties. Taking advantage of the convolutional neural network in image feature extraction, the historical demand data of the first twenty-five minutes of the entire region are used as a model input to predict the travel demand for the next five minutes. In order to verify the performance of the proposed method, one-month data from online car-hailing of the Chengdu Fourth Ring Road are used. The results show that the model successfully extracts the spatiotemporal features of the data, and the prediction accuracies of the proposed method are superior to those of the representative methods, including the Bayesian Ridge Model, Linear Regression, Support Vector Regression, and Long Short-Term Memory networks.

Patient visit forecasting in an emergency department using a deep neural network approach

Kybernetes ◽  
2019 ◽  
Vol 49 (9) ◽  
pp. 2335-2348 ◽  
Author(s):  
Milad Yousefi ◽  
Moslem Yousefi ◽  
Masood Fathi ◽  
Flavio S. Fogliatto
Keyword(s):  
Neural Network ◽  
Emergency Department ◽  
Linear Regression ◽  
Deep Neural Network ◽  
Short Term Memory ◽  
Demand Forecasting ◽  
Machine Learning Algorithms ◽  
Support Vector ◽  
Neural Network Approach ◽  
Content Type

Purpose This study aims to investigate the factors affecting daily demand in an emergency department (ED) and to provide a forecasting tool in a public hospital for horizons of up to seven days. Design/methodology/approach In this study, first, the important factors to influence the demand in EDs were extracted from literature then the relevant factors to the study are selected. Then, a deep neural network is applied to constructing a reliable predictor. Findings Although many statistical approaches have been proposed for tackling this issue, better forecasts are viable by using the abilities of machine learning algorithms. Results indicate that the proposed approach outperforms statistical alternatives available in the literature such as multiple linear regression, autoregressive integrated moving average, support vector regression, generalized linear models, generalized estimating equations, seasonal ARIMA and combined ARIMA and linear regression. Research limitations/implications The authors applied this study in a single ED to forecast patient visits. Applying the same method in different EDs may give a better understanding of the performance of the model to the authors. The same approach can be applied in any other demand forecasting after some minor modifications. Originality/value To the best of the knowledge, this is the first study to propose the use of long short-term memory for constructing a predictor of the number of patient visits in EDs.

Sign in / Sign up

Export Citation Format

Share Document