scholarly journals API Call-Based Malware Classification Using Recurrent Neural Networks

2021 ◽  
Author(s):  
Chen Li ◽  
Junjun Zheng
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Short Term Memory ◽  
Application Programming Interface ◽  
Classification Model ◽  
Series Data ◽  
Process Time ◽  
Economic Damage ◽  
Malware Classification

Malicious software, called malware, can perform harmful actions on computer systems, which may cause economic damage and information leakage. Therefore, malware classification is meaningful and required to prevent malware attacks. Application programming interface (API) call sequences are easily observed and are good choices as features for malware classification. However, one of the main issues is how to generate a suitable feature for the algorithms of classification to achieve a high classification accuracy. Different malware sample brings API call sequence with different lengths, and these lengths may reach millions, which may cause computation cost and time complexities. Recurrent neural networks (RNNs) is one of the most versatile approaches to process time series data, which can be used to API call-based Malware calssification. In this paper, we propose a malware classification model with RNN, especially the long short-term memory (LSTM) and the gated recurrent unit (GRU), to classify variants of malware by using long-sequences of API calls. In numerical experiments, a benchmark dataset is used to illustrate the proposed approach and validate its accuracy. The numerical results show that the proposed RNN model works well on the malware classification.

scholarly journals Deep Learning Based Recurrent Neural Networks to Enhance the Performance of Wind Energy Forecasting: A Review

2021 ◽  
Vol 35 (1) ◽  
pp. 1-10
Author(s):  
Senthil Kumar Paramasivan
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Wind Energy ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Short Term Memory ◽  
Function Optimization ◽  
Series Data ◽  
Energy Forecasting

In the modern era, deep learning is a powerful technique in the field of wind energy forecasting. The deep neural network effectively handles the seasonal variation and uncertainty characteristics of wind speed by proper structural design, objective function optimization, and feature learning. The present paper focuses on the critical analysis of wind energy forecasting using deep learning based Recurrent neural networks (RNN) models. It explores RNN and its variants, such as simple RNN, Long Short Term Memory (LSTM), Gated Recurrent Unit (GRU), and Bidirectional RNN models. The recurrent neural network processes the input time series data sequentially and captures well the temporal dependencies exist in the successive input data. This review investigates the RNN models of wind energy forecasting, the data sources utilized, and the performance achieved in terms of the error measures. The overall review shows that the deep learning based RNN improves the performance of wind energy forecasting compared to the conventional techniques.

A review of irregular time series data handling with gated recurrent neural networks

2021 ◽  
Vol 441 ◽  
pp. 161-178
Author(s):  
Philip B. Weerakody ◽  
Kok Wai Wong ◽  
Guanjin Wang ◽  
Wendell Ela
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Data Handling

scholarly journals Observation error covariance specification in dynamical systems for data assimilation using recurrent neural networks

2021 ◽  
Author(s):  
Sibo Cheng ◽  
Mingming Qiu
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Dynamical Systems ◽  
Data Assimilation ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data ◽  
Observation Data ◽  
Observation Error ◽  
Error Covariance

AbstractData assimilation techniques are widely used to predict complex dynamical systems with uncertainties, based on time-series observation data. Error covariance matrices modeling is an important element in data assimilation algorithms which can considerably impact the forecasting accuracy. The estimation of these covariances, which usually relies on empirical assumptions and physical constraints, is often imprecise and computationally expensive, especially for systems of large dimensions. In this work, we propose a data-driven approach based on long short term memory (LSTM) recurrent neural networks (RNN) to improve both the accuracy and the efficiency of observation covariance specification in data assimilation for dynamical systems. Learning the covariance matrix from observed/simulated time-series data, the proposed approach does not require any knowledge or assumption about prior error distribution, unlike classical posterior tuning methods. We have compared the novel approach with two state-of-the-art covariance tuning algorithms, namely DI01 and D05, first in a Lorenz dynamical system and then in a 2D shallow water twin experiments framework with different covariance parameterization using ensemble assimilation. This novel method shows significant advantages in observation covariance specification, assimilation accuracy, and computational efficiency.

scholarly journals Predicting the Dynamic Behaviour of Malware using RNN

2020 ◽  
Vol 9 (3) ◽  
pp. 3557-3559
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Dynamic Behaviour ◽  
Time Series Data ◽  
Malicious Code ◽  
Series Data ◽  
Malware Analysis ◽  
Dynamic Features ◽  
Static And Dynamic Analysis ◽  
Static Code Analysis

Malware analysis can be classified as static and dynamic analysis. Static analysis involves the inspection of the malicious code by observing the features such as file signatures, strings etc. The code obfuscation techniques such as string encryption, class encryption etc can be easily applied on static code analysis. Dynamic or behavioural data is more difficult to obfuscate as the malicious payload may have already been executed before it is detected. In this paper, the dataset is obtained from repositories such as VirusShare and is run in Cuckoo Sandbox with the help of the agent.py. The dynamic features are extracted from the generated Cuckoo logs in the html and JSON format and it has to be determined whether it is malicious or not using recurrent neural networks. Recurrent Neural Networks are capable of predicting whether an executable is malicious and have the ability to capture time-series data.

scholarly journals A Bi–LSTM and k-NN Based Method for Detecting Major Time Zones of Overloaded Vehicles

Symmetry ◽  
2019 ◽  
Vol 11 (9) ◽  
pp. 1160
Author(s):  
Sangmin Park ◽  
Byung-Won On ◽  
Ryong Lee ◽  
Min-Woo Park ◽  
Sang-Hwan Lee
Keyword(s):  
Neural Network ◽  
Urban Areas ◽  
Traffic Accidents ◽  
Time Series Data ◽  
Short Term Memory ◽  
New Method ◽  
Classification Model ◽  
Series Data ◽  
Traffic Condition ◽  
Time Zones

Overloaded vehicles such as large cargo trucks tend to cause large traffic accidents. Such traffic accidents often bring high mortality rates, including injuries and deaths, and cause fatal damage to road structures such as roads and bridges. Therefore, there is a vicious circle in which a lot of the budgets is spent for accident restoration and road maintenance. It is important to control overloaded vehicles that are around roads in urban areas. However, it often takes a lot of manpower to track down on overloaded vehicles at appropriate interception points during a specific time. Moreover, the drivers tend to avoid interception by bypassing the interception point, while exchanging interception information with each other. In this work, the main bridges in a city are chosen as the interception point. Since installing vehicle-weighing devices on the road surface is expensive and the devices cause frequent faults after the installation, inexpensive general-purpose Internet of Things (IoT) sensors, such as acceleration and gyroscope sensors, are installed on the bridges. First, assuming that the sensing value of the overloaded vehicle is different from the nonoverloaded vehicle, we investigate the difference in the sensed values between the overloaded and nonoverloaded vehicles. Then, based on the hypothesis, we propose a new method to identify prime time zones with overloaded vehicles. Technically, the proposed method comprises two steps. In the first step, we propose a new bridge traffic classification model using Bidirectional Long Short-Term Memory (Bi–LSTM) that automatically classifies time series data to either high or low traffic condition. The Bi–LSTM model has higher accuracy than existing neural network models because it has a symmetric neural network structure, by which input information can be processed in forward and backward directions. In the second step, we propose a new method of automatically identifying top-k time zones with many overloaded vehicles under the high traffic condition. It first uses the k-Nearest Neighbor (NN) algorithm to find the sensing value, most similar to the actual sensing value of the overloaded vehicle, in the high traffic cluster. According to the experimental results, there is a high difference of the sensing values between the overloaded and the nonoverloaded vehicle, through statistical verification. Also, the accuracy of the proposed method in the first step is ~75%, and the top-k time zones in which overloaded vehicles are crowded are identified automatically.

Deep machine learning for detection of acoustic wave reflections

2019 ◽  
Vol 19 (5) ◽  
pp. 1340-1350
Author(s):  
Mulugeta A Haile ◽  
Edward Zhu ◽  
Christopher Hsu ◽  
Natasha Bradley
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Acoustic Emission ◽  
Time Series Data ◽  
Short Term Memory ◽  
Series Data ◽  
Short Term ◽  
Term Memory ◽  
Propagating Waves ◽  
Long Short Term Memory

Acoustic emission signals are information rich and can be used to estimate the size and location of damage in structures. However, many existing algorithms may be deceived by indirectly propagated acoustic emission waves which are modulated by reflection boundaries within the structures. We propose two deep learning models to identify such waves such that existing algorithms for damage detection and localization may be used. The first approach uses long short-term memory recurrent neural networks to learn distinct patterns directly from the time-series data. In the second approach, we transform the time-series data into spectrograms and utilize convolutional neural networks to perform binary classification by leveraging spectro-temporal features. We achieved 80% classification accuracy using long short-term memory and near-perfect accuracy using convolutional neural networks on a dataset of acoustic emission signals generated by the Hsu-Nielsen sources. Both long short-term memory and convolutional neural network models were able to learn general and context-specific features of the direct and reflected acoustic emission waves. Once accurately identified, the indirectly propagating waves are filtered out while the directly propagating waves are used for source location using existing methods.

scholarly journals A Simple Distortion-Free Method to Handle Variable Length Sequences for Recurrent Neural Networks in Text Dependent Speaker Verification

2020 ◽  
Vol 10 (12) ◽  
pp. 4092 ◽  
Author(s):  
Sung-Hyun Yoon ◽  
Ha-Jin Yu
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Speaker Verification ◽  
Input Sequence ◽  
Variable Length ◽  
Series Data ◽  
Time Dependency ◽  
Information Distortion ◽  
Text Dependent Speaker Verification

Recurrent neural networks (RNNs) can model the time-dependency of time-series data. It has also been widely used in text-dependent speaker verification to extract speaker-and-phrase-discriminant embeddings. As with other neural networks, RNNs are trained in mini-batch units. In order to feed input sequences into an RNN in mini-batch units, all the sequences in each mini-batch must have the same length. However, the sequences have variable lengths and we have no knowledge of these lengths in advance. Truncation/padding are most commonly used to make all sequences the same length. However, the truncation/padding causes information distortion because some information is lost and/or unnecessary information is added, which can degrade the performance of text-dependent speaker verification. In this paper, we propose a method to handle variable length sequences for RNNs without adding information distortion by truncating the output sequence so that it has the same length as corresponding original input sequence. The experimental results for the text-dependent speaker verification task in part 2 of RSR 2015 show that our method reduces the relative equal error rate by approximately 1.3% to 27.1%, depending on the task, compared to the baselines but with an associated, small overhead in execution time.

Improvement of Variant Adaptable LSTM Trained With Metaheuristic Algorithms for Healthcare Analysis

2021 ◽  
pp. 1031-1051
Author(s):  
Tarik A. Rashid ◽  
Mohammad K. Hassan ◽  
Mokhtar Mohammadi ◽  
Kym Fraser
Keyword(s):  
Diabetes Mellitus ◽  
Neural Networks ◽  
Time Series Data ◽  
Short Term Memory ◽  
Learning Algorithm ◽  
Back Propagation ◽  
Machine Learning Techniques ◽  
Series Data ◽  
Data Sets ◽  
Patients With Diabetes

Recently, the population of the world has increased along with health problems. Diabetes mellitus disease as an example causes issues to the health of many patients globally. The task of this chapter is to develop a dynamic and intelligent decision support system for patients with different diseases, and it aims at examining machine-learning techniques supported by optimization techniques. Artificial neural networks have been used in healthcare for several decades. Most research works utilize multilayer layer perceptron (MLP) trained with back propagation (BP) learning algorithm to achieve diabetes mellitus classification. Nonetheless, MLP has some drawbacks, such as, convergence, which can be slow; local minima can affect the training process. It is hard to scale and cannot be used with time series data sets. To overcome these drawbacks, long short-term memory (LSTM) is suggested, which is a more advanced form of recurrent neural networks. In this chapter, adaptable LSTM trained with two optimizing algorithms instead of the back propagation learning algorithm is presented. The optimization algorithms are biogeography-based optimization (BBO) and genetic algorithm (GA). Dataset is collected locally and another benchmark dataset is used as well. Finally, the datasets fed into adaptable models; LSTM with BBO (LSTMBBO) and LSTM with GA (LSTMGA) for classification purposes. The experimental and testing results are compared and they are promising. This system helps physicians and doctors to provide proper health treatment for patients with diabetes mellitus. Details of source code and implementation of our system can be obtained in the following link “https://github.com/hamakamal/LSTM.”

Bayesian Recurrent Neural Networks for Monitoring Rotorcraft Icing from Aeroacoustics Time-Series Data

2022 ◽  
Author(s):  
Hua Tong ◽  
Jeremiah M. Hauth ◽  
Xun Huan ◽  
Beckett Yx Zhou ◽  
Nicolas R. Gauger ◽  
...  
Keyword(s):  
Neural Networks ◽  
Time Series ◽  
Recurrent Neural Networks ◽  
Time Series Data ◽  
Series Data
Sign in / Sign up

Export Citation Format

Share Document