Using recurrent neural networks for probabilistic classification of the processor architecture of executable files

2021 ◽  
Author(s):  
A. A. Gladkikh ◽  
M. O. Komakhin ◽  
A. V. Simankov ◽  
D. A. Uzenkov
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Software Package ◽  
Performance Metrics ◽  
Digital Data ◽  
Processor Architecture ◽  
Classification Problems ◽  
Processor Architectures ◽  
Previous State

The main problem of applying recurrent neural networks to the problem of classifying processor architectures is that the use of a recurrent neural network is complicated by the lack of blocks that allow memorizing and taking into account the result of work at each next step. To solve this problem, the authors proposed a strategy for using a neural network based on the mechanism of controlled recurrent blocks. Each neuron of such a network has a memory cell, which stores the previous state and several filters. The update filter determines how much information will remain from the previous state and how much will be taken from the previous layer. The reset filter determines how much information about previous states is lost. The purpose of the work is to increase the efficiency of determining the processor architecture by code from executable files running on this processor by creating methods, algorithms and programs that are invariant to constant data (strings, constants, header sections, data sections, indents) contained in executable files. The paper discusses the features of the use of recurrent neural networks on the example of the problem of classifying the processor architecture by executable code from compiled executable files. The features of the machine code of various processor architectures used in modern computing have been briefly considered. The use of recurrent neural networks has been proposed, which have advantages in terms of speed and accuracy in solving classification problems. It is noted that in order to improve the classification results and practical use, it is necessary to provide a larger volume of the training sample for each of the classes, as well as to expand the number of classes. The proposed method based on a neural network with a mechanism of controlled recurrent blocks has been implemented in the software package that allows processing digital data from executable files for various processor architectures, in particular at the initial stage of security audit of embedded systems in order to determine a set of technical means that can be applied to analysis at subsequent stages. Conclusions have been drawn about the results of measuring the performance metrics of the algorithm and the possibility of expanding functionality without making changes to the architecture of the software package.

scholarly journals Recurrent Neural Networks for Narrowband Signal Detection in the Time-Frequency Domain

2004 ◽  
Vol 213 ◽  
pp. 483-486
Author(s):  
David Brodrick ◽  
Douglas Taylor ◽  
Joachim Diederich
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Signal Detection ◽  
Frequency Domain ◽  
Recurrent Neural Networks ◽  
Radio Frequency Interference ◽  
Recurrent Networks ◽  
Time Frequency ◽  
Narrowband Signal ◽  
Radio Signals

A recurrent neural network was trained to detect the time-frequency domain signature of narrowband radio signals against a background of astronomical noise. The objective was to investigate the use of recurrent networks for signal detection in the Search for Extra-Terrestrial Intelligence, though the problem is closely analogous to the detection of some classes of Radio Frequency Interference in radio astronomy.

scholarly journals The interaction between structure and meaning in sentence comprehension: Recurrent neural networks and reading times

2019 ◽  
Author(s):  
Stefan L. Frank ◽  
John Hoeks
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Sentence Processing ◽  
Recurrent Neural Networks ◽  
Sentence Comprehension ◽  
Semantic Relations ◽  
Garden Path ◽  
Word Predictability ◽  
Syntactic Ambiguities ◽  
Potential Object

Recurrent neural network (RNN) models of sentence processing have recently displayed a remarkable ability to learn aspects of structure comprehension, as evidenced by their ability to account for reading times on sentences with local syntactic ambiguities (i.e., garden-path effects). Here, we investigate if these models can also simulate the effect of semantic appropriateness of the ambiguity's readings. RNNs-based estimates of surprisal of the disambiguating verb of sentences with an NP/S-coordination ambiguity (as in `The wizard guards the king and the princess protects ...') show identical patters to human reading times on the same sentences: Surprisal is higher on ambiguous structures than on their disambiguated counterparts and this effect is weaker, but not absent, in cases of poor thematic fit between the verb and its potential object (`The teacher baked the cake and the baker made ...'). These results show that an RNN is able to simultaneously learn about structural and semantic relations between words and suggest that garden-path phenomena may be more closely related to word predictability than traditionally assumed.

scholarly journals Binary and Multiclass Text Classification by Means of Separable Convolutional Neural Network

Inventions ◽  
2021 ◽  
Vol 6 (4) ◽  
pp. 70
Author(s):  
Elena Solovyeva ◽  
Ali Abdullah
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Convolutional Neural Network ◽  
Recurrent Neural Networks ◽  
Low Cost ◽  
Computational Cost ◽  
High Accuracy ◽  
Activation Functions ◽  
Fully Connected ◽  
Fully Connected Networks

In this paper, the structure of a separable convolutional neural network that consists of an embedding layer, separable convolutional layers, convolutional layer and global average pooling is represented for binary and multiclass text classifications. The advantage of the proposed structure is the absence of multiple fully connected layers, which is used to increase the classification accuracy but raises the computational cost. The combination of low-cost separable convolutional layers and a convolutional layer is proposed to gain high accuracy and, simultaneously, to reduce the complexity of neural classifiers. Advantages are demonstrated at binary and multiclass classifications of written texts by means of the proposed networks under the sigmoid and Softmax activation functions in convolutional layer. At binary and multiclass classifications, the accuracy obtained by separable convolutional neural networks is higher in comparison with some investigated types of recurrent neural networks and fully connected networks.

scholarly journals Comparison of the efficiency of neural network algorithms in recognition and classification problems

2020 ◽  
Vol 224 ◽  
pp. 01025
Author(s):  
Alexey Beskopylny ◽  
Alexandr Lyapin ◽  
Nikita Beskopylny ◽  
Elena Kadomtseva
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Computation Time ◽  
Classification Problems ◽  
Handwritten Digit Recognition ◽  
Network Algorithms ◽  
Digit Recognition ◽  
Labour Intensity ◽  
Handwritten Digit ◽  
Accuracy Of Results

The article is devoted to the problem of comparing the effectiveness of feedforward (FF) and convolutional neural networks (CNN) algorithms in the problems of handwritten digit recognition and classification. In recent years, the attention of many researchers to the FF and CNN algorithms has given rise to many hybrid models focused on solving specific problems. At the same time, the efficiency of each algorithm in terms of accuracy and labour intensity remains unclear. It is shown that in classical problems, FFs can have advantages over CNN in terms of labour intensity with the same accuracy of results. Using the handwritten digits data from the MNIST database as an example, it is shown that FF algorithms provide greater accuracy and require less computation time than CNN.

scholarly journals ELMAN-RECURRENT NEURAL NETWORK FOR LOAD SHEDDING OPTIMIZATION

SINERGI ◽  
2020 ◽  
Vol 24 (1) ◽  
pp. 29
Author(s):  
Widi Aribowo
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Neural Networks ◽  
Power System ◽  
Recurrent Neural Networks ◽  
Load Shedding ◽  
Feed Forward Neural Network ◽  
Linear Problems ◽  
Elman Recurrent Neural Network ◽  
And Control

Load shedding plays a key part in the avoidance of the power system outage. The frequency and voltage fluidity leads to the spread of a power system into sub-systems and leads to the outage as well as the severe breakdown of the system utility.  In recent years, Neural networks have been very victorious in several signal processing and control applications.  Recurrent Neural networks are capable of handling complex and non-linear problems. This paper provides an algorithm for load shedding using ELMAN Recurrent Neural Networks (RNN). Elman has proposed a partially RNN, where the feedforward connections are modifiable and the recurrent connections are fixed. The research is implemented in MATLAB and the performance is tested with a 6 bus system. The results are compared with the Genetic Algorithm (GA), Combining Genetic Algorithm with Feed Forward Neural Network (hybrid) and RNN. The proposed method is capable of assigning load releases needed and more efficient than other methods. 

scholarly journals PREDICTION OF FINANCIAL DISTRESS: CASE OF MINING ENTERPRISES IN CZECH REPUBLIC

2020 ◽  
Vol 15 (1) ◽  
pp. 1-14
Author(s):  
Zuzana Rowland ◽  
Alla Kasych ◽  
Petr Suler
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Czech Republic ◽  
Financial Stability ◽  
Grey Zone ◽  
Financial Health ◽  
Classification Problems ◽  
Mining Companies ◽  
Artificial Neural

The ability to predict a company's financial health is a challenge for many researchers and scientists. It is also a distracting topic, as many other new approaches to financial health predictions have emerged in recent years. In this paper, we focused on identifying the financial health of mining companies in the Czech Republic. We chose the neural network method because, based on various instances of related research, neural networks represent a more reliable financial forecast than mathematical-statistical methods such as discriminant analysis and logistic regression. The concept of a neural network emerged with the first artificial neural networks, inspired by biological systems. The existence of prediction and classification problems directly predetermines artificial neural networks with respect to a given issue. We used the Amadeus database for processing, including financial indicators, SPSS, and Visual Gene Developer software. In total, we analyzed sixty-four mining companies. Complete data on financial stability were available for fifty-three companies, which we explored, and based on these results, identified financial situations for the other thirteen. Based on the available information, we processed a neural network and regression analysis. We managed to classify thirteen companies as solvent, insolvent, and in the grey zone, with the help of prediction.

scholarly journals Seismic velocity estimation: A deep recurrent neural-network approach

Geophysics ◽  
2019 ◽  
Vol 85 (1) ◽  
pp. U21-U29
Author(s):  
Gabriel Fabien-Ouellet ◽  
Rahul Sarkar
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Model Building ◽  
Seismic Velocity ◽  
Velocity Model ◽  
Velocity Estimation ◽  
Interval Velocity ◽  
Velocity Model Building ◽  
3D Velocity Model

Applying deep learning to 3D velocity model building remains a challenge due to the sheer volume of data required to train large-scale artificial neural networks. Moreover, little is known about what types of network architectures are appropriate for such a complex task. To ease the development of a deep-learning approach for seismic velocity estimation, we have evaluated a simplified surrogate problem — the estimation of the root-mean-square (rms) and interval velocity in time from common-midpoint gathers — for 1D layered velocity models. We have developed a deep neural network, whose design was inspired by the information flow found in semblance analysis. The network replaces semblance estimation by a representation built with a deep convolutional neural network, and then it performs velocity estimation automatically with recurrent neural networks. The network is trained with synthetic data to identify primary reflection events, rms velocity, and interval velocity. For a synthetic test set containing 1D layered models, we find that rms and interval velocity are accurately estimated, with an error of less than [Formula: see text] for the rms velocity. We apply the neural network to a real 2D marine survey and obtain accurate rms velocity predictions leading to a coherent stacked section, in addition to an estimation of the interval velocity that reproduces the main structures in the stacked section. Our results provide strong evidence that neural networks can estimate velocity from seismic data and that good performance can be achieved on real data even if the training is based on synthetics. The findings for the 1D problem suggest that deep convolutional encoders and recurrent neural networks are promising components of more complex networks that can perform 2D and 3D velocity model building.

scholarly journals Forecasting Economy-Related Data Utilizing Weight-Constrained Recurrent Neural Networks

Algorithms ◽  
2019 ◽  
Vol 12 (4) ◽  
pp. 85 ◽  
Author(s):  
Ioannis E. Livieris
Keyword(s):  
Neural Networks ◽  
Recurrent Neural Networks ◽  
Training Algorithm ◽  
Economic Data ◽  
Classification Problems ◽  
Useful Knowledge ◽  
Related Data ◽  
Limited Memory ◽  
Proposed Model ◽  
Projection Strategy

During the last few decades, machine learning has constituted a significant tool in extracting useful knowledge from economic data for assisting decision-making. In this work, we evaluate the performance of weight-constrained recurrent neural networks in forecasting economic classification problems. These networks are efficiently trained with a recently-proposed training algorithm, which has two major advantages. Firstly, it exploits the numerical efficiency and very low memory requirements of the limited memory BFGS matrices; secondly, it utilizes a gradient-projection strategy for handling the bounds on the weights. The reported numerical experiments present the classification accuracy of the proposed model, providing empirical evidence that the application of the bounds on the weights of the recurrent neural network provides more stable and reliable learning.

Sign in / Sign up

Export Citation Format

Share Document