scholarly journals Artificial neural networks based techniques for anomaly detection in Apache Spark

2019 ◽  
Vol 23 (2) ◽  
pp. 1345-1360 ◽  
Author(s):  
Ahmad Alnafessah ◽  
Giuliano Casale
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Anomaly Detection ◽  
Nearest Neighbor ◽  
Machine Learning Algorithms ◽  
Apache Spark ◽  
Detection Methods ◽  
Support Vector ◽  
Data Systems ◽  
Artificial Neural

Abstract Late detection and manual resolutions of performance anomalies in Cloud Computing and Big Data systems may lead to performance violations and financial penalties. Motivated by this issue, we propose an artificial neural network based methodology for anomaly detection tailored to the Apache Spark in-memory processing platform. Apache Spark is widely adopted by industry because of its speed and generality, however there is still a shortage of comprehensive performance anomaly detection methods applicable to this platform. We propose an artificial neural networks driven methodology to quickly sift through Spark logs data and operating system monitoring metrics to accurately detect and classify anomalous behaviors based on the Spark resilient distributed dataset characteristics. The proposed method is evaluated against three popular machine learning algorithms, decision trees, nearest neighbor, and support vector machine, as well as against four variants that consider different monitoring datasets. The results prove that our proposed method outperforms other methods, typically achieving 98–99% F-scores, and offering much greater accuracy than alternative techniques to detect both the period in which anomalies occurred and their type.

An Efficient Hybrid Forecasting Approach for Wind Speed Time Series

2017 ◽  
Vol 7 (9) ◽  
pp. 13
Author(s):  
Bhargavi Munnaluri ◽  
K. Ganesh Reddy
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Wind Speed ◽  
Fossil Fuels ◽  
Renewable Energy Sources ◽  
Support Vector ◽  
Hybrid Forecasting ◽  
Artificial Neural ◽  
Future Utilization

Wind forecasting is one of the best efficient ways to deal with the challenges of wind power generation. Due to the depletion of fossil fuels renewable energy sources plays a major role for the generation of power. For future management and for future utilization of power, we need to predict the wind speed.  In this paper, an efficient hybrid forecasting approach with the combination of Support Vector Machine (SVM) and Artificial Neural Networks(ANN) are proposed to improve the quality of prediction of wind speed. Due to the different parameters of wind, it is difficult to find the accurate prediction value of the wind speed. The proposed hybrid model of forecasting is examined by taking the hourly wind speed of past years data by reducing the prediction error with the help of Mean Square Error by 0.019. The result obtained from the Artificial Neural Networks improves the forecasting quality.

scholarly journals Adaptive Detection of Direct-Sequence Spread-Spectrum Signals Based on Knowledge-Enhanced Compressive Measurements and Artificial Neural Networks

Sensors ◽  
2021 ◽  
Vol 21 (7) ◽  
pp. 2538
Author(s):  
Shuang Zhang ◽  
Feng Liu ◽  
Yuang Huang ◽  
Xuedong Meng
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Spread Spectrum ◽  
High Efficiency ◽  
Detection System ◽  
Direct Sequence Spread Spectrum ◽  
Detection Performance ◽  
Detection Methods ◽  
Direct Sequence ◽  
Artificial Neural

The direct-sequence spread-spectrum (DSSS) technique has been widely used in wireless secure communications. In this technique, the baseband signal is spread over a wider bandwidth using pseudo-random sequences to avoid interference or interception. In this paper, the authors propose methods to adaptively detect the DSSS signals based on knowledge-enhanced compressive measurements and artificial neural networks. Compared with the conventional non-compressive detection system, the compressive detection framework can achieve a reasonable balance between detection performance and sampling hardware cost. In contrast to the existing compressive sampling techniques, the proposed methods are shown to enable adaptive measurement kernel design with high efficiency. Through the theoretical analysis and the simulation results, the proposed adaptive compressive detection methods are also demonstrated to provide significantly enhanced detection performance efficiently, compared to their counterpart with the conventional random measurement kernels.

scholarly journals The Budapest Amyloid Predictor and Its Applications

Biomolecules ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 500
Author(s):  
László Keresztes ◽  
Evelin Szögi ◽  
Bálint Varga ◽  
Viktor Farkas ◽  
András Perczel ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
User Needs ◽  
Computational Technique ◽  
Linear Support Vector Machine ◽  
Β Sheets ◽  
Artificial Neural ◽  
Amorphous Aggregation

The amyloid state of proteins is widely studied with relevance to neurology, biochemistry, and biotechnology. In contrast with nearly amorphous aggregation, the amyloid state has a well-defined structure, consisting of parallel and antiparallel β-sheets in a periodically repeated formation. The understanding of the amyloid state is growing with the development of novel molecular imaging tools, like cryogenic electron microscopy. Sequence-based amyloid predictors were developed, mainly using artificial neural networks (ANNs) as the underlying computational technique. From a good neural-network-based predictor, it is a very difficult task to identify the attributes of the input amino acid sequence, which imply the decision of the network. Here, we present a linear Support Vector Machine (SVM)-based predictor for hexapeptides with correctness higher than 84%, i.e., it is at least as good as the best published ANN-based tools. Unlike artificial neural networks, the decisions of the linear SVMs are much easier to analyze and, from a good predictor, we can infer rich biochemical knowledge. In the Budapest Amyloid Predictor webserver the user needs to input a hexapeptide, and the server outputs a prediction for the input plus the 6 × 19 = 114 distance-1 neighbors of the input hexapeptide.

MODELING OF NEURAL PREDICTIVE CONTROL OF IRRIGATION MACHINES

2021 ◽  
pp. 14-22
Author(s):  
G. N. KAMYSHOVA ◽  
Keyword(s):  
Neural Networks ◽  
Artificial Neural Networks ◽  
Real Time ◽  
Predictive Control ◽  
Intelligent Control ◽  
Machine Learning Algorithms ◽  
Intelligent Control Systems ◽  
Artificial Neural ◽  
The One ◽  
Neural Predictive Control

The purpose of the study is to develop new scientific approaches to improve the efficiency of irrigation machines. Modern digital technologies allow the collection of data, their analysis and operational management of equipment and technological processes, often in real time. All this allows, on the one hand, applying new approaches to modeling technical systems and processes (the so-called “data-driven models”), on the other hand, it requires the development of fundamentally new models, which will be based on the methods of artificial intelligence (artificial neural networks, fuzzy logic, machine learning algorithms and etc.).The analysis of the tracks and the actual speeds of the irrigation machines in real time showed their significant deviations in the range from the specified speed, which leads to a deterioration in the irrigation parameters. We have developed an irrigation machine’s control model based on predictive control approaches and the theory of artificial neural networks. Application of the model makes it possible to implement control algorithms with predicting the response of the irrigation machine to the control signal. A diagram of an algorithm for constructing predictive control, a structure of a neuroregulator and tools for its synthesis using modern software are proposed. The versatility of the model makes it possible to use it both to improve the efficiency of management of existing irrigation machines and to develop new ones with integrated intelligent control systems.

IMPROVEMENT OF DOSE ESTIMATION PROCESS USING ARTIFICIAL NEURAL NETWORKS

2018 ◽  
Vol 184 (1) ◽  
pp. 36-43 ◽  
Author(s):  
Gal Amit ◽  
Hanan Datz
Keyword(s):  
Neural Networks ◽  
Support Vector Machine ◽  
Artificial Neural Networks ◽  
Support Vector ◽  
Physical Parameters ◽  
Machine Method ◽  
Algorithm Performance ◽  
Artificial Neural ◽  
First Time ◽  
Automatic Algorithm

Abstract We present here for the first time a fast and reliable automatic algorithm based on artificial neural networks for the anomaly detection of a thermoluminescence dosemeter (TLD) glow curves (GCs), and compare its performance with formerly developed support vector machine method. The GC shape of TLD depends on numerous physical parameters, which may significantly affect it. When integrated into a dosimetry laboratory, this automatic algorithm can classify ‘anomalous’ (having any kind of anomaly) GCs for manual review, and ‘regular’ (acceptable) GCs for automatic analysis. The new algorithm performance is then compared with two kinds of formerly developed support vector machine classifiers—regular and weighted ones—using three different metrics. Results show an impressive accuracy rate of 97% for TLD GCs that are correctly classified to either of the classes.

Sign in / Sign up

Export Citation Format

Share Document