scholarly journals Method of Evaluating and Predicting Traffic State of Highway Network Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Jiayu Liu ◽  
Xingju Wang ◽  
Yanting Li ◽  
Xuejian Kang ◽  
Lu Gao
Keyword(s):  
Deep Learning ◽  
Prediction Model ◽  
Network Traffic ◽  
Short Term Memory ◽  
Real Data ◽  
Hebei Province ◽  
Discriminant Model ◽  
Traffic State ◽  
Highway Network

The accurate evaluation and prediction of highway network traffic state can provide effective information for travelers and traffic managers. Based on the deep learning theory, this paper proposes an evaluation and prediction model of highway network traffic state, which consists of a Fuzzy C-means (FCM) algorithm-based traffic state partition model, a Long Short-Term Memory (LSTM) algorithm-based traffic state prediction model, and a K-Means algorithm-based traffic state discriminant model. The highway network in Hebei Province is employed as a case study to validate the model, where the traffic state of highway network is analyzed using both predicted data and real data. The dataset contains 536,823 pieces of data collected by 233 continuous observation stations in Hebei Province from September 5, 2016, to September 12, 2016. The analysis results show that the model proposed in this paper has a good performance on the evaluation and prediction of the traffic state of the highway network, which is consistent with the discriminant result using the real data.

scholarly journals Real-Time Detection of Dictionary DGA Network Traffic Using Deep Learning

2021 ◽  
Vol 2 (2) ◽  
Author(s):  
Kate Highnam ◽  
Domenic Puzio ◽  
Song Luo ◽  
Nicholas R. Jennings
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Real Time ◽  
Network Traffic ◽  
Short Term Memory ◽  
Domain Names ◽  
Control Networks ◽  
Detection Techniques ◽  
Lstm Network ◽  
And Control

AbstractBotnets and malware continue to avoid detection by static rule engines when using domain generation algorithms (DGAs) for callouts to unique, dynamically generated web addresses. Common DGA detection techniques fail to reliably detect DGA variants that combine random dictionary words to create domain names that closely mirror legitimate domains. To combat this, we created a novel hybrid neural network, Bilbo the “bagging” model, that analyses domains and scores the likelihood they are generated by such algorithms and therefore are potentially malicious. Bilbo is the first parallel usage of a convolutional neural network (CNN) and a long short-term memory (LSTM) network for DGA detection. Our unique architecture is found to be the most consistent in performance in terms of AUC, $$F_1$$ F 1 score, and accuracy when generalising across different dictionary DGA classification tasks compared to current state-of-the-art deep learning architectures. We validate using reverse-engineered dictionary DGA domains and detail our real-time implementation strategy for scoring real-world network logs within a large enterprise. In 4 h of actual network traffic, the model discovered at least five potential command-and-control networks that commercial vendor tools did not flag.

scholarly journals Machine Learning and Prediction-Based Resource Management in IoT Considering Qos

2019 ◽  
Vol 8 (2) ◽  
pp. 687-694
Keyword(s):  
Machine Learning ◽  
Prediction Model ◽  
Short Term Memory ◽  
Real Data ◽  
Computing Methods ◽  
Energy Utilization ◽  
Real Field ◽  
Proposed Model ◽  
Improved Performance ◽  
Video Sensors

Internet of Things (IoT) is one of the fast-growing technology paradigms used in every sectors, where in the Quality of Service (QoS) is a critical component in such systems and usage perspective with respect to ProSumers (producer and consumers). Most of the recent research works on QoS in IoT have used Machine Learning (ML) techniques as one of the computing methods for improved performance and solutions. The adoption of Machine Learning and its methodologies have become a common trend and need in every technologies and domain areas, such as open source frameworks, task specific algorithms and using AI and ML techniques. In this work we propose an ML based prediction model for resource optimization in the IoT environment for QoS provisioning. The proposed methodology is implemented by using a multi-layer neural network (MNN) for Long Short Term Memory (LSTM) learning in layered IoT environment. Here the model considers the resources like bandwidth and energy as QoS parameters and provides the required QoS by efficient utilization of the resources in the IoT environment. The performance of the proposed model is evaluated in a real field implementation by considering a civil construction project, where in the real data is collected by using video sensors and mobile devices as edge nodes. Performance of the prediction model is observed that there is an improved bandwidth and energy utilization in turn providing the required QoS in the IoT environment.

scholarly journals Two-Phase Deep Learning-Based EDoS Detection System

2021 ◽  
Vol 11 (21) ◽  
pp. 10249
Author(s):  
Chien-Nguyen Nhu ◽  
Minho Park
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Network Traffic ◽  
Input Data ◽  
Short Term Memory ◽  
Detection System ◽  
Scale Up ◽  
Sequence Length ◽  
Two Phase ◽  
Detection Scheme

Cloud computing is currently considered the most cost-effective platform for offering business and consumer IT services over the Internet. However, it is prone to new vulnerabilities. A new type of attack called an economic denial of sustainability (EDoS) attack exploits the pay-per-use model to scale up the resource usage over time to the extent that the cloud user has to pay for the unexpected usage charge. To prevent EDoS attacks, a few solutions have been proposed, including hard-threshold and machine learning-based solutions. Among them, long short-term memory (LSTM)-based solutions achieve much higher accuracy and false-alarm rates than hard-threshold and other machine learning-based solutions. However, LSTM requires a long sequence length of the input data, leading to a degraded performance owing to increases in the calculations, the detection time, and consuming a large number of computing resources of the defense system. We, therefore, propose a two-phase deep learning-based EDoS detection scheme that uses an LSTM model to detect each abnormal flow in network traffic; however, the LSTM model requires only a short sequence length of five of the input data. Thus, the proposed scheme can take advantage of the efficiency of the LSTM algorithm in detecting each abnormal flow in network traffic, while reducing the required sequence length of the input data. A comprehensive performance evaluation shows that our proposed scheme outperforms the existing solutions in terms of accuracy and resource consumption.

scholarly journals Using Deep Learning to Predict Sentiments: Case Study in Tourism

Complexity ◽  
2018 ◽  
Vol 2018 ◽  
pp. 1-9 ◽  
Author(s):  
C. A. Martín ◽  
J. M. Torres ◽  
R. M. Aguilar ◽  
S. Diaz
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Short Term Memory ◽  
Tourism Industry ◽  
Digital Platforms ◽  
Mass Tourism ◽  
Link Type ◽  
Learning Techniques ◽  
The Relationship

Technology and the Internet have changed how travel is booked, the relationship between travelers and the tourism industry, and how tourists share their travel experiences. As a result of this multiplicity of options, mass tourism markets have been dispersing. But the global demand has not fallen; quite the contrary, it has increased. Another important factor, the digital transformation, is taking hold to reach new client profiles, especially the so-called third generation of tourism consumers, digital natives who only understand the world through their online presence and who make the most of every one of its advantages. In this context, the digital platforms where users publish their impressions of tourism experiences are starting to carry more weight than the corporate content created by companies and brands. In this paper, we propose using different deep-learning techniques and architectures to solve the problem of classifying the comments that tourists publish online and that new tourists use to decide how best to plan their trip. Specifically, in this paper, we propose a classifier to determine the sentiments reflected on the http://booking.com and http://tripadvisor.com platforms for the service received in hotels. We develop and compare various classifiers based on convolutional neural networks (CNN) and long short-term memory networks (LSTM). These classifiers were trained and validated with data from hotels located on the island of Tenerife. An analysis of our findings shows that the most accurate and robust estimators are those based on LSTM recurrent neural networks.

scholarly journals Intelligent Prediction Method of Building Energy Consumption Based on Deep Learning

2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Bingqian Fan ◽  
Xuanxuan Xing
Keyword(s):  
Deep Learning ◽  
Energy Consumption ◽  
Prediction Model ◽  
Prediction Accuracy ◽  
Simulation Experiment ◽  
Short Term Memory ◽  
Building Energy ◽  
Building Energy Consumption ◽  
Energy Consumption Prediction ◽  
Consumption Prediction

Building energy consumption prediction plays an important role in realizing building energy conservation control. Limited by some external factors such as temperature, there are some problems in practical applications, such as complex operation and low prediction accuracy. Aiming at the problem of low prediction accuracy caused by poor timing of existing building energy consumption prediction methods, a building energy consumption prediction and analysis method based on the deep learning network is proposed in this paper. Before establishing the energy consumption prediction model, the building energy consumption data source is preprocessed and analyzed. Then, based on the Keras deep learning framework, an improved long short-term memory (ILSTM) prediction model is built to support the accurate analysis of the whole cycle of the prediction network. At the same time, the adaptive moment (Adam) estimation algorithm is used to update and optimize the weight parameters of the model to realize the adaptive and rapid update and matching of network parameters. The simulation experiment is based on the actual dataset collected by a university in Southwest China. The experimental results show that the evaluation indexes MAE and RMSE of the proposed method are 0.015 and 0.109, respectively, which are better than the comparison method. The simulation experiment proves that the proposed method is feasible.

scholarly journals Pay attention and you won’t lose it: a deep learning approach to sequence imputation

2019 ◽  
Vol 5 ◽  
pp. e210
Author(s):  
Ilia Sucholutsky ◽  
Apurva Narayan ◽  
Matthias Schonlau ◽  
Sebastian Fischmeister
Keyword(s):  
Deep Learning ◽  
Short Term Memory ◽  
Learning Approach ◽  
Short Term ◽  
Fold Reduction ◽  
Data Restoration ◽  
Major Bottleneck ◽  
Long Short Term Memory ◽  
End Stage

In most areas of machine learning, it is assumed that data quality is fairly consistent between training and inference. Unfortunately, in real systems, data are plagued by noise, loss, and various other quality reducing factors. While a number of deep learning algorithms solve end-stage problems of prediction and classification, very few aim to solve the intermediate problems of data pre-processing, cleaning, and restoration. Long Short-Term Memory (LSTM) networks have previously been proposed as a solution for data restoration, but they suffer from a major bottleneck: a large number of sequential operations. We propose using attention mechanisms to entirely replace the recurrent components of these data-restoration networks. We demonstrate that such an approach leads to reduced model sizes by as many as two orders of magnitude, a 2-fold to 4-fold reduction in training times, and 95% accuracy for automotive data restoration. We also show in a case study that this approach improves the performance of downstream algorithms reliant on clean data.

A method for constructing a network traffic classifier based on deep learning

2021 ◽  
Author(s):  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Traffic ◽  
Short Term Memory ◽  
Short Term ◽  
Raw Data ◽  
Term Memory ◽  
High Classification Accuracy ◽  
Data Flows ◽  
Long Short Term Memory

An overview and analysis of methods for constructing of network traffic classifiers is given and the advantage of deep learning methods is shown. Based on a comparative analysis, the methods of deep learning with a teacher is selected. A method based on the use of a multilayer neural network of long short-term memory (LSTM) is considered. The structure of a deep network, at the input of which raw data flows fed, divided into sessions is created. Based on the selected classes of applications, it is experimentally proven that the developed neural network of long short-term memory, to the input of which raw data is supplied, allows to obtain a high classification accuracy. Keywords network traffic; deep learning; long short-term memory neural network; raw data

Sign in / Sign up

Export Citation Format

Share Document