A New Framework for Anomaly Detection Based on KNN-Distort in the Metro Traffic Flow

Author(s):  
Yapeng Zhang ◽  
Nan Hu ◽  
Wenjun Wang ◽  
Hao Yu
2020 ◽  
Vol 2020 ◽  
pp. 1-10
Author(s):  
Mingzhu Tang ◽  
Xiangwan Fu ◽  
Huawei Wu ◽  
Qi Huang ◽  
Qi Zhao

Traffic flow anomaly detection is helpful to improve the efficiency and reliability of detecting fault behavior and the overall effectiveness of the traffic operation. The data detected by the traffic flow sensor contains a lot of noise due to equipment failure, environmental interference, and other factors. In the case of large traffic flow data noises, a traffic flow anomaly detection method based on robust ridge regression with particle swarm optimization (PSO) algorithm is proposed. Feature sets containing historical characteristics with a strong linear correlation and statistical characteristics using the optimal sliding window are constructed. Then by providing the feature sets inputs to the PSO-Huber-Ridge model and the model outputs the traffic flow. The Huber loss function is recommended to reduce noise interference in the traffic flow. The L2 regular term of the ridge regression is employed to reduce the degree of overfitting of the model training. A fitness function is constructed, which can balance the relative size between the k-fold cross-validation root mean square error and the k-fold cross-validation average absolute error with the control parameter η to improve the optimization efficiency of the optimization algorithm and the generalization ability of the proposed model. The hyperparameters of the robust ridge regression forecast model are optimized by the PSO algorithm to obtain the optimal hyperparameters. The traffic flow data set is used to train and validate the proposed model. Compared with other optimization methods, the proposed model has the lowest RMSE, MAE, and MAPE. Finally, the traffic flow that forecasted by the proposed model is used to perform anomaly detection. The abnormality of the error between the forecasted value and the actual value is detected by the abnormal traffic flow threshold based on the sliding window. The experimental results verify the validity of the proposed anomaly detection model.


Author(s):  
Md Rakibul Alam ◽  
Ilias Gerostathopoulos ◽  
Sasan Amini ◽  
Christian Prehofer ◽  
Alessandro Attanasi

2020 ◽  
Vol 17 (3) ◽  
pp. 1349-1362
Author(s):  
Trung V. Phan ◽  
Tri Gia Nguyen ◽  
Nhu-Ngoc Dao ◽  
Truong Thu Huong ◽  
Nguyen Huu Thanh ◽  
...  

Author(s):  
Valliammal Narayan ◽  
Shanmugapriya D.

Information is vital for any organization to communicate through any network. The growth of internet utilization and the web users increased the cyber threats. Cyber-attacks in the network change the traffic flow of each system. Anomaly detection techniques have been developed for different types of cyber-attack or anomaly strategies. Conventional ADS protect information transferred through the network or cyber attackers. The stable prevention of anomalies by machine and deep-learning algorithms are applied for cyber-security. Big data solutions handle voluminous data in a short span of time. Big data management is the organization and manipulation of huge volumes of structured data, semi-structured data and unstructured data, but it does not handle a data imbalance problem during the training process. Big data-based machine and deep-learning algorithms for anomaly detection involve the classification of decision boundary between normal traffic flow and anomaly traffic flow. The performance of anomaly detection is efficiently increased by different algorithms.


Author(s):  
Jinsong Lan ◽  
Cheng Long ◽  
Raymond Chi-Wing Wong ◽  
Youyang Chen ◽  
Yanjie Fu ◽  
...  

2022 ◽  
pp. 678-707
Author(s):  
Valliammal Narayan ◽  
Shanmugapriya D.

Information is vital for any organization to communicate through any network. The growth of internet utilization and the web users increased the cyber threats. Cyber-attacks in the network change the traffic flow of each system. Anomaly detection techniques have been developed for different types of cyber-attack or anomaly strategies. Conventional ADS protect information transferred through the network or cyber attackers. The stable prevention of anomalies by machine and deep-learning algorithms are applied for cyber-security. Big data solutions handle voluminous data in a short span of time. Big data management is the organization and manipulation of huge volumes of structured data, semi-structured data and unstructured data, but it does not handle a data imbalance problem during the training process. Big data-based machine and deep-learning algorithms for anomaly detection involve the classification of decision boundary between normal traffic flow and anomaly traffic flow. The performance of anomaly detection is efficiently increased by different algorithms.


Sign in / Sign up

Export Citation Format

Share Document