scholarly journals Generalized subspace based high dimensional density estimation

2011 ◽  
Author(s):  
Karthikeyan Shanmuga Vadivel ◽  
Mehmet Emre Sargin ◽  
Swapna Joshi ◽  
B.S. Manjunath ◽  
Scott Grafton
Keyword(s):  
Density Estimation ◽  
High Dimensional

scholarly journals Unsupervised Anomaly Detection Based on Deep Autoencoding and Clustering

2021 ◽  
Vol 2021 ◽  
pp. 1-8
Author(s):  
Chuanlei Zhang ◽  
Jiangtao Liu ◽  
Wei Chen ◽  
Jinyuan Shi ◽  
Minda Yao ◽  
...  
Keyword(s):  
Anomaly Detection ◽  
Dimension Reduction ◽  
Density Estimation ◽  
Original Data ◽  
Industrial Applications ◽  
Multidimensional Data ◽  
High Dimensional ◽  
Clustering Methods ◽  
Detection Scheme ◽  
Unsupervised Anomaly Detection

The unsupervised anomaly detection task based on high-dimensional or multidimensional data occupies a very important position in the field of machine learning and industrial applications; especially in the aspect of network security, the anomaly detection of network data is particularly important. The key to anomaly detection is density estimation. Although the methods of dimension reduction and density estimation have made great progress in recent years, most dimension reduction methods are difficult to retain the key information of original data or multidimensional data. Recent studies have shown that the deep autoencoder (DAE) can solve this problem well. In order to improve the performance of unsupervised anomaly detection, we propose an anomaly detection scheme based on a deep autoencoder (DAE) and clustering methods. The deep autoencoder is trained to learn the compressed representation of the input data and then feed it to clustering approach. This scheme makes full use of the advantages of the deep autoencoder (DAE) to generate low-dimensional representation and reconstruction errors for the input high-dimensional or multidimensional data and uses them to reconstruct the input samples. The proposed scheme could eliminate redundant information contained in the data, improve performance of clustering methods in identifying abnormal samples, and reduce the amount of calculation. To verify the effectiveness of the proposed scheme, massive comparison experiments have been conducted with traditional dimension reduction algorithms and clustering methods. The results of experiments demonstrate that, in most cases, the proposed scheme outperforms the traditional dimension reduction algorithms with different clustering methods.

Density estimation of high dimensional data using ICA and Bayesian networks

2014 ◽  
Vol 18 (2) ◽  
pp. 157-179 ◽  
Author(s):  
Abdenebi Rouigueb ◽  
Salim Chitroub ◽  
Ahmed Bouridane
Keyword(s):  
Bayesian Networks ◽  
Density Estimation ◽  
High Dimensional Data ◽  
High Dimensional
Sign in / Sign up

Export Citation Format

Share Document