scholarly journals Anomaly Detection in Video Data Based on Probabilistic Latent Space Models

Author(s):  
Giulia Slavic ◽  
Damian Campo ◽  
Mohamad Baydoun ◽  
Pablo Marin ◽  
David Martin ◽  
...  
Author(s):  
Alireza Vafaei Sadr ◽  
Bruce A. Bassett ◽  
M. Kunz

AbstractAnomaly detection is challenging, especially for large datasets in high dimensions. Here, we explore a general anomaly detection framework based on dimensionality reduction and unsupervised clustering. DRAMA is released as a general python package that implements the general framework with a wide range of built-in options. This approach identifies the primary prototypes in the data with anomalies detected by their large distances from the prototypes, either in the latent space or in the original, high-dimensional space. DRAMA is tested on a wide variety of simulated and real datasets, in up to 3000 dimensions, and is found to be robust and highly competitive with commonly used anomaly detection algorithms, especially in high dimensions. The flexibility of the DRAMA framework allows for significant optimization once some examples of anomalies are available, making it ideal for online anomaly detection, active learning, and highly unbalanced datasets. Besides, DRAMA naturally provides clustering of outliers for subsequent analysis.


2021 ◽  
Vol 2021 (8) ◽  
Author(s):  
Oliver Atkinson ◽  
Akanksha Bhardwaj ◽  
Christoph Englert ◽  
Vishal S. Ngairangbam ◽  
Michael Spannowsky

Abstract We devise an autoencoder based strategy to facilitate anomaly detection for boosted jets, employing Graph Neural Networks (GNNs) to do so. To overcome known limitations of GNN autoencoders, we design a symmetric decoder capable of simultaneously reconstructing edge features and node features. Focusing on latent space based discriminators, we find that such setups provide a promising avenue to isolate new physics and competing SM signatures from sensitivity-limiting QCD jet contributions. We demonstrate the flexibility and broad applicability of this approach using examples of W bosons, top quarks, and exotic hadronically-decaying exotic scalar bosons.


2021 ◽  
Vol 30 (1) ◽  
pp. 19-33
Author(s):  
Annis Shafika Amran ◽  
Sharifah Aida Sheikh Ibrahim ◽  
Nurul Hashimah Ahamed Hassain Malim ◽  
Nurfaten Hamzah ◽  
Putra Sumari ◽  
...  

Electroencephalogram (EEG) is a neurotechnology used to measure brain activity via brain impulses. Throughout the years, EEG has contributed tremendously to data-driven research models (e.g., Generalised Linear Models, Bayesian Generative Models, and Latent Space Models) in Neuroscience Technology and Neuroinformatic. Due to versatility, portability, cost feasibility, and non-invasiveness. It contributed to various Neuroscientific data that led to advancement in medical, education, management, and even the marketing field. In the past years, the extensive uses of EEG have been inclined towards medical healthcare studies such as in disease detection and as an intervention in mental disorders, but not fully explored for uses in neuromarketing. Hence, this study construes the data acquisition technique in neuroscience studies using electroencephalogram and outlines the trend of revolution of this technique in aspects of its technology and databases by focusing on neuromarketing uses.


2020 ◽  
Vol 10 (23) ◽  
pp. 8660
Author(s):  
Lu Wang ◽  
Dongkai Zhang ◽  
Jiahao Guo ◽  
Yuexing Han

Detecting image anomalies automatically in industrial scenarios can improve economic efficiency, but the scarcity of anomalous samples increases the challenge of the task. Recently, autoencoder has been widely used in image anomaly detection without using anomalous images during training. However, it is hard to determine the proper dimensionality of the latent space, and it often leads to unwanted reconstructions of the anomalous parts. To solve this problem, we propose a novel method based on the autoencoder. In this method, the latent space of the autoencoder is estimated using a discrete probability model. With the estimated probability model, the anomalous components in the latent space can be well excluded and undesirable reconstruction of the anomalous parts can be avoided. Specifically, we first adopt VQ-VAE as the reconstruction model to get a discrete latent space of normal samples. Then, PixelSail, a deep autoregressive model, is used to estimate the probability model of the discrete latent space. In the detection stage, the autoregressive model will determine the parts that deviate from the normal distribution in the input latent space. Then, the deviation code will be resampled from the normal distribution and decoded to yield a restored image, which is closest to the anomaly input. The anomaly is then detected by comparing the difference between the restored image and the anomaly image. Our proposed method is evaluated on the high-resolution industrial inspection image datasets MVTec AD which consist of 15 categories. The results show that the AUROC of the model improves by 15% over autoencoder and also yields competitive performance compared with state-of-the-art methods.


2017 ◽  
Vol 11 (3) ◽  
pp. 1217-1244 ◽  
Author(s):  
Michael Salter-Townshend ◽  
Tyler H. McCormick

2011 ◽  
Vol 17 (1) ◽  
pp. 1-36 ◽  
Author(s):  
ROXANA GIRJU ◽  
MICHAEL J. PAUL

AbstractReciprocity is a pervasive concept that plays an important role in governing people's behavior, judgments, and thus their social interactions. In this paper we present an analysis of the concept of reciprocity as expressed in English and a way to model it. At a larger structural level the reciprocity model will induce representations and clusters of relations between interpersonal verbs. In particular, we introduce an algorithm that semi-automatically discovers patterns encoding reciprocity based on a set of simple yet effective pronoun templates. Using the most frequently occurring patterns we queried the web and extracted 13,443 reciprocal instances, which represent a broad-coverage resource. Unsupervised clustering procedures are performed to generate meaningful semantic clusters of reciprocal instances. We also present several extensions (along with observations) to these models that incorporate meta-attributes like the verbs' affective value, identify gender differences between participants, consider the textual context of the instances, and automatically discover verbs with certain presuppositions. The pattern discovery procedure yields an accuracy of 97 per cent, while the clustering procedures – clustering with pairwise membership and clustering with transitions – indicate accuracies of 91 per cent and 64 per cent, respectively. Our affective value clustering can predict an unknown verb's affective value (positive, negative, or neutral) with 51 per cent accuracy, while it can discriminate between positive and negative values with 68 per cent accuracy. The presupposition discovery procedure yields an accuracy of 97 per cent.


2021 ◽  
Author(s):  
Yiwen Liao ◽  
Alexander Bartler ◽  
Bin Yang

2019 ◽  
Vol 10 (1) ◽  
Author(s):  
Xinqiang Ding ◽  
Zhengting Zou ◽  
Charles L. Brooks III

AbstractProtein sequences contain rich information about protein evolution, fitness landscapes, and stability. Here we investigate how latent space models trained using variational auto-encoders can infer these properties from sequences. Using both simulated and real sequences, we show that the low dimensional latent space representation of sequences, calculated using the encoder model, captures both evolutionary and ancestral relationships between sequences. Together with experimental fitness data and Gaussian process regression, the latent space representation also enables learning the protein fitness landscape in a continuous low dimensional space. Moreover, the model is also useful in predicting protein mutational stability landscapes and quantifying the importance of stability in shaping protein evolution. Overall, we illustrate that the latent space models learned using variational auto-encoders provide a mechanism for exploration of the rich data contained in protein sequences regarding evolution, fitness and stability and hence are well-suited to help guide protein engineering efforts.


Sign in / Sign up

Export Citation Format

Share Document