scholarly journals Decoding Photons: Physics in the Latent Space of a BIB-AE Generative Network

2021 ◽  
Vol 251 ◽  
pp. 03003
Author(s):  
Erik Buhmann ◽  
Sascha Diefenbacher ◽  
Engin Eren ◽  
Frank Gaede ◽  
Gregor Kasieczka ◽  
...  
Keyword(s):  
Neural Networks ◽  
Data Collection ◽  
High Accuracy ◽  
Fast Simulation ◽  
Information Bottleneck ◽  
Latent Space ◽  
Future Collider

Given the increasing data collection capabilities and limited computing resources of future collider experiments, interest in using generative neural networks for the fast simulation of collider events is growing. In our previous study, the Bounded Information Bottleneck Autoencoder (BIB-AE) architecture for generating photon showers in a high-granularity calorimeter showed a high accuracy modeling of various global differential shower distributions. In this work, we investigate how the BIB-AE encodes this physics information in its latent space. Our understanding of this encoding allows us to propose methods to optimize the generation performance further, for example, by altering latent space sampling or by suggesting specific changes to hyperparameters. In particular, we improve the modeling of the shower shape along the particle incident axis.

scholarly journals Variational Information Bottleneck for Unsupervised Clustering: Deep Gaussian Mixture Embedding

Entropy ◽  
2020 ◽  
Vol 22 (2) ◽  
pp. 213 ◽  
Author(s):  
Yiğit Uğur ◽  
George Arvanitakis ◽  
Abdellatif Zaidi
Keyword(s):  
Neural Networks ◽  
Lower Bound ◽  
Gradient Descent ◽  
Gaussian Mixture ◽  
Variational Inference ◽  
Stochastic Gradient Descent ◽  
Information Bottleneck ◽  
Latent Space ◽  
Type Algorithm ◽  
The Cost

In this paper, we develop an unsupervised generative clustering framework that combines the variational information bottleneck and the Gaussian mixture model. Specifically, in our approach, we use the variational information bottleneck method and model the latent space as a mixture of Gaussians. We derive a bound on the cost function of our model that generalizes the Evidence Lower Bound (ELBO) and provide a variational inference type algorithm that allows computing it. In the algorithm, the coders’ mappings are parametrized using neural networks, and the bound is approximated by Markov sampling and optimized with stochastic gradient descent. Numerical results on real datasets are provided to support the efficiency of our method.

Estimating Pigment Concentrations from Spectral Images Using an Encoder‐Decoder Neural Network

2020 ◽  
Vol 64 (3) ◽  
pp. 30502-1-30502-15
Author(s):  
Kensuke Fukumoto ◽  
Norimichi Tsumura ◽  
Roy Berns
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Absorption Coefficient ◽  
Spectral Data ◽  
High Accuracy ◽  
Pigment Concentration ◽  
Scattering Coefficient ◽  
A Value ◽  
Input And Output ◽  
Pigment Concentrations

Abstract A method is proposed to estimate the concentration of pigments mixed in a painting, using the encoder‐decoder model of neural networks. The model is trained to output a value that is the same as its input, and its middle output extracts a certain feature as compressed information about the input. In this instance, the input and output are spectral data of a painting. The model is trained with pigment concentration as the middle output. A dataset containing the scattering coefficient and absorption coefficient of each of 19 pigments was used. The Kubelka‐Munk theory was applied to the coefficients to obtain many patterns of synthetic spectral data, which were used for training. The proposed method was tested using spectral images of 33 paintings, which showed that the method estimates, with high accuracy, the concentrations that have a similar spectrum of the target pigments.

Squeak and rattle noise classification using radial basis function neural networks

2020 ◽  
Vol 68 (4) ◽  
pp. 283-293
Author(s):  
Oleksandr Pogorilyi ◽  
Mohammad Fard ◽  
John Davy ◽  
Mechanical and Automotive Engineering, School ◽  
Mechanical and Automotive Engineering, School ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
High Accuracy ◽  
Training Method ◽  
Vehicle Interior ◽  
Trained Classifier ◽  
Different Types ◽  
Noise Classification ◽  
Automatic Tool ◽  
Multi Class Classification

In this article, an artificial neural network is proposed to classify short audio sequences of squeak and rattle (S&R) noises. The aim of the classification is to see how accurately the trained classifier can recognize different types of S&R sounds. Having a high accuracy model that can recognize audible S&R noises could help to build an automatic tool able to identify unpleasant vehicle interior sounds in a matter of seconds from a short audio recording of the sounds. In this article, the training method of the classifier is proposed, and the results show that the trained model can identify various classes of S&R noises: simple (binary clas- sification) and complex ones (multi class classification).

scholarly journals Financial Information Asymmetry: Using Deep Learning Algorithms to Predict Financial Distress

Symmetry ◽  
2021 ◽  
Vol 13 (3) ◽  
pp. 443
Author(s):  
Chyan-long Jan
Keyword(s):  
Neural Networks ◽  
Deep Learning ◽  
Information Asymmetry ◽  
Error Rate ◽  
Financial Distress ◽  
Prediction Models ◽  
High Accuracy ◽  
Financial Information ◽  
Financial Distress Prediction ◽  
Distress Prediction

Because of the financial information asymmetry, the stakeholders usually do not know a company’s real financial condition until financial distress occurs. Financial distress not only influences a company’s operational sustainability and damages the rights and interests of its stakeholders, it may also harm the national economy and society; hence, it is very important to build high-accuracy financial distress prediction models. The purpose of this study is to build high-accuracy and effective financial distress prediction models by two representative deep learning algorithms: Deep neural networks (DNN) and convolutional neural networks (CNN). In addition, important variables are selected by the chi-squared automatic interaction detector (CHAID). In this study, the data of Taiwan’s listed and OTC sample companies are taken from the Taiwan Economic Journal (TEJ) database during the period from 2000 to 2019, including 86 companies in financial distress and 258 not in financial distress, for a total of 344 companies. According to the empirical results, with the important variables selected by CHAID and modeling by CNN, the CHAID-CNN model has the highest financial distress prediction accuracy rate of 94.23%, and the lowest type I error rate and type II error rate, which are 0.96% and 4.81%, respectively.

Forward Kinematic Modeling of Conical-Shaped Continuum Manipulators

Robotica ◽  
2021 ◽  
pp. 1-19
Author(s):  
A. H. Bouyom Boutchouang ◽  
Achille Melingui ◽  
J. J. B. Mvogo Ahanda ◽  
Othman Lakhal ◽  
Frederic Biya Motto ◽  
...  
Keyword(s):  
Neural Networks ◽  
Data Collection ◽  
Robot Control ◽  
Deep Neural Networks ◽  
Forward Kinematics ◽  
Kinematic Modeling ◽  
Experimental Platform ◽  
Continuum Manipulators ◽  
Forward Kinematic

SUMMARY Forward kinematics is essential in robot control. Its resolution remains a challenge for continuum manipulators because of their inherent flexibility. Learning-based approaches allow obtaining accurate models. However, they suffer from the explosion of the learning database that wears down the manipulator during data collection. This paper proposes an approach that combines the model and learning-based approaches. The learning database is derived from analytical equations to prevent the robot from operating for long periods. The database obtained is handled using Deep Neural Networks (DNNs). The Compact Bionic Handling robot serves as an experimental platform. The comparison with existing approaches gives satisfaction.

scholarly journals High accuracy data-driven heliostat calibration and state prediction with pretrained deep neural networks

Solar Energy ◽  
2021 ◽  
Vol 218 ◽  
pp. 48-56
Author(s):  
Max Pargmann ◽  
Daniel Maldonado Quinto ◽  
Peter Schwarzbözl ◽  
Robert Pitz-Paal
Keyword(s):  
Neural Networks ◽  
Deep Neural Networks ◽  
High Accuracy ◽  
Data Driven ◽  
State Prediction ◽  
Accuracy Data

scholarly journals Anomaly detection with convolutional Graph Neural Networks

2021 ◽  
Vol 2021 (8) ◽  
Author(s):  
Oliver Atkinson ◽  
Akanksha Bhardwaj ◽  
Christoph Englert ◽  
Vishal S. Ngairangbam ◽  
Michael Spannowsky
Keyword(s):  
Neural Networks ◽  
Anomaly Detection ◽  
Top Quarks ◽  
New Physics ◽  
Broad Applicability ◽  
Latent Space ◽  
Edge Features ◽  
Graph Neural Networks ◽  
Promising Avenue ◽  
Do So

Abstract We devise an autoencoder based strategy to facilitate anomaly detection for boosted jets, employing Graph Neural Networks (GNNs) to do so. To overcome known limitations of GNN autoencoders, we design a symmetric decoder capable of simultaneously reconstructing edge features and node features. Focusing on latent space based discriminators, we find that such setups provide a promising avenue to isolate new physics and competing SM signatures from sensitivity-limiting QCD jet contributions. We demonstrate the flexibility and broad applicability of this approach using examples of W bosons, top quarks, and exotic hadronically-decaying exotic scalar bosons.

scholarly journals Representing Deep Neural Networks Latent Space Geometries with Graphs

Algorithms ◽  
2021 ◽  
Vol 14 (2) ◽  
pp. 39
Author(s):  
Carlos Lassance ◽  
Vincent Gripon ◽  
Antonio Ortega
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Deep Learning ◽  
Objective Function ◽  
Learning Process ◽  
Deep Neural Networks ◽  
State Of The Art ◽  
The Core ◽  
Learning Tasks ◽  
Latent Space

Deep Learning (DL) has attracted a lot of attention for its ability to reach state-of-the-art performance in many machine learning tasks. The core principle of DL methods consists of training composite architectures in an end-to-end fashion, where inputs are associated with outputs trained to optimize an objective function. Because of their compositional nature, DL architectures naturally exhibit several intermediate representations of the inputs, which belong to so-called latent spaces. When treated individually, these intermediate representations are most of the time unconstrained during the learning process, as it is unclear which properties should be favored. However, when processing a batch of inputs concurrently, the corresponding set of intermediate representations exhibit relations (what we call a geometry) on which desired properties can be sought. In this work, we show that it is possible to introduce constraints on these latent geometries to address various problems. In more detail, we propose to represent geometries by constructing similarity graphs from the intermediate representations obtained when processing a batch of inputs. By constraining these Latent Geometry Graphs (LGGs), we address the three following problems: (i) reproducing the behavior of a teacher architecture is achieved by mimicking its geometry, (ii) designing efficient embeddings for classification is achieved by targeting specific geometries, and (iii) robustness to deviations on inputs is achieved via enforcing smooth variation of geometry between consecutive latent spaces. Using standard vision benchmarks, we demonstrate the ability of the proposed geometry-based methods in solving the considered problems.

Sign in / Sign up

Export Citation Format

Share Document