Issues in Bayesian Analysis of Neural Network Models

1998 ◽  
Vol 10 (3) ◽  
pp. 749-770 ◽  
Author(s):  
Peter Müller ◽  
David Rios Insua
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Monte Carlo ◽  
Markov Chain ◽  
Markov Chain Monte Carlo ◽  
Bayesian Analysis ◽  
Network Models ◽  
Feedforward Neural Networks ◽  
Data Driven ◽  
Neural Network Models

Stemming from work by Buntine and Weigend (1991) and MacKay (1992), there is a growing interest in Bayesian analysis of neural network models. Although conceptually simple, this problem is computationally involved. We suggest a very efficient Markov chain Monte Carlo scheme for inference and prediction with fixed-architecture feedforward neural networks. The scheme is then extended to the variable architecture case, providing a data-driven procedure to identify sensible architectures.

Neural Network Models for Conditional Distribution Under Bayesian Analysis

2008 ◽  
Vol 20 (2) ◽  
pp. 504-522 ◽  
Author(s):  
Tatiana Miazhynskaia ◽  
Sylvia Frühwirth-Schnatter ◽  
Georg Dorffner
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Monte Carlo ◽  
Markov Chain ◽  
Conditional Distribution ◽  
Strong Support ◽  
Network Models ◽  
Conditional Density ◽  
Neural Network Models ◽  
Model Evidence

We use neural networks (NN) as a tool for a nonlinear autoregression to predict the second moment of the conditional density of return series. The NN models are compared to the popular econometric GARCH(1,1) model. We estimate the models in a Bayesian framework using Markov chain Monte Carlo posterior simulations. The interlinked aspects of the proposed Bayesian methodology are identification of NN hidden units and treatment of NN complexity based on model evidence. The empirical study includes the application of the designed strategy to market data, where we found a strong support for a nonlinear multilayer perceptron model with two hidden units.

scholarly journals Multistage ensemble of feedforward neural networks for prediction of heating energy consumption

2016 ◽  
Vol 20 (4) ◽  
pp. 1321-1331 ◽  
Author(s):  
Radisa Jovanovic ◽  
Aleksandra Sretenovic ◽  
Branislav Zivkovic
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Energy Consumption ◽  
Network Models ◽  
Feedforward Neural Networks ◽  
Neural Network Ensemble ◽  
University Campus ◽  
Neural Network Models ◽  
Feed Forward Neural Networks ◽  
Heating Energy Consumption

Feedforward neural network models are created for prediction of heating energy consumption of a university campus. Actual measured data are used for training and testing the models. Multistage neural network ensemble is proposed for the possible improvement of prediction accuracy. Previously trained feed-forward neural networks are first separated into clusters, using k-means algorithm, and then the best network of each cluster is chosen as a member of the ensemble. Three different averaging methods (simple, weighted and median) for obtaining ensemble output are applied. Besides this conventional approach, single radial basis neural network in the second level is used to aggregate the selected ensemble members. It is shown that heating energy consumption can be predicted with better accuracy by using ensemble of neural networks than using the best trained single neural network, while the best results are achieved with multistage ensemble.

scholarly journals Cocrystal Prediction by Artificial Neural Networks

2020 ◽  
Author(s):  
Jan-Joris Devogelaer ◽  
Hugo Meekes ◽  
Paul Tinnemans ◽  
Elias Vlieg ◽  
Rene de Gelder
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Prediction Method ◽  
Network Models ◽  
Data Driven ◽  
Neural Network Models ◽  
Design And Synthesis ◽  
Structural Database ◽  
Artificial Neural ◽  
Artificial Neural Network Models

<div>A significant amount of attention has been given to the design and synthesis of cocrystals by both industry and academia because of its potential to change a molecule’s physicochemical properties. This paper reports on the application of a data-driven cocrystal prediction method, based on two types of artificial neural network models and cocrystal data present in the Cambridge Structural Database. The models accept pairs of coformers and predict whether a cocrystal is likely to form.</div>

scholarly journals Cocrystal Prediction by Artificial Neural Networks

2020 ◽  
Author(s):  
Jan-Joris Devogelaer ◽  
Hugo Meekes ◽  
Paul Tinnemans ◽  
Elias Vlieg ◽  
Rene de Gelder
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Prediction Method ◽  
Network Models ◽  
Data Driven ◽  
Neural Network Models ◽  
Design And Synthesis ◽  
Structural Database ◽  
Artificial Neural ◽  
Artificial Neural Network Models

<div>A significant amount of attention has been given to the design and synthesis of cocrystals by both industry and academia because of its potential to change a molecule’s physicochemical properties. This paper reports on the application of a data-driven cocrystal prediction method, based on two types of artificial neural network models and cocrystal data present in the Cambridge Structural Database. The models accept pairs of coformers and predict whether a cocrystal is likely to form.</div>

FEEDFORWARD NEURAL NETWORK MODELS FOR HANDLING CLASS OVERLAP AND CLASS IMBALANCE

2005 ◽  
Vol 15 (05) ◽  
pp. 323-338 ◽  
Author(s):  
RALF KRETZSCHMAR ◽  
NICOLAOS B. KARAYIANNIS ◽  
FRITZ EGGIMANN
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Error Function ◽  
Class Imbalance ◽  
Network Models ◽  
Feedforward Neural Networks ◽  
Feedforward Neural Network ◽  
Neural Network Models ◽  
Real World Data ◽  
Special Case

This paper proposes a framework for training feedforward neural network models capable of handling class overlap and imbalance by minimizing an error function that compensates for such imperfections of the training set. A special case of the proposed error function can be used for training variance-controlled neural networks (VCNNs), which are developed to handle class overlap by minimizing an error function involving the class-specific variance (CSV) computed at their outputs. Another special case of the proposed error function can be used for training class-balancing neural networks (CBNNs), which are developed to handle class imbalance by relying on class-specific correction (CSC). VCNNs and CBNNs are compared with conventional feedforward neural networks (FFNNs), quantum neural networks (QNNs), and resampling techniques. The properties of VCNNs and CBNNs are illustrated by experiments on artificial data. Various experiments involving real-world data reveal the advantages offered by VCNNs and CBNNs in the presence of class overlap and class imbalance.

scholarly journals Cocrystal Prediction by Artificial Neural Networks

2020 ◽  
Author(s):  
Jan-Joris Devogelaer ◽  
Hugo Meekes ◽  
Paul Tinnemans ◽  
Elias Vlieg ◽  
Rene de Gelder
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Prediction Method ◽  
Network Models ◽  
Data Driven ◽  
Neural Network Models ◽  
Design And Synthesis ◽  
Structural Database ◽  
Artificial Neural ◽  
Artificial Neural Network Models

<div>A significant amount of attention has been given to the design and synthesis of cocrystals by both industry and academia because of its potential to change a molecule’s physicochemical properties. This paper reports on the application of a data-driven cocrystal prediction method, based on two types of artificial neural network models and cocrystal data present in the Cambridge Structural Database. The models accept pairs of coformers and predict whether a cocrystal is likely to form.</div>

scholarly journals Opening the black box of neural networks: methods for interpreting neural network models in clinical applications

2018 ◽  
Vol 6 (11) ◽  
pp. 216-216 ◽  
Author(s):  
Zhongheng Zhang ◽  
◽  
Marcus W. Beck ◽  
David A. Winkler ◽  
Bin Huang ◽  
...  
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Models ◽  
Black Box ◽  
Clinical Applications ◽  
Neural Network Models

scholarly journals Robotic grasp detection using a novel two-stage approach

2021 ◽  
Vol 1 (1) ◽  
pp. 19-29
Author(s):  
Zhe Chu ◽  
Mengkai Hu ◽  
Xiangyu Chen
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Network Models ◽  
Particle Swarm Optimizer ◽  
Neural Network Models ◽  
Two Stage ◽  
The Neural Network ◽  
End To End ◽  
Small Change ◽  
Robotic Grasp

Recently, deep learning has been successfully applied to robotic grasp detection. Based on convolutional neural networks (CNNs), there have been lots of end-to-end detection approaches. But end-to-end approaches have strict requirements for the dataset used for training the neural network models and it’s hard to achieve in practical use. Therefore, we proposed a two-stage approach using particle swarm optimizer (PSO) candidate estimator and CNN to detect the most likely grasp. Our approach achieved an accuracy of 92.8% on the Cornell Grasp Dataset, which leaped into the front ranks of the existing approaches and is able to run at real-time speeds. After a small change of the approach, we can predict multiple grasps per object in the meantime so that an object can be grasped in a variety of ways.

Sign in / Sign up

Export Citation Format

Share Document