Multilayer Neural Networks with Receptive Fields as a Model for the Neuron Reconstruction Problem

2012 ◽  
pp. 242-250
Author(s):  
Wojciech Czarnecki
Keyword(s):  
Neural Networks ◽  
Receptive Fields ◽  
Reconstruction Problem ◽  
Neuron Reconstruction ◽  
Multilayer Neural Networks

scholarly journals SOME METHODS OF ADAPTIVE MULTILAYER NEURAL NETWORKS TRAINING

2014 ◽  
pp. 99-106
Author(s):  
Leonid Makhnist ◽  
Nikolaj Maniakov ◽  
Nikolaj Maniakov
Keyword(s):  
Neural Networks ◽  
Basic Concept ◽  
Gradient Descent ◽  
Descent Method ◽  
Gradient Descent Method ◽  
New Techniques ◽  
Adaptive Training ◽  
Multilayer Neural Networks

Is proposed two new techniques for multilayer neural networks training. Its basic concept is based on the gradient descent method. For every methodic are showed formulas for calculation of the adaptive training steps. Presented matrix algorithmizations for all of these techniques are very helpful in its program realization.

Reduced Representation by Neural Networks with Restricted Receptive Fields

1995 ◽  
Vol 7 (3) ◽  
pp. 507-517 ◽  
Author(s):  
Marco Idiart ◽  
Barry Berk ◽  
L. F. Abbott
Keyword(s):  
Neural Networks ◽  
Biological Networks ◽  
Input Data ◽  
Hebbian Learning ◽  
Receptive Fields ◽  
Principal Component ◽  
Data Sets ◽  
Reduced Representation ◽  
Learning Rules ◽  
Reduced Representations

Model neural networks can perform dimensional reductions of input data sets using correlation-based learning rules to adjust their weights. Simple Hebbian learning rules lead to an optimal reduction at the single unit level but result in highly redundant network representations. More complex rules designed to reduce or remove this redundancy can develop optimal principal component representations, but they are not very compelling from a biological perspective. Neurons in biological networks have restricted receptive fields limiting their access to the input data space. We find that, within this restricted receptive field architecture, simple correlation-based learning rules can produce surprisingly efficient reduced representations. When noise is present, the size of the receptive fields can be optimally tuned to maximize the accuracy of reconstructions of input data from a reduced representation.

Sign in / Sign up

Export Citation Format

Share Document