Synaptic Plasticity, Dynamic Neural Networks, and Temporal Pattern Representation

2016 ◽  
pp. 689-691 ◽  
Author(s):  
Minoru Tsukada
Keyword(s):  
Neural Networks ◽  
Synaptic Plasticity ◽  
Temporal Pattern ◽  
Dynamic Neural Networks

scholarly journals Exploiting heterogeneity in operational neural networks by synaptic plasticity

2021 ◽  
Author(s):  
Serkan Kiranyaz ◽  
Junaid Malik ◽  
Habib Ben Abdallah ◽  
Turker Ince ◽  
Alexandros Iosifidis ◽  
...  
Keyword(s):  
Neural Networks ◽  
Synaptic Plasticity ◽  
Network Model ◽  
Neuron Model ◽  
Linear Operators ◽  
Training Data ◽  
Learning Performance ◽  
Minimal Network ◽  
Hidden Layer ◽  
Hidden Neurons

AbstractThe recently proposed network model, Operational Neural Networks (ONNs), can generalize the conventional Convolutional Neural Networks (CNNs) that are homogenous only with a linear neuron model. As a heterogenous network model, ONNs are based on a generalized neuron model that can encapsulate any set of non-linear operators to boost diversity and to learn highly complex and multi-modal functions or spaces with minimal network complexity and training data. However, the default search method to find optimal operators in ONNs, the so-called Greedy Iterative Search (GIS) method, usually takes several training sessions to find a single operator set per layer. This is not only computationally demanding, also the network heterogeneity is limited since the same set of operators will then be used for all neurons in each layer. To address this deficiency and exploit a superior level of heterogeneity, in this study the focus is drawn on searching the best-possible operator set(s) for the hidden neurons of the network based on the “Synaptic Plasticity” paradigm that poses the essential learning theory in biological neurons. During training, each operator set in the library can be evaluated by their synaptic plasticity level, ranked from the worst to the best, and an “elite” ONN can then be configured using the top-ranked operator sets found at each hidden layer. Experimental results over highly challenging problems demonstrate that the elite ONNs even with few neurons and layers can achieve a superior learning performance than GIS-based ONNs and as a result, the performance gap over the CNNs further widens.

scholarly journals A New Robust Training Law for Dynamic Neural Networks with External Disturbance: An LMI Approach

2010 ◽  
Vol 2010 ◽  
pp. 1-14 ◽  
Author(s):  
Choon Ki Ahn
Keyword(s):  
Neural Networks ◽  
Linear Matrix Inequality ◽  
Exponential Stability ◽  
External Disturbance ◽  
Linear Matrix ◽  
Matrix Inequality ◽  
Input Output ◽  
Lmi Approach ◽  
Dynamic Neural Networks ◽  
Numerical Examples

A new robust training law, which is called an input/output-to-state stable training law (IOSSTL), is proposed for dynamic neural networks with external disturbance. Based on linear matrix inequality (LMI) formulation, the IOSSTL is presented to not only guarantee exponential stability but also reduce the effect of an external disturbance. It is shown that the IOSSTL can be obtained by solving the LMI, which can be easily facilitated by using some standard numerical packages. Numerical examples are presented to demonstrate the validity of the proposed IOSSTL.

ASSESSING THE PREDICTIONS OF DYNAMIC NEURAL NETWORKS

2005 ◽  
Vol 38 (1) ◽  
pp. 29-34
Author(s):  
K. Dadhe ◽  
S. Engell
Keyword(s):  
Neural Networks ◽  
Dynamic Neural Networks

A methodology for modeling batch reactors using generalized dynamic neural networks

2010 ◽  
Vol 159 (1-3) ◽  
pp. 195-202 ◽  
Author(s):  
Moein Navvab Kashani ◽  
Shahrokh Shahhosseini
Keyword(s):  
Neural Networks ◽  
Batch Reactors ◽  
Dynamic Neural Networks
Sign in / Sign up

Export Citation Format

Share Document