scholarly journals A Reward-Modulated Hebbian Learning Rule Can Explain Experimentally Observed Network Reorganization in a Brain Control Task

2010 ◽  
Vol 30 (25) ◽  
pp. 8400-8410 ◽  
Author(s):  
R. Legenstein ◽  
S. M. Chase ◽  
A. B. Schwartz ◽  
W. Maass
Keyword(s):  
Hebbian Learning ◽  
Learning Rule ◽  
Control Task ◽  
Hebbian Learning Rule

scholarly journals Synaptic memory devices from CoO/Nb:SrTiO 3 junction

2019 ◽  
Vol 6 (4) ◽  
pp. 181098 ◽  
Author(s):  
Le Zhao ◽  
Jie Xu ◽  
Xiantao Shang ◽  
Xue Li ◽  
Qiang Li ◽  
...  
Keyword(s):  
Large Scale ◽  
Hebbian Learning ◽  
Learning Rule ◽  
Charge Trapping ◽  
Spike Timing ◽  
Hebbian Learning Rule ◽  
Synaptic Functions ◽  
Neuromorphic System ◽  
Reduce Energy Consumption ◽  
Novel Design

Non-volatile memristors are promising for future hardware-based neurocomputation application because they are capable of emulating biological synaptic functions. Various material strategies have been studied to pursue better device performance, such as lower energy cost, better biological plausibility, etc. In this work, we show a novel design for non-volatile memristor based on CoO/Nb:SrTiO 3 heterojunction. We found the memristor intrinsically exhibited resistivity switching behaviours, which can be ascribed to the migration of oxygen vacancies and charge trapping and detrapping at the heterojunction interface. The carrier trapping/detrapping level can be finely adjusted by regulating voltage amplitudes. Gradual conductance modulation can therefore be realized by using proper voltage pulse stimulations. And the spike-timing-dependent plasticity, an important Hebbian learning rule, has been implemented in the device. Our results indicate the possibility of achieving artificial synapses with CoO/Nb:SrTiO 3 heterojunction. Compared with filamentary type of the synaptic device, our device has the potential to reduce energy consumption, realize large-scale neuromorphic system and work more reliably, since no structural distortion occurs.

ASSOCIATIVE MEMORY IN NEURAL NETWORKS WITH THE HEBBIAN LEARNING RULE

1989 ◽  
Vol 03 (07) ◽  
pp. 555-560 ◽  
Author(s):  
M.V. TSODYKS
Keyword(s):  
Neural Networks ◽  
Associative Memory ◽  
Hebbian Learning ◽  
Learning Rule ◽  
Network Activity ◽  
Hebbian Learning Rule ◽  
Level Of Activity ◽  
The Mean ◽  
Full Network ◽  
Simultaneous Activity

We consider the Hopfield model with the most simple form of the Hebbian learning rule, when only simultaneous activity of pre- and post-synaptic neurons leads to modification of synapse. An extra inhibition proportional to full network activity is needed. Both symmetric nondiluted and asymmetric diluted networks are considered. The model performs well at extremely low level of activity p<K−1/2, where K is the mean number of synapses per neuron.

A Nonlinear Hebbian Network that Learns to Detect Disparity in Random-Dot Stereograms

1996 ◽  
Vol 8 (3) ◽  
pp. 545-566 ◽  
Author(s):  
Christopher W. Lee ◽  
Bruno A. Olshausen
Keyword(s):  
Hebbian Learning ◽  
Learning Rule ◽  
Coincidence Detection ◽  
Input Stream ◽  
Hebbian Learning Rule ◽  
Pairwise Correlations ◽  
Input Layer ◽  
Random Dot Stereograms ◽  
Rule Analysis ◽  
Shed Light

An intrinsic limitation of linear, Hebbian networks is that they are capable of learning only from the linear pairwise correlations within an input stream. To explore what higher forms of structure could be learned with a nonlinear Hebbian network, we constructed a model network containing a simple form of nonlinearity and we applied it to the problem of learning to detect the disparities present in random-dot stereograms. The network consists of three layers, with nonlinear sigmoidal activation functions in the second-layer units. The nonlinearities allow the second layer to transform the pixel-based representation in the input layer into a new representation based on coupled pairs of left-right inputs. The third layer of the network then clusters patterns occurring on the second-layer outputs according to their disparity via a standard competitive learning rule. Analysis of the network dynamics shows that the second-layer units' nonlinearities interact with the Hebbian learning rule to expand the region over which pairs of left-right inputs are stable. The learning rule is neurobiologically inspired and plausible, and the model may shed light on how the nervous system learns to use coincidence detection in general.

scholarly journals A Biologically Supported Error-Correcting Learning Rule

1991 ◽  
Vol 3 (2) ◽  
pp. 201-212 ◽  
Author(s):  
Peter J. B. Hancock ◽  
Leslie S. Smith ◽  
William A. Phillips
Keyword(s):  
Synaptic Plasticity ◽  
Visual Cortex ◽  
Associative Memory ◽  
False Positive ◽  
Hebbian Learning ◽  
Learning Rule ◽  
Synaptic Activity ◽  
Highly Active ◽  
Hebbian Learning Rule ◽  
Better Than

We show that a form of synaptic plasticity recently discovered in slices of the rat visual cortex (Artola et al. 1990) can support an error-correcting learning rule. The rule increases weights when both pre- and postsynaptic units are highly active, and decreases them when pre-synaptic activity is high and postsynaptic activation is less than the threshold for weight increment but greater than a lower threshold. We show that this rule corrects false positive outputs in feedforward associative memory, that in an appropriate opponent-unit architecture it corrects misses, and that it performs better than the optimal Hebbian learning rule reported by Willshaw and Dayan (1990).

scholarly journals Genes used together are more likely to be fused together in evolution by mutational mechanisms: A bioinformatic test of the used-fused hypothesis

2021 ◽  
Author(s):  
Evgeni Bolotin ◽  
Daniel Melamed ◽  
Adi Livnat
Keyword(s):  
Hebbian Learning ◽  
Learning Rule ◽  
Gene Interaction ◽  
Gene Fusions ◽  
Random Mutation ◽  
Fitness Effects ◽  
Hebbian Learning Rule ◽  
Human Genes ◽  
Alternative Hypotheses ◽  
Go Terms

Cases of parallel or recurrent gene fusions, whether in evolution or in cancer and genetic disease, are difficult to explain, as they require multiple of the same or similar breakpoints to repeat. The used-together-fused-together hypothesis holds that genes that are used together repeatedly and persistently in a certain context are more likely than otherwise to undergo a fusion mutation in the course of evolution–reminiscent of the Hebbian learning rule where neurons that fire together wire together. This mutational hypothesis offers to explain both evolutionary parallelism and recurrence in disease of gene fusions under one umbrella. Here, we test this hypothesis using bioinformatic data. Various measures of gene interaction, including co-expression, co-localization, same-TAD presence and semantic similarity of GO terms show that human genes whose homologs are fused in one or more other organisms are significantly more likely to interact together than random genes, controlling for genomic distance between genes. In addition, we find a statistically significant overlap between pairs of genes that fused in the course of evolution in non-human species and pairs that undergo fusion in human cancers. These results provide support for the used-together-fused-together hypothesis over several alternative hypotheses, including that all gene pairs can fuse by random mutation, but among pairs that have thus fused, those that have interacted previously are more likely to be favored by selection. Multiple consequences are discussed, including the relevance of mutational mechanisms to exon shuffling, to the distribution of fitness effects of mutation and to parallelism.

scholarly journals Deep Gated Hebbian Predictive Coding Accounts for Emergence of Complex Neural Response Properties Along the Visual Cortical Hierarchy

2021 ◽  
Vol 15 ◽  
Author(s):  
Shirin Dora ◽  
Sander M. Bohte ◽  
Cyriel M. A. Pennartz
Keyword(s):  
Network Architecture ◽  
Hebbian Learning ◽  
Predictive Coding ◽  
Learning Rule ◽  
Neuronal Populations ◽  
Hebbian Learning Rule ◽  
Cortical Hierarchy ◽  
Latent Representations ◽  
High Level ◽  
Visual Cortical

Predictive coding provides a computational paradigm for modeling perceptual processing as the construction of representations accounting for causes of sensory inputs. Here, we developed a scalable, deep network architecture for predictive coding that is trained using a gated Hebbian learning rule and mimics the feedforward and feedback connectivity of the cortex. After training on image datasets, the models formed latent representations in higher areas that allowed reconstruction of the original images. We analyzed low- and high-level properties such as orientation selectivity, object selectivity and sparseness of neuronal populations in the model. As reported experimentally, image selectivity increased systematically across ascending areas in the model hierarchy. Depending on the strength of regularization factors, sparseness also increased from lower to higher areas. The results suggest a rationale as to why experimental results on sparseness across the cortical hierarchy have been inconsistent. Finally, representations for different object classes became more distinguishable from lower to higher areas. Thus, deep neural networks trained using a gated Hebbian formulation of predictive coding can reproduce several properties associated with neuronal responses along the visual cortical hierarchy.

Hebbian learning rule restraining catastrophic forgetting in pulse neural network

2005 ◽  
Vol 151 (3) ◽  
pp. 50-60
Author(s):  
Makoto Motoki ◽  
Tomoki Hamagami ◽  
Seiichi Koakutsu ◽  
Hironori Hirata
Keyword(s):  
Neural Network ◽  
Hebbian Learning ◽  
Learning Rule ◽  
Hebbian Learning Rule
Sign in / Sign up

Export Citation Format

Share Document