Dependency of the connection architectures of oscillatory neural networks on synchronization

Author(s):  
Y. Hayashi
Author(s):  
Thomas C. Jackson ◽  
Abhishek A. Sharma ◽  
James A. Bain ◽  
Jeffrey A. Weldon ◽  
Lawrence Pileggi

2018 ◽  
Vol 139 ◽  
pp. 8-14 ◽  
Author(s):  
Andrey Velichko ◽  
Maksim Belyaev ◽  
Vadim Putrolaynen ◽  
Valentin Perminov ◽  
Alexander Pergament

2021 ◽  
Author(s):  
Corentin Delacour ◽  
Stefania Carapezzi ◽  
Madeleine Abernot ◽  
Gabriele Boschetto ◽  
Nadine Azemard ◽  
...  

2021 ◽  
Vol 15 ◽  
Author(s):  
Jafar Shamsi ◽  
María José Avedillo ◽  
Bernabé Linares-Barranco ◽  
Teresa Serrano-Gotarredona

Oscillatory Neural Networks (ONNs) are currently arousing interest in the research community for their potential to implement very fast, ultra-low-power computing tasks by exploiting specific emerging technologies. From the architectural point of view, ONNs are based on the synchronization of oscillatory neurons in cognitive processing, as occurs in the human brain. As emerging technologies, VO2 and memristive devices show promising potential for the efficient implementation of ONNs. Abundant literature is now becoming available pertaining to the study and building of ONNs based on VO2 devices and resistive coupling, such as memristors. One drawback of direct resistive coupling is that physical resistances cannot be negative, but from the architectural and computational perspective this would be a powerful advantage when interconnecting weights in ONNs. Here we solve the problem by proposing a hardware implementation technique based on differential oscillatory neurons for ONNs (DONNs) with VO2-based oscillators and memristor-bridge circuits. Each differential oscillatory neuron is made of a pair of VO2 oscillators operating in anti-phase. This way, the neurons provide a pair of differential output signals in opposite phase. The memristor-bridge circuit is used as an adjustable coupling function that is compatible with differential structures and capable of providing both positive and negative weights. By combining differential oscillatory neurons and memristor-bridge circuits, we propose the hardware implementation of a fully connected differential ONN (DONN) and use it as an associative memory. The standard Hebbian rule is used for training, and the weights are then mapped to the memristor-bridge circuit through a proposed mapping rule. The paper also introduces some functional and hardware specifications to evaluate the design. Evaluation is performed by circuit-level electrical simulations and shows that the retrieval accuracy of the proposed design is comparable to that of classic Hopfield Neural Networks.


2002 ◽  
Vol 14 (10) ◽  
pp. 2371-2396 ◽  
Author(s):  
Silvia Scarpetta ◽  
L. Zhaoping ◽  
John Hertz

We introduce a model of generalized Hebbian learning and retrieval in oscillatory neural networks modeling cortical areas such as hippocampus and olfactory cortex. Recent experiments have shown that synaptic plasticity depends on spike timing, especially on synapses from excitatory pyramidal cells, in hippocampus, and in sensory and cerebellar cortex. Here we study how such plasticity can be used to form memories and input representations when the neural dynamics are oscillatory, as is common in the brain (particularly in the hippocampus and olfactory cortex). Learning is assumed to occur in a phase of neural plasticity, in which the network is clamped to external teaching signals. By suitable manipulation of the nonlinearity of the neurons or the oscillation frequencies during learning, the model can be made, in a retrieval phase, either to categorize new inputs or to map them, in a continuous fashion, onto the space spanned by the imprinted patterns. We identify the first of these possibilities with the function of olfactory cortex and the second with the observed response characteristics of place cells in hippocampus. We investigate both kinds of networks analytically and by computer simulations, and we link the models with experimental findings, exploring, in particular, how the spike timing dependence of the synaptic plasticity constrains the computational function of the network and vice versa.


Sign in / Sign up

Export Citation Format

Share Document