STDP Provides the Substrate for Igniting Synfire Chains by Spatiotemporal Input Patterns

2008 ◽  
Vol 20 (2) ◽  
pp. 415-435 ◽  
Author(s):  
Ryosuke Hosaka ◽  
Osamu Araki ◽  
Tohru Ikeguchi
Keyword(s):  
Neural Network ◽  
Experimental Studies ◽  
Spike Timing ◽  
Inhibitory Neurons ◽  
Spatiotemporal Pattern ◽  
Spiking Neural Network ◽  
Synfire Chains ◽  
The Neural Network ◽  
Stdp Rule ◽  
Neural Network Structure

Spike-timing-dependent synaptic plasticity (STDP), which depends on the temporal difference between pre- and postsynaptic action potentials, is observed in the cortices and hippocampus. Although several theoretical and experimental studies have revealed its fundamental aspects, its functional role remains unclear. To examine how an input spatiotemporal spike pattern is altered by STDP, we observed the output spike patterns of a spiking neural network model with an asymmetrical STDP rule when the input spatiotemporal pattern is repeatedly applied. The spiking neural network comprises excitatory and inhibitory neurons that exhibit local interactions. Numerical experiments show that the spiking neural network generates a single global synchrony whose relative timing depends on the input spatiotemporal pattern and the neural network structure. This result implies that the spiking neural network learns the transformation from spatiotemporal to temporal information. In the literature, the origin of the synfire chain has not been sufficiently focused on. Our results indicate that spiking neural networks with STDP can ignite synfire chains in the cortices.

scholarly journals A Spiking Neural Network Based on the Model of VO2—Neuron

Electronics ◽  
2019 ◽  
Vol 8 (10) ◽  
pp. 1065 ◽  
Author(s):  
Belyaev ◽  
Velichko
Keyword(s):  
Neural Network ◽  
Electrical Circuit ◽  
Spike Timing ◽  
Spiking Neural Network ◽  
Training Method ◽  
Information Coding ◽  
The Neural Network ◽  
Output Neurons ◽  
Winner Takes All ◽  
Integrate And Fire Neuron

In this paper, we present an electrical circuit of a leaky integrate-and-fire neuron with one VO2 switch, which models the properties of biological neurons. Based on VO2 neurons, a two-layer spiking neural network consisting of nine input and three output neurons is modeled in the SPICE simulator. The network contains excitatory and inhibitory couplings, and implements the winner-takes-all principle in pattern recognition. Using a supervised Spike-Timing-Dependent Plasticity training method and a timing method of information coding, the network was trained to recognize three patterns with dimensions of 3 × 3 pixels. The neural network is able to recognize up to 105 images per second, and has the potential to increase the recognition speed further.

scholarly journals A STDP Rule that Favours Chaotic Spiking over Regular Spiking of Neurons

2021 ◽  
Vol 12 (03) ◽  
pp. 25-33
Author(s):  
Mario Antoine Aoun
Keyword(s):  
Neural Network ◽  
Chaos Theory ◽  
Spike Timing ◽  
Spiking Neurons ◽  
Spiking Neural Network ◽  
Spike Timing Dependent Plasticity ◽  
Dependent Plasticity ◽  
Stdp Rule

We compare the number of states of a Spiking Neural Network (SNN) composed from chaotic spiking neurons versus the number of states of a SNN composed from regular spiking neurons while both SNNs implementing a Spike Timing Dependent Plasticity (STDP) rule that we created. We find out that this STDP rule favors chaotic spiking since the number of states is larger in the chaotic SNN than the regular SNN. This chaotic favorability is not general; it is exclusive to this STDP rule only. This research falls under our long-term investigation of STDP and chaos theory.

scholarly journals Efficient VLSI Architecture for Odor Recognition with a Spiking Neural Network

2019 ◽  
Vol 9 (1S3) ◽  
pp. 6-9
Keyword(s):  
Neural Network ◽  
Synaptic Plasticity ◽  
Vlsi Architecture ◽  
Spike Timing ◽  
Time Difference ◽  
Spiking Neural Network ◽  
Cortical Cells ◽  
Odor Recognition ◽  
Stdp Rule

In this paper spiking neural network (SNN) is presented which can discriminate odor data. Spike timing dependent synaptic plasticity (STDP) means a plasticity which is controlled by the presynaptic and postsynaptic spikes time difference. Using this STDP rule the synaptic weights are modified after the mitral and before the cortical cells. In order to determine whether the circuit has correctly identified the odor the SNN has either a high or a low response at the output for any odor given as the input.

scholarly journals Using a Low-Power Spiking Continuous Time Neuron (SCTN) for Sound Signal Processing

Sensors ◽  
2021 ◽  
Vol 21 (4) ◽  
pp. 1065
Author(s):  
Moshe Bensimon ◽  
Shlomo Greenberg ◽  
Moshe Haiut
Keyword(s):  
Neural Network ◽  
Network Structure ◽  
Analog Circuits ◽  
Continuous Time ◽  
Spiking Neurons ◽  
Spiking Neural Network ◽  
Sound Classification ◽  
Classification Framework ◽  
Neural Network Structure ◽  
Simple Analog

This work presents a new approach based on a spiking neural network for sound preprocessing and classification. The proposed approach is biologically inspired by the biological neuron’s characteristic using spiking neurons, and Spike-Timing-Dependent Plasticity (STDP)-based learning rule. We propose a biologically plausible sound classification framework that uses a Spiking Neural Network (SNN) for detecting the embedded frequencies contained within an acoustic signal. This work also demonstrates an efficient hardware implementation of the SNN network based on the low-power Spike Continuous Time Neuron (SCTN). The proposed sound classification framework suggests direct Pulse Density Modulation (PDM) interfacing of the acoustic sensor with the SCTN-based network avoiding the usage of costly digital-to-analog conversions. This paper presents a new connectivity approach applied to Spiking Neuron (SN)-based neural networks. We suggest considering the SCTN neuron as a basic building block in the design of programmable analog electronics circuits. Usually, a neuron is used as a repeated modular element in any neural network structure, and the connectivity between the neurons located at different layers is well defined. Thus, generating a modular Neural Network structure composed of several layers with full or partial connectivity. The proposed approach suggests controlling the behavior of the spiking neurons, and applying smart connectivity to enable the design of simple analog circuits based on SNN. Unlike existing NN-based solutions for which the preprocessing phase is carried out using analog circuits and analog-to-digital conversion, we suggest integrating the preprocessing phase into the network. This approach allows referring to the basic SCTN as an analog module enabling the design of simple analog circuits based on SNN with unique inter-connections between the neurons. The efficiency of the proposed approach is demonstrated by implementing SCTN-based resonators for sound feature extraction and classification. The proposed SCTN-based sound classification approach demonstrates a classification accuracy of 98.73% using the Real-World Computing Partnership (RWCP) database.

scholarly journals Adaptive Control Structure with Neural Data Processing Applied for Electrical Drive with Elastic Shaft

Energies ◽  
2021 ◽  
Vol 14 (12) ◽  
pp. 3389
Author(s):  
Marcin Kamiński ◽  
Krzysztof Szabat
Keyword(s):  
Neural Network ◽  
Adaptive Control ◽  
Dynamic Properties ◽  
Experimental Studies ◽  
Drive System ◽  
Particle Swarm Optimizer ◽  
The Neural Network ◽  
Control Concept ◽  
Constant Coefficients ◽  
Selection Of

This paper presents issues related to the adaptive control of the drive system with an elastic clutch connecting the main motor and the load machine. Firstly, the problems and the main algorithms often implemented for the mentioned object are analyzed. Then, the control concept based on the RNN (recurrent neural network) for the drive system with the flexible coupling is thoroughly described. For this purpose, an adaptive model inspired by the Elman model is selected, which is related to internal feedback in the neural network. The indicated feature improves the processing of dynamic signals. During the design process, for the selection of constant coefficients of the controller, the PSO (particle swarm optimizer) is applied. Moreover, in order to obtain better dynamic properties and improve work in real conditions, one model based on the ADALINE (adaptive linear neuron) is introduced into the structure. Details of the algorithm used for the weights’ adaptation are presented (including stability analysis) to perform the shaft torque signal filtering. The effectiveness of the proposed approach is examined through simulation and experimental studies.

scholarly journals A Heterogeneous Spiking Neural Network for Unsupervised Learning of Spatiotemporal Patterns

2021 ◽  
Vol 14 ◽  
Author(s):  
Xueyuan She ◽  
Saurabh Dash ◽  
Daehyun Kim ◽  
Saibal Mukhopadhyay
Keyword(s):  
Neural Network ◽  
Moving Objects ◽  
Short Term Memory ◽  
Back Propagation ◽  
Spike Timing ◽  
Spatiotemporal Patterns ◽  
Spiking Neural Network ◽  
Spatial And Temporal Patterns ◽  
Unsupervised Training ◽  
Improved Performance

This paper introduces a heterogeneous spiking neural network (H-SNN) as a novel, feedforward SNN structure capable of learning complex spatiotemporal patterns with spike-timing-dependent plasticity (STDP) based unsupervised training. Within H-SNN, hierarchical spatial and temporal patterns are constructed with convolution connections and memory pathways containing spiking neurons with different dynamics. We demonstrate analytically the formation of long and short term memory in H-SNN and distinct response functions of memory pathways. In simulation, the network is tested on visual input of moving objects to simultaneously predict for object class and motion dynamics. Results show that H-SNN achieves prediction accuracy on similar or higher level than supervised deep neural networks (DNN). Compared to SNN trained with back-propagation, H-SNN effectively utilizes STDP to learn spatiotemporal patterns that have better generalizability to unknown motion and/or object classes encountered during inference. In addition, the improved performance is achieved with 6x fewer parameters than complex DNNs, showing H-SNN as an efficient approach for applications with constrained computation resources.

Sunlight Greenhouse Temperature Prediction Model Based on Bayesian Regularization BP Neural Network

2015 ◽  
Vol 740 ◽  
pp. 871-874
Author(s):  
Hui Zhao ◽  
Li Rong Shi ◽  
Hong Jun Wang
Keyword(s):  
Neural Network ◽  
Network Structure ◽  
Bp Neural Network ◽  
Principal Component ◽  
Coupling Factor ◽  
Bayesian Regularization ◽  
The Neural Network ◽  
Neural Network Structure ◽  
Input Variables ◽  
Bp Neural Network Model

Directing against the problems of too large size of the neural network structure due to the existence of a complex relationship between the input coupling factor and too many input factors in establishing model for predicting temperature of sunlight greenhouse. This article chose the environmental factors that affect the sunlight greenhouse temperature as data sample. Through the principal component analysis of data samples, three main factors were extracted. These selected principal component values were taken as the input variables of BP neural network model. Use the Bayesian regularization algorithm to improve the BP neural network. The empirical results show that this method is utilized modify BP neural network, which can simplify network structure and smooth fitting curve, has good generalization capability.

Neural Network-Based Speed Control of A Two-Mass-Model System

1999 ◽  
Vol 3 (5) ◽  
pp. 427-430 ◽  
Author(s):  
Rached Dhaouadi ◽  
◽  
Khaled Nouri
Keyword(s):  
Neural Network ◽  
Inverse Dynamics ◽  
Mass Model ◽  
Neural Network Learning ◽  
Inverse Control ◽  
Network Learning ◽  
The Neural Network ◽  
Control Scheme ◽  
On Line ◽  
Neural Network Structure

We present an application of artificial neural networks to the problem of controlling the speed of an elastic drive system. We derive a neural network structure to simulate the inverse dynamics of the system, then implement the direct inverse control scheme in a closed loop. The neural network learning is done on-line to adaptively control the speed to follow a stepwise changing reference. The experimental results with a two-mass-model analog board confirm the effectiveness of the proposed neurocontrol scheme.

Sign in / Sign up

Export Citation Format

Share Document