scholarly journals Modeling of extrasynaptic information transfer in neural networks using braid theory

2018 ◽  
Vol 145 ◽  
pp. 306-311
Author(s):  
Olga Lukyanova ◽  
Oleg Nikitin
Author(s):  
Alexander D. Pisarev

This article studies the implementation of some well-known principles of information work of biological systems in the input unit of the neuroprocessor, including spike coding of information used in models of neural networks of the latest generation.<br> The development of modern neural network IT gives rise to a number of urgent tasks at the junction of several scientific disciplines. One of them is to create a hardware platform&nbsp;— a neuroprocessor for energy-efficient operation of neural networks. Recently, the development of nanotechnology of the main units of the neuroprocessor relies on combined memristor super-large logical and storage matrices. The matrix topology is built on the principle of maximum integration of programmable links between nodes. This article describes a method for implementing biomorphic neural functionality based on programmable links of a highly integrated 3D logic matrix.<br> This paper focuses on the problem of achieving energy efficiency of the hardware used to model neural networks. The main part analyzes the known facts of the principles of information transfer and processing in biological systems from the point of view of their implementation in the input unit of the neuroprocessor. The author deals with the scheme of an electronic neuron implemented based on elements of a 3D logical matrix. A pulsed method of encoding input information is presented, which most realistically reflects the principle of operation of a sensory biological neural system. The model of an electronic neuron for selecting ranges of technological parameters in a real 3D logic matrix scheme is analyzed. The implementation of disjunctively normal forms is shown, using the logic function in the input unit of a neuroprocessor as an example. The results of modeling fragments of electric circuits with memristors of a 3D logical matrix in programming mode are presented.<br> The author concludes that biomorphic pulse coding of standard digital signals allows achieving a high degree of energy efficiency of the logic elements of the neuroprocessor by reducing the number of valve operations. Energy efficiency makes it possible to overcome the thermal limitation of the scalable technology of three-dimensional layout of elements in memristor crossbars.


2018 ◽  
Vol 20 (7) ◽  
pp. 1656-1671 ◽  
Author(s):  
Abrar H. Abdulnabi ◽  
Bing Shuai ◽  
Zhen Zuo ◽  
Lap-Pui Chau ◽  
Gang Wang

Entropy ◽  
2020 ◽  
Vol 22 (1) ◽  
pp. 102 ◽  
Author(s):  
Adrian Moldovan ◽  
Angel Caţaron ◽  
Răzvan Andonie

Current neural networks architectures are many times harder to train because of the increasing size and complexity of the used datasets. Our objective is to design more efficient training algorithms utilizing causal relationships inferred from neural networks. The transfer entropy (TE) was initially introduced as an information transfer measure used to quantify the statistical coherence between events (time series). Later, it was related to causality, even if they are not the same. There are only few papers reporting applications of causality or TE in neural networks. Our contribution is an information-theoretical method for analyzing information transfer between the nodes of feedforward neural networks. The information transfer is measured by the TE of feedback neural connections. Intuitively, TE measures the relevance of a connection in the network and the feedback amplifies this connection. We introduce a backpropagation type training algorithm that uses TE feedback connections to improve its performance.


2009 ◽  
Vol 19 (04) ◽  
pp. 295-308 ◽  
Author(s):  
SAMANWOY GHOSH-DASTIDAR ◽  
HOJJAT ADELI

Most current Artificial Neural Network (ANN) models are based on highly simplified brain dynamics. They have been used as powerful computational tools to solve complex pattern recognition, function estimation, and classification problems. ANNs have been evolving towards more powerful and more biologically realistic models. In the past decade, Spiking Neural Networks (SNNs) have been developed which comprise of spiking neurons. Information transfer in these neurons mimics the information transfer in biological neurons, i.e., via the precise timing of spikes or a sequence of spikes. To facilitate learning in such networks, new learning algorithms based on varying degrees of biological plausibility have also been developed recently. Addition of the temporal dimension for information encoding in SNNs yields new insight into the dynamics of the human brain and could result in compact representations of large neural networks. As such, SNNs have great potential for solving complicated time-dependent pattern recognition problems because of their inherent dynamic representation. This article presents a state-of-the-art review of the development of spiking neurons and SNNs, and provides insight into their evolution as the third generation neural networks.


Biosystems ◽  
2019 ◽  
Vol 185 ◽  
pp. 104028 ◽  
Author(s):  
Giuseppe Pica ◽  
Mohammadreza Soltanipour ◽  
Stefano Panzeri

2020 ◽  
Vol 6 (3) ◽  
pp. 12-21
Author(s):  
A.I. Tarutin ◽  
◽  
S.V. Veretekhina ◽  
D.Yu. Eliseeva ◽  
◽  
...  

the article uses the results of studies on the impact of trends on the economy of individual companies and states. The importance of trends in all areas of activity is proved. Methods of finding future trends are also proposed. So, this technology can change the financial income of companies and distribution networks, as well as the position of states on the world stage. The use of trending technology can change the economies of countries. The hypothesis of the dependence of the rate of propagation of trends on the speed of information transfer is considered. The importance of combining industries in order to enhance the quality of the presentation of information to the end user and the convenience of its visualization are discussed. It is noted that at the moment, conducting experiments and tests becomes possible at “home”; therefore, the market is becoming more competitive and requiring new technical solutions. Possible uses of this technology in a market environment are presented. Monitoring the identification of new trends is important because works ahead of the curve. An additional effect is the early entry of goods into the market, in contrast to enterprises that do not use trend forecasts. Advancement provides the following advantages: reduction of the time for goods and services to enter the market; reduction of production costs due to the possibility of increasing production time. And ways to use neural networks in finding a trend.


2007 ◽  
Vol 19 (10) ◽  
pp. 2581-2603 ◽  
Author(s):  
Chiara Bartolozzi ◽  
Giacomo Indiveri

Synapses are crucial elements for computation and information transfer in both real and artificial neural systems. Recent experimental findings and theoretical models of pulse-based neural networks suggest that synaptic dynamics can play a crucial role for learning neural codes and encoding spatiotemporal spike patterns. Within the context of hardware implementations of pulse-based neural networks, several analog VLSI circuits modeling synaptic functionality have been proposed. We present an overview of previously proposed circuits and describe a novel analog VLSI synaptic circuit suitable for integration in large VLSI spike-based neural systems. The circuit proposed is based on a computational model that fits the real postsynaptic currents with exponentials. We present experimental data showing how the circuit exhibits realistic dynamics and show how it can be connected to additional modules for implementing a wide range of synaptic properties.


Sign in / Sign up

Export Citation Format

Share Document