Optimal control methods for nonlinear parameter estimation in biophysical neuron models

Functional forms of biophysically-realistic neuron models are constrained by neurobiological and anatomical considerations, such as cell morphologies and the presence of known ion channels. Despite these constraints, neurons models still contain unknown static parameters which must be inferred from experiment. This inference task is most readily cast into the framework of state-space models, which systematically takes into account partial observability and measurement noise. Inferring only dynamical state variables such as membrane voltages is a well-studied problem, and has been approached with a wide range of techniques beginning with the well-known Kalman filter. Inferring both states and fixed parameters, on the other hand, is less straightforward. Here, we develop a method for joint parameter and state inference that combines traditional state space modeling with chaotic synchronization and optimal control. Our methods are tailored particularly to situations with considerable measurement noise, sparse observability, very nonlinear or chaotic dynamics, and highly uninformed priors. We illustrate our approach both in a canonical chaotic model and in a phenomenological neuron model, showing that many unknown parameters can be uncovered reliably and accurately from short and noisy observed time traces. Our method holds promise for estimation in larger-scale systems, given ongoing improvements in calcium reporters and genetically-encoded voltage indicators.

Self-Evolutionary Neuron Model for Fast-Response Spiking Neural Networks

We propose two simple and effective spiking neuron models to improve the response time of the conventional spiking neural network. The proposed neuron models adaptively tune the presynaptic input current depending on the input received from its presynapses and subsequent neuron firing events. We analyze and derive the firing activity homeostatic convergence of the proposed models. We experimentally verify and compare the models on MNIST handwritten digits and FashionMNIST classification tasks. We show that the proposed neuron models significantly increase the response speed to the input signal.

Distribution of spiking and bursting in Rulkov’s neuron model

Large-scale brain simulations require the investigation of large networks of realistic neuron models, usually represented by sets of differential equations. Here we report a detailed fine-scale study of the dynamical response over extended parameter ranges of a computationally inexpensive model, the two-dimensional Rulkov map, which reproduces well the spiking and spiking-bursting activity of real biological neurons. In addition, we provide evidence of the existence of nested arithmetic progressions among periodic pulsing and bursting phases of Rulkov’s neuron. We find that specific remarkably complex nested sequences of periodic neural oscillations can be expressed as simple linear combinations of pairs of certain basal periodicities. Moreover, such nested progressions are robust and can be observed abundantly in diverse control parameter planes which are described in detail. We believe such findings to add significantly to the knowledge of Rulkov neuron dynamics and to be potentially helpful in large-scale simulations of the brain and other complex neuron networks.

A New Memristive Neuron Map Model and Its Network’s Dynamics under Electrochemical Coupling

A memristor is a vital circuit element that can mimic biological synapses. This paper proposes the memristive version of a recently proposed map neuron model based on the phase space. The dynamic of the memristive map model is investigated by using bifurcation and Lyapunov exponents’ diagrams. The results prove that the memristive map can present different behaviors such as spiking, periodic bursting, and chaotic bursting. Then, a ring network is constructed by hybrid electrical and chemical synapses, and the memristive neuron models are used to describe the nodes. The collective behavior of the network is studied. It is observed that chemical coupling plays a crucial role in synchronization. Different kinds of synchronization, such as imperfect synchronization, complete synchronization, solitary state, two-cluster synchronization, chimera, and nonstationary chimera, are identified by varying the coupling strengths.

Synchronization conditions in networks of Hindmarsh-Rose systems

The algebraic connectivity is crucial parameter in studying of synchronization of diffusively coupled networks. This paper studies the synchronization in networks of Hindmarsh-Rose systems, which is one of the most used neuron models. It presents sufficient condition for synchronization in these networks using the Lyapunov function method. This is a simple condition which depends on the algebraic connectivity and on the parameters of the individual system. Numerical examples are presented to illustrate the obtained results.

BrainFreeze: Expanding the Capabilities of Neuromorphic Systems Using Mixed-Signal Superconducting Electronics

Superconducting electronics (SCE) is uniquely suited to implement neuromorphic systems. As a result, SCE has the potential to enable a new generation of neuromorphic architectures that can simultaneously provide scalability, programmability, biological fidelity, on-line learning support, efficiency and speed. Supporting all of these capabilities simultaneously has thus far proven to be difficult using existing semiconductor technologies. However, as the fields of computational neuroscience and artificial intelligence (AI) continue to advance, the need for architectures that can provide combinations of these capabilities will grow. In this paper, we will explain how superconducting electronics could be used to address this need by combining analog and digital SCE circuits to build large scale neuromorphic systems. In particular, we will show through detailed analysis that the available SCE technology is suitable for near term neuromorphic demonstrations. Furthermore, this analysis will establish that neuromorphic architectures built using SCE will have the potential to be significantly faster and more efficient than current approaches, all while supporting capabilities such as biologically suggestive neuron models and on-line learning. In the future, SCE-based neuromorphic systems could serve as experimental platforms supporting investigations that are not feasible with current approaches. Ultimately, these systems and the experiments that they support would enable the advancement of neuroscience and the development of more sophisticated AI.

Non-monotonic effects of GABAergic synaptic inputs on neuronal firing

GABA is canonically known as the principal inhibitory neurotransmitter in the nervous system, usually acting by hyper-polarizing membrane potential. However, GABAergic currents can also exhibit non-inhibitory effects, depending on the brain region, developmental stage or pathological condition. Here, we investigate the diverse effects of GABA on the firing rate of several single neuron models, using both analytical calculations and numerical simulations. We find that the relationship between GABAergic synaptic conductance and output firing rate exhibits three qualitatively different regimes as a function of GABA reversal potential, νGABA: monotonically decreasing for sufficiently low νGABA (inhibitory), monotonically increasing for νGABA above firing threshold (excitatory); and a non-monotonic region for intermediate values of νGABA. In the non-monotonic regime, small GABA conductances have an excitatory effect while large GABA conductances show an inhibitory effect. We provide a phase diagram of different GABAergic effects as a function of GABA reversal potential and glutamate conductance. We find that noisy inputs increase the range of νGABA for which the non-monotonic effect can be observed. We also construct a micro-circuit model of striatum to explain observed effects of GABAergic fast spiking interneurons on spiny projection neurons, including non-monotonicity, as well as the heterogeneity of the effects. Our work provides a mechanistic explanation of paradoxical effects of GABAergic synaptic inputs, with implications for understanding the effects of GABA in neural computation and development.

Reduced Dimension, Biophysical Neuron Models Constructed From Observed Data

Using methods from nonlinear dynamics and interpolation techniques from applied mathematics, we show how to use data alone to construct discrete time dynamical rules that forecast observed neuron properties. These data may come from from simulations of a Hodgkin-Huxley (HH) neuron model or from laboratory current clamp experiments. In each case the reduced dimension data driven forecasting (DDF) models are shown to predict accurately for times after the training period.When the available observations for neuron preparations are, for example, membrane voltage V(t) only, we use the technique of time delay embedding from nonlinear dynamics to generate an appropriate space in which the full dynamics can be realized.The DDF constructions are reduced dimension models relative to HH models as they are built on and forecast only observables such as V(t). They do not require detailed specification of ion channels, their gating variables, and the many parameters that accompany an HH model for laboratory measurements, yet all of this important information is encoded in the DDF model.As the DDF models use only voltage data and forecast only voltage data they can be used in building networks with biophysical connections. Both gap junction connections and ligand gated synaptic connections among neurons involve presynaptic voltages and induce postsynaptic voltage response. Biophysically based DDF neuron models can replace other reduced dimension neuron models, say of the integrate-and-fire type, in developing and analyzing large networks of neurons.When one does have detailed HH model neurons for network components, a reduced dimension DDF realization of the HH voltage dynamics may be used in network computations to achieve computational efficiency and the exploration of larger biological networks.

Dual-mode dendritic devices enhanced neural network based on electrolyte gated transistors

As a fundamental component of biological neurons, dendrites have been proven to have crucial effects in neuronal activities. Single neurons with dendrite structures show high signal processing capability that is analogous to a multilayer perceptron, whereas oversimplified point neuron models are still prevalent in AI algorithms and neuromorphic systems and fundamentally limit their efficiency and functionality of the systems constructed. In this study, we propose a dual-mode dendritic device based on electrolyte gated transistor, which can be operated to generate both supralinear and sublinear current-voltage responses when receiving input voltage pulses. We propose and demonstrate that the dual-mode dendritic devices can be used as a dendritic processing block between weight matrices and output neurons so as to enhance the expression ability of the neural networks. A dual-mode dendrites-enhanced neural network is therefore constructed with only two trainable parameters in the second layer, thus achieving 1000× reduction in the amount of second layer parameter compared to multilayer perceptron. After training by back propagation, the network reaches 90.1% accuracy in MNIST handwritten digits classification, showing advantage of the present dual-mode dendritic devices in building highly efficient neuromorphic computing.