A mechanistically interpretable model of the retinal neural code for natural scenes with multiscale adaptive dynamics

The visual system processes stimuli over a wide range of spatiotemporal scales, with individual neurons receiving input from tens of thousands of neurons whose dynamics range from milliseconds to tens of seconds. This poses a challenge to create models that both accurately capture visual computations and are mechanistically interpretable. Here we present a model of salamander retinal ganglion cell spiking responses recorded with a multielectrode array that captures natural scene responses and slow adaptive dynamics. The model consists of a three-layer convolutional neural network (CNN) modified to include local recurrent synaptic dynamics taken from a linear-nonlinear-kinetic (LNK) model \cite{ozuysal2012linking}. We presented alternating natural scenes and uniform field white noise stimuli designed to engage slow contrast adaptation. To overcome difficulties fitting slow and fast dynamics together, we first optimized all fast spatiotemporal parameters, then separately optimized recurrent slow synaptic parameters. The resulting full model reproduces a wide range of retinal computations and is mechanistically interpretable, having internal units that correspond to retinal interneurons with biophysically modeled synapses. This model allows us to study the contribution of model units to any retinal computation, and examine how long-term adaptation changes the retinal neural code for natural scenes through selective adaptation of retinal pathways.

Emergence and fragmentation of the alpha-band driven by neuronal network dynamics

Rhythmic neuronal network activity underlies brain oscillations. To investigate how connected neuronal networks contribute to the emergence of the α-band and to the regulation of Up and Down states, we study a model based on synaptic short-term depression-facilitation with afterhyperpolarization (AHP). We found that the α-band is generated by the network behavior near the attractor of the Up-state. Coupling inhibitory and excitatory networks by reciprocal connections leads to the emergence of a stable α-band during the Up states, as reflected in the spectrogram. To better characterize the emergence and stability of thalamocortical oscillations containing α and δ rhythms during anesthesia, we model the interaction of two excitatory networks with one inhibitory network, showing that this minimal topology underlies the generation of a persistent α-band in the neuronal voltage characterized by dominant Up over Down states. Finally, we show that the emergence of the α-band appears when external inputs are suppressed, while fragmentation occurs at small synaptic noise or with increasing inhibitory inputs. To conclude, α-oscillations could result from the synaptic dynamics of interacting excitatory neuronal networks with and without AHP, a principle that could apply to other rhythms.

Photoelectroactive artificial synapse and its application to biosignal pattern recognition

In recent years, optoelectronic artificial synapses have garnered a great deal of research attention owing to their multifunctionality to process optical input signals or to update their weights optically. However, for most optoelectronic synapses, the use of optical stimuli is restricted to an excitatory spike pulse, which majorly limits their application to hardware neural networks. Here, we report a unique weight-update operation in a photoelectroactive synapse; the synaptic weight can be both potentiated and depressed using “optical spikes.” This unique bidirectional operation originates from the ionization and neutralization of inherent defects in hexagonal-boron nitride by co-stimuli consisting of optical and electrical spikes. The proposed synapse device exhibits (i) outstanding analog memory characteristics, such as high accessibility (cycle-to-cycle variation of <1%) and long retention (>21 days), and (ii) excellent synaptic dynamics, such as a high dynamic range (>384) and modest asymmetricity (<3.9). Such remarkable characteristics enable a maximum accuracy of 96.1% to be achieved during the training and inference simulation for human electrocardiogram patterns.

Persistent synaptic inhibition of the subthalamic nucleus by high frequency stimulation

Background: Deep brain stimulation (DBS) provides symptomatic relief in a growing number of neurological indications, but local synaptic dynamics in response to electrical stimulation that may relate to its mechanism of action have not been fully characterized. Objective: The objectives of this study were to (1) study local synaptic dynamics during high frequency extracellular stimulation of the subthalamic nucleus (STN), and (2) compare STN synaptic dynamics with those of the neighboring substantia nigra pars reticulata (SNr). Methods: Two microelectrodes were advanced into the STN and SNr of patients undergoing DBS surgery for PD. Neuronal firing and evoked field potentials (fEPs) were recorded with one microelectrode during stimulation from an adjacent microelectrode. Results: Excitatory and inhibitory fEPs could be discerned within the STN and their amplitudes predicted bidirectional effects on neuronal firing (p = .007). There were no differences between STN and SNr inhibitory fEP dynamics at low stimulation frequencies (p > .999). However, inhibitory neuronal responses were sustained over time in STN during high frequency stimulation, but not SNr (p < .001) where depression of inhibitory input was coupled with a return of neuronal firing (p = .003). Interpretation: Persistent inhibitory input to the STN suggests a local synaptic mechanism for the suppression of subthalamic firing during high frequency stimulation. Moreover, differences in the resiliency versus vulnerability of inhibitory inputs to the STN and SNr suggest a projection source- and frequency-specificity for this mechanism. The feasibility of targeting electrophysiologically-identified neural structures may provide insight into how DBS achieves frequency-specific modulation of neuronal projections.

Learning the Synaptic and Intrinsic Membrane Dynamics Underlying Working Memory in Spiking Neural Network Models

Recurrent neural network (RNN) models trained to perform cognitive tasks are a useful computational tool for understanding how cortical circuits execute complex computations. However, these models are often composed of units that interact with one another using continuous signals and overlook parameters intrinsic to spiking neurons. Here, we develop a method to directly train not only synaptic-related variables but also membrane-related parameters of a spiking RNN model. Training our model on a wide range of cognitive tasks resulted in diverse yet task-specific synaptic and membrane parameters. We also show that fast membrane time constants and slow synaptic decay dynamics naturally emerge from our model when it is trained on tasks associated with working memory (WM). Further dissecting the optimized parameters revealed that fast membrane properties are important for encoding stimuli, and slow synaptic dynamics are needed for WM maintenance. This approach offers a unique window into how connectivity patterns and intrinsic neuronal properties contribute to complex dynamics in neural populations.

Bridging Hierarchies in Multi-Scale Models of Neural Systems: Look-Up Tables Enable Computationally Efficient Simulations of Non-linear Synaptic Dynamics

Synapses are critical actors of neuronal transmission as they form the basis of chemical communication between neurons. Accurate computational models of synaptic dynamics may prove important in elucidating emergent properties across hierarchical scales. Yet, in large-scale neuronal network simulations, synapses are often modeled as highly simplified linear exponential functions due to their small computational footprint. However, these models cannot capture the complex non-linear dynamics that biological synapses exhibit and thus, are insufficient in representing synaptic behavior accurately. Existing detailed mechanistic synapse models can replicate these non-linear dynamics by modeling the underlying kinetics of biological synapses, but their high complexity prevents them from being a suitable option in large-scale models due to long simulation times. This motivates the development of more parsimonious models that can capture the complex non-linear dynamics of synapses accurately while maintaining a minimal computational cost. We propose a look-up table approach that stores precomputed values thereby circumventing most computations at runtime and enabling extremely fast simulations for glutamatergic receptors AMPAr and NMDAr. Our results demonstrate that this methodology is capable of replicating the dynamics of biological synapses as accurately as the mechanistic synapse models while offering up to a 56-fold increase in speed. This powerful approach allows for multi-scale neuronal networks to be simulated at large scales, enabling the investigation of how low-level synaptic activity may lead to changes in high-level phenomena, such as memory and learning.

Flexible and Energy-efficient Synaptic Transistor with Quasi-linear Weight Update Protocol by Inkjet Printing of Orientated Polar-electret/High-k Oxide Hybrid Dielectric

Artificial synapse by inkjet printing is promising in cost-effective and flexible applications, but remains challenging in emulating synaptic dynamics with a sufficient number of stable and effective conductance states under ultra-low voltage spiking operation. Hence, for the first time, a synaptic transistor gated by inkjet-printed hybrid dielectric of electret polyvinyl pyrrolidone (PVP) and high-k Zirconia oxide (ZrOx) is proposed and thus synthesized to solve this issue. Quasi-linear potentiation/depression characteristics with large variation margin of conductance states are obtained through the coupling of these two dielectric components and the facilitating of dipole orientation, which can be attributed to the orderly arranged molecule chains induced by the carefully designed microfluidic flows in droplets. Crucial features of biological synapses including long-term potentiation/depression (LTP/D), spike-timing-dependence-plasticity (STDP) learning rule, “Learning-Experience” behavior, and ultralow energy consumption (< 10 fJ/pulse) are successfully implemented on the device. Simulation results exhibit an excellent image recognition accuracy (97.1 %) after 15 training epochs, which is the highest for printed synaptic transistors. Moreover, the device sustained excellent endurance against bending tests with radius down to 8 mm. This work presents a very viable solution for constructing the futuristic flexible and low-cost neural systems.