Sensory coding and contrast invariance emerge from the control of plastic inhibition over emergent selectivity

Visual stimuli are represented by a highly efficient code in the primary visual cortex, but the development of this code is still unclear. Two distinct factors control coding efficiency: Representational efficiency, which is determined by neuronal tuning diversity, and metabolic efficiency, which is influenced by neuronal gain. How these determinants of coding efficiency are shaped during development, supported by excitatory and inhibitory plasticity, is only partially understood. We investigate a fully plastic spiking network of the primary visual cortex, building on phenomenological plasticity rules. Our results suggest that inhibitory plasticity is key to the emergence of tuning diversity and accurate input encoding. We show that inhibitory feedback (random and specific) increases the metabolic efficiency by implementing a gain control mechanism. Interestingly, this led to the spontaneous emergence of contrast-invariant tuning curves. Our findings highlight that (1) interneuron plasticity is key to the development of tuning diversity and (2) that efficient sensory representations are an emergent property of the resulting network.

Offline memory replay in recurrent neuronal networks emerges from constraints on online dynamics

During spatial exploration, neural circuits in the hippocampus store memories of sequences of sensory events encountered in the environment. When sensory information is absent during "offline" resting periods, brief neuronal population bursts can "replay" sequences of activity that resemble bouts of sensory experience. These sequences can occur in either forward or reverse order, and can even include spatial trajectories that have not been experienced, but are consistent with the topology of the environment. The neural circuit mechanisms underlying this variable and flexible sequence generation are unknown. Here we demonstrate in a recurrent spiking network model of hippocampal area CA3 that experimental constraints on network dynamics such as spike rate adaptation, population sparsity, stimulus selectivity, and rhythmicity enable additional emergent properties, including variable offline memory replay. In an online stimulus-driven state, we observed the emergence of neuronal sequences that swept from representations of past to future stimuli on the timescale of the theta rhythm. In an offline state driven only by noise, the network generated both forward and reverse neuronal sequences, and recapitulated the experimental observation that offline memory replay events tend to include salient locations like the site of a reward. These results demonstrate that biological constraints on the dynamics of recurrent neural circuits are sufficient to enable memories of sensory events stored in the strengths of synaptic connections to be flexibly read out during rest and sleep, which is thought to be important for memory consolidation and planning of future behavior.

The generation of cortical novelty responses through inhibitory plasticity

Animals depend on fast and reliable detection of novel stimuli in their environment. Neurons in multiple sensory areas respond more strongly to novel in comparison to familiar stimuli. Yet, it remains unclear which circuit, cellular, and synaptic mechanisms underlie those responses. Here, we show that spike-timing-dependent plasticity of inhibitory-to-excitatory synapses generates novelty responses in a recurrent spiking network model. Inhibitory plasticity increases the inhibition onto excitatory neurons tuned to familiar stimuli, while inhibition for novel stimuli remains low, leading to a network novelty response. The generation of novelty responses does not depend on the periodicity but rather on the distribution of presented stimuli. By including tuning of inhibitory neurons, the network further captures stimulus-specific adaptation. Finally, we suggest that disinhibition can control the amplification of novelty responses. Therefore, inhibitory plasticity provides a flexible, biologically plausible mechanism to detect the novelty of bottom-up stimuli, enabling us to make experimentally testable predictions.

Long- and short-term history effects in a spiking network model of statistical learning

The statistical structure of the environment is often important when making decisions. There are multiple theories of how the brain represents statistical structure. One such theory states that neural activity spontaneously samples from probability distributions. In other words, the network spends more time in states which encode high-probability stimuli. Existing spiking network models implementing sampling lack the ability to learn the statistical structure from observed stimuli and instead often hard-code a dynamics. Here, we focus on how arbitrary prior knowledge about the external world can both be learned and spontaneously recollected. We present a model based upon learning the inverse of the cumulative distribution function. Learning is entirely unsupervised using biophysical neurons and biologically plausible learning rules. We show how this prior knowledge can then be accessed to compute expectations and signal surprise in downstream networks. Sensory history effects emerge from the model as a consequence of ongoing learning.

Model Reduction Captures Stochastic Gamma Oscillations on Low-Dimensional Manifolds

Gamma frequency oscillations (25–140 Hz), observed in the neural activities within many brain regions, have long been regarded as a physiological basis underlying many brain functions, such as memory and attention. Among numerous theoretical and computational modeling studies, gamma oscillations have been found in biologically realistic spiking network models of the primary visual cortex. However, due to its high dimensionality and strong non-linearity, it is generally difficult to perform detailed theoretical analysis of the emergent gamma dynamics. Here we propose a suite of Markovian model reduction methods with varying levels of complexity and apply it to spiking network models exhibiting heterogeneous dynamical regimes, ranging from nearly homogeneous firing to strong synchrony in the gamma band. The reduced models not only successfully reproduce gamma oscillations in the full model, but also exhibit the same dynamical features as we vary parameters. Most remarkably, the invariant measure of the coarse-grained Markov process reveals a two-dimensional surface in state space upon which the gamma dynamics mainly resides. Our results suggest that the statistical features of gamma oscillations strongly depend on the subthreshold neuronal distributions. Because of the generality of the Markovian assumptions, our dimensional reduction methods offer a powerful toolbox for theoretical examinations of other complex cortical spatio-temporal behaviors observed in both neurophysiological experiments and numerical simulations.

Phase-locking patterns underlying effective communication in exact firing rate models of neural networks

Macroscopic oscillations in the brain have been observed to be involved in many cognitive tasks but their role is not completely understood. One of the suggested functions of the oscillations is to dynamically modulate communication between neural circuits. The Communication Through Coherence (CTC) theory establishes that oscillations reflect rhythmic changes in excitability of the neuronal populations. Thus, populations need to be properly phase-locked so that input volleys arrive at the peaks of excitability of the receiving population to communicate effectively. Here, we present a modeling study to explore synchronization between neuronal circuits connected with unidirectional projections. We consider an Excitatory-Inhibitory (E-I) network of quadratic integrate-and-fire neurons modeling a Pyramidal-Interneuronal Network Gamma (PING) rhythm. The network receives an external periodic input from either one or two sources, simulating the inputs from other oscillating neural groups. We use recently developed mean-field models which provide an exact description of the macroscopic activity of the spiking network. This low-dimensional mean field model allows us to use tools from bifurcation theory to identify the phase-locked states between the input and the target population as a function of the amplitude, frequency and coherence of the inputs. We identify the conditions for optimal phaselocking and selective communication. We find that inputs with high coherence can entrain the network for a wider range of frequencies. Besides, faster oscillatory inputs than the intrinsic network gamma cycle show more effective communication than inputs with similar frequency. Our analysis further shows that the entrainment of the network by inputs with higher frequency is more robust to distractors, thus giving them an advantage to entrain the network. Finally, we show that pulsatile inputs can switch between attended inputs in selective attention.

Thalamocortical Spectral Transmission Relies on Balanced Input Strengths

The thalamus is a key element of sensory transmission in the brain, as it gates and selects sensory streams through a modulation of its internal activity. A preponderant role in these functions is played by its internal activity in the alpha range ([8–14] Hz), but the mechanism underlying this process is not completely understood. In particular, how do thalamocortical connections convey stimulus driven information selectively over the back-ground of thalamic internally generated activity? Here we investigate this issue with a spiking network model of feedforward connectivity between thalamus and primary sensory cortex reproducing the local field potential of both areas. We found that in a feedforward network, thalamic oscillations in the alpha range do not entrain cortical activity for two reasons: (i) alpha range oscillations are weaker in neurons projecting to the cortex, (ii) the gamma resonance dynamics of cortical networks hampers oscillations over the 10–20 Hz range thus weakening alpha range oscillations. This latter mechanism depends on the balance of the strength of thalamocortical connections toward excitatory and inhibitory neurons in the cortex. Our results highlight the relevance of corticothalamic feedback to sustain alpha range oscillations and pave the way toward an integrated understanding of the sensory streams traveling between the periphery and the cortex.