Neural Mechanisms of Visual Motion Anomalies in Autism: A Two-Decade Update and Novel Aetiology

The 21st century has seen dramatic changes in our understanding of the visual physio-perceptual anomalies of autism and also in the structure and development of the primate visual system. This review covers the past 20 years of research into motion perceptual/dorsal stream anomalies in autism, as well as new understanding of the development of primate vision. The convergence of this literature allows a novel developmental hypothesis to explain the physiological and perceptual differences of the broad autistic spectrum. Central to these observations is the development of motion areas MT+, the seat of the dorsal cortical stream, central area of pre-attentional processing as well as being an anchor of binocular vision for 3D action. Such development normally occurs via a transfer of thalamic drive from the inferior pulvinar → MT to the anatomically stronger but later-developing LGN → V1 → MT connection. We propose that autistic variation arises from a slowing in the normal developmental attenuation of the pulvinar → MT pathway. We suggest that this is caused by a hyperactive amygdala → thalamic reticular nucleus circuit increasing activity in the PIm → MT via response gain modulation of the pulvinar and hence altering synaptic competition in area MT. We explore the probable timing of transfer in dominance of human MT from pulvinar to LGN/V1 driving circuitry and discuss the implications of the main hypothesis.

The synaptic basis of activity-dependent eye-specific competition

Binocular vision requires proper developmental wiring of eye-specific inputs to the brain. Axons from the two eyes initially overlap in the dorsal lateral geniculate nucleus and undergo activity-dependent competition to segregate into target domains. The synaptic basis of such refinement is unknown. Here we used volumetric super-resolution imaging to measure the nanoscale molecular reorganization of developing retinogeniculate eye-specific synapses in the mouse brain. The outcome of binocular synaptic competition was determined by the relative eye-specific maturation of presynaptic vesicle content. Genetic disruption of spontaneous retinal activity prevented subsynaptic vesicle pool maturation, recruitment of vesicles to the active zone, synaptic development and eye-specific competition. These results reveal an activity-dependent presynaptic basis for axonal refinement in the mammalian visual system.

Constraint-induced intervention as an emergent phenomenon from synaptic competition in biological systems

The principle of constraint-induced therapy is widely practiced in rehabilitation. In hemiplegic cerebral palsy (CP) with impaired contralateral corticospinal projection due to unilateral injury, function improves after imposing a temporary constraint on limbs from the less affected hemisphere. This type of partially-reversible impairment in motor control by early brain injury bears a resemblance to the experience-dependent plastic acquisition and modification of neuronal response selectivity in the visual cortex. Previously, such mechanism was modeled within the framework of BCM (Bienenstock-Cooper-Munro) theory, a rate-based synaptic modification theory. Here, we demonstrate a minimally complex yet sufficient neural network model which provides a fundamental explanation for inter-hemispheric competition using a simplified spike-based model of information transmission and plasticity. We emulate the restoration of function in hemiplegic CP by simulating the competition between cells of the ipsilateral and contralateral corticospinal tracts. We use a high-speed hardware neural simulation to provide realistic numbers of spikes and realistic magnitudes of synaptic modification. We demonstrate that the phenomenon of constraint-induced partial reversal of hemiplegia can be modeled by simplified neural descending tracts with 2 layers of spiking neurons and synapses with spike-timing-dependent plasticity (STDP). We further demonstrate that persistent hemiplegia following unilateral cortical inactivation or deprivation is predicted by the STDP-based model but is inconsistent with BCM model. Although our model is a highly simplified and limited representation of the corticospinal system, it offers an explanation of how constraint as an intervention can help the system to escape from a suboptimal solution. This is a display of an emergent phenomenon from the synaptic competition.

Sequence memory in recurrent neuronal network can develop without structured input

How does spontaneous activity during development prepare cortico-cortical connections for sensory input? We here analyse the development of sequence memory, an intrinsic feature of recurrent networks that supports temporal perception. We use a recurrent neural network model with homeostatic and spike-timing-dependent plasticity (STDP). This model has been shown to learn specific sequences from structured input. We show that development even under unstructured input increases unspecific sequence memory. Moreover, networks “pre-shaped” by such unstructured input subsequently learn specific sequences faster. The key structural substrate is the emergence of strong and directed synapses due to STDP and synaptic competition. These construct self-amplifying preferential paths of activity, which can quickly encode new input sequences. Our results suggest that memory traces are not printed on a tabula rasa, but instead harness building blocks already present in the brain.

Temporal Gating of Synaptic Competition in the Amygdala by Cannabinoid Receptor Activation

The acquisition of fear memories involves plasticity of the thalamic and cortical pathways to the lateral amygdala (LA). In turn, the maintenance of synaptic plasticity requires the interplay between input-specific synaptic tags and the allocation of plasticity-related proteins. Based on this interplay, weakly activated synapses can express long-lasting forms of synaptic plasticity by cooperating with strongly activated synapses. Increasing the number of activated synapses can shift cooperation to competition. Synaptic cooperation and competition can determine whether two events, separated in time, are associated or whether a particular event is selected for storage. The rules that determine whether synapses cooperate or compete are unknown. We found that synaptic cooperation and competition, in the LA, are determined by the temporal sequence of cortical and thalamic stimulation and that the strength of the synaptic tag is modulated by the endocannabinoid signaling. This modulation is particularly effective in thalamic synapses, supporting a critical role of endocannabinoids in restricting thalamic plasticity. Also, we found that the availability of synaptic proteins is activity-dependent, shifting competition to cooperation. Our data present the first evidence that presynaptic modulation of synaptic activation, by the cannabinoid signaling, functions as a temporal gating mechanism limiting synaptic cooperation and competition.

Competitive Learning in a Spiking Neural Network: Towards an Intelligent Pattern Classifier

One of the modern trends in the design of human–machine interfaces (HMI) is to involve the so called spiking neuron networks (SNNs) in signal processing. The SNNs can be trained by simple and efficient biologically inspired algorithms. In particular, we have shown that sensory neurons in the input layer of SNNs can simultaneously encode the input signal based both on the spiking frequency rate and on varying the latency in generating spikes. In the case of such mixed temporal-rate coding, the SNN should implement learning working properly for both types of coding. Based on this, we investigate how a single neuron can be trained with pure rate and temporal patterns, and then build a universal SNN that is trained using mixed coding. In particular, we study Hebbian and competitive learning in SNN in the context of temporal and rate coding problems. We show that the use of Hebbian learning through pair-based and triplet-based spike timing-dependent plasticity (STDP) rule is accomplishable for temporal coding, but not for rate coding. Synaptic competition inducing depression of poorly used synapses is required to ensure a neural selectivity in the rate coding. This kind of competition can be implemented by the so-called forgetting function that is dependent on neuron activity. We show that coherent use of the triplet-based STDP and synaptic competition with the forgetting function is sufficient for the rate coding. Next, we propose a SNN capable of classifying electromyographical (EMG) patterns using an unsupervised learning procedure. The neuron competition achieved via lateral inhibition ensures the “winner takes all” principle among classifier neurons. The SNN also provides gradual output response dependent on muscular contraction strength. Furthermore, we modify the SNN to implement a supervised learning method based on stimulation of the target classifier neuron synchronously with the network input. In a problem of discrimination of three EMG patterns, the SNN with supervised learning shows median accuracy 99.5% that is close to the result demonstrated by multi-layer perceptron learned by back propagation of an error algorithm.

Can sleep protect memories from catastrophic forgetting?

Continual learning remains to be an unsolved problem in artificial neural networks. Biological systems have evolved mechanisms by which they can prevent catastrophic forgetting of old knowledge during new training and allow lifelong learning. Building upon data suggesting the importance of sleep in learning and memory, here we test a hypothesis that sleep protects memories from catastrophic forgetting. We found that training in a thalamocortical network model of a “new” memory that interferes with previously stored “old” memory may result in degradation and forgetting of the old memory trace. Simulating NREM sleep immediately after new learning leads to replay, which reverses the damage and ultimately enhances both old and new memory traces. Surprisingly, we found that sleep replay goes beyond recovering old memory traces that were damaged by new learning. When a new memory competes for the neuronal/synaptic resources previously allocated to the old memory, sleep replay changes the synaptic footprint of the old memory trace to allow for the overlapping populations of neurons to store multiple memories. Different neurons become preferentially supporting different memory traces to allow successful recall. We compared synaptic weight dynamics during sleep replay with that during interleaved training – a common approach to overcome catastrophic forgetting in artificial networks – and found that interleaved training promotes synaptic competition and weakening of reciprocal synapses, effectively reducing an ensemble of neurons contributing to memory recall. This leads to suboptimal recall performance compared to that after sleep. Together, our results suggest that sleep provides a powerful mechanism to achieve continual learning by combining consolidation of new memory traces with reconsolidation of old memory traces to minimize memory interference.