Stimulus-Driven and Spontaneous Dynamics in Excitatory-Inhibitory Recurrent Neural Networks for Sequence Representation

Recurrent neural networks (RNNs) have been widely used to model sequential neural dynamics (“neural sequences”) of cortical circuits in cognitive and motor tasks. Efforts to incorporate biological constraints and Dale's principle will help elucidate the neural representations and mechanisms of underlying circuits. We trained an excitatory-inhibitory RNN to learn neural sequences in a supervised manner and studied the representations and dynamic attractors of the trained network. The trained RNN was robust to trigger the sequence in response to various input signals and interpolated a time-warped input for sequence representation. Interestingly, a learned sequence can repeat periodically when the RNN evolved beyond the duration of a single sequence. The eigenspectrum of the learned recurrent connectivity matrix with growing or damping modes, together with the RNN's nonlinearity, were adequate to generate a limit cycle attractor. We further examined the stability of dynamic attractors while training the RNN to learn two sequences. Together, our results provide a general framework for understanding neural sequence representation in the excitatory-inhibitory RNN.

Temporally delayed linear modelling (TDLM) measures replay in both animals and humans

There are rich structures in off-task neural activity which are hypothesised to reflect fundamental computations across a broad spectrum of cognitive functions. Here, we develop an analysis toolkit – Temporal Delayed Linear Modelling (TDLM) for analysing such activity. TDLM is a domain-general method for finding neural sequences that respect a pre-specified transition graph. It combines nonlinear classification and linear temporal modelling to test for statistical regularities in sequences of task-related reactivations. TDLM is developed on the non-invasive neuroimaging data and is designed to take care of confounds and maximize sequence detection ability. Notably, as a linear framework, TDLM can be easily extended, without loss of generality, to capture rodent replay in electrophysiology, including in continuous spaces, as well as addressing second-order inference questions, e.g., its temporal and spatial varying pattern. We hope TDLM will advance a deeper understanding of neural computation and promote a richer convergence between animal and human neuroscience.

Transitioning between preparatory and precisely sequenced neuronal activity in production of a skilled behavior

Precise neural sequences are associated with the production of well-learned skilled behaviors. Yet, how neural sequences arise in the brain remains unclear. In songbirds, premotor projection neurons in the cortical song nucleus HVC are necessary for producing learned song and exhibit precise sequential activity during singing. Using cell-type specific calcium imaging we identify populations of HVC premotor neurons associated with the beginning and ending of singing-related neural sequences. We characterize neurons that bookend singing-related sequences and neuronal populations that transition from sparse preparatory activity prior to song to precise neural sequences during singing. Recordings from downstream premotor neurons or the respiratory system suggest that pre-song activity may be involved in motor preparation to sing. These findings reveal population mechanisms associated with moving from non-vocal to vocal behavioral states and suggest that precise neural sequences begin and end as part of orchestrated activity across functionally diverse populations of cortical premotor neurons.

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here, we describe a software toolbox—called seqNMF—with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral data sets. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.

Transitioning between preparatory and precisely sequenced neuronal activity in production of a skilled behavior

ABSTRACTPrecise neural sequences are associated with the production of well-learned skilled behaviors. Yet, how neural sequences arise in the brain remains unclear. In songbirds, premotor projection neurons in the cortical song nucleus HVC are necessary for producing learned song and exhibit precise sequential activity during singing. Using cell-type specific calcium imaging we identify populations of HVC premotor neurons associated with the beginning and ending of singing-related neural sequences. We discovered neurons that bookend singing-related sequences and neuronal populations that transition from sparse preparatory activity prior to song to precise neural sequences during singing. Recordings from downstream premotor neurons or the respiratory system suggest that pre-song activity may be involved in motor preparation to sing. These findings reveal population mechanisms associated with moving from non-vocal to vocal behavioral states and suggest that precise neural sequences begin and end as part of orchestrated activity across functionally diverse populations of cortical premotor neurons.

Unsupervised discovery of temporal sequences in high-dimensional datasets, with applications to neuroscience

Identifying low-dimensional features that describe large-scale neural recordings is a major challenge in neuroscience. Repeated temporal patterns (sequences) are thought to be a salient feature of neural dynamics, but are not succinctly captured by traditional dimensionality reduction techniques. Here we describe a software toolbox—called seqNMF—with new methods for extracting informative, non-redundant, sequences from high-dimensional neural data, testing the significance of these extracted patterns, and assessing the prevalence of sequential structure in data. We test these methods on simulated data under multiple noise conditions, and on several real neural and behavioral data sets. In hippocampal data, seqNMF identifies neural sequences that match those calculated manually by reference to behavioral events. In songbird data, seqNMF discovers neural sequences in untutored birds that lack stereotyped songs. Thus, by identifying temporal structure directly from neural data, seqNMF enables dissection of complex neural circuits without relying on temporal references from stimuli or behavioral outputs.