scholarly journals Representation learning for neural population activity with Neural Data Transformers

2021 ◽  
Author(s):  
Joel Ye ◽  
Chethan Pandarinath
Keyword(s):  
Representation Learning ◽  
Neural Population ◽  
Population Activity ◽  
Neural Data ◽  
Neural Population Activity

scholarly journals Representation learning for neural population activity with Neural Data Transformers

2021 ◽  
Author(s):  
Joel Ye ◽  
Chethan Pandarinath
Keyword(s):  
Real Time ◽  
Representation Learning ◽  
Neural Population ◽  
Dynamical Structure ◽  
Population Activity ◽  
Neural Data ◽  
Reaching Task ◽  
Explicit Dynamics ◽  
Real Time Applications ◽  
Neural Population Activity

AbstractNeural population activity is theorized to reflect an underlying dynamical structure. This structure can be accurately captured using state space models with explicit dynamics, such as those based on recurrent neural networks (RNNs). However, using recurrence to explicitly model dynamics necessitates sequential processing of data, slowing real-time applications such as brain-computer interfaces. Here we introduce the Neural Data Transformer (NDT), a non-recurrent alternative. We test the NDT’s ability to capture autonomous dynamical systems by applying it to synthetic datasets with known dynamics and data from monkey motor cortex during a reaching task well-modeled by RNNs. The NDT models these datasets as well as state-of-the-art recurrent models. Further, its non-recurrence enables 3.9ms inference, well within the loop time of real-time applications and more than 6 times faster than recurrent baselines on the monkey reaching dataset. These results suggest that an explicit dynamics model is not necessary to model autonomous neural population dynamics.Codegithub.com/snel-repo/neural-data-transformers.

scholarly journals Cortical state transitions and stimulus response evolve along stiff and sloppy parameter dimensions, respectively

eLife ◽  
2020 ◽  
Vol 9 ◽  
Author(s):  
Adrian Ponce-Alvarez ◽  
Gabriela Mochol ◽  
Ainhoa Hermoso-Mendizabal ◽  
Jaime de la Rocha ◽  
Gustavo Deco
Keyword(s):  
Collective Behavior ◽  
Neural Population ◽  
State Transitions ◽  
Population Activity ◽  
Sensory Inputs ◽  
Stimulus Response ◽  
Spontaneous Neuronal Activity ◽  
The Brain ◽  
Shed Light ◽  
Neural Population Activity

Previous research showed that spontaneous neuronal activity presents sloppiness: the collective behavior is strongly determined by a small number of parameter combinations, defined as ‘stiff’ dimensions, while it is insensitive to many others (‘sloppy’ dimensions). Here, we analyzed neural population activity from the auditory cortex of anesthetized rats while the brain spontaneously transited through different synchronized and desynchronized states and intermittently received sensory inputs. We showed that cortical state transitions were determined by changes in stiff parameters associated with the activity of a core of neurons with low responses to stimuli and high centrality within the observed network. In contrast, stimulus-evoked responses evolved along sloppy dimensions associated with the activity of neurons with low centrality and displaying large ongoing and stimulus-evoked fluctuations without affecting the integrity of the network. Our results shed light on the interplay among stability, flexibility, and responsiveness of neuronal collective dynamics during intrinsic and induced activity.

scholarly journals Cortical state transitions and stimulus response evolve along stiff and sloppy parameter dimensions, respectively

2019 ◽  
Author(s):  
Adrián Ponce-Alvarez ◽  
Gabriela Mochol ◽  
Ainhoa Hermoso-Mendizabal ◽  
Jaime de la Rocha ◽  
Gustavo Deco
Keyword(s):  
Collective Behavior ◽  
Neural Population ◽  
State Transitions ◽  
Population Activity ◽  
Sensory Inputs ◽  
Stimulus Response ◽  
Spontaneous Neuronal Activity ◽  
The Brain ◽  
Shed Light ◽  
Neural Population Activity

SummaryPrevious research showed that spontaneous neuronal activity presents sloppiness: the collective behavior is strongly determined by a small number of parameter combinations, defined as “stiff” dimensions, while it is insensitive to many others (“sloppy” dimensions). Here, we analyzed neural population activity from the auditory cortex of anesthetized rats while the brain spontaneously transited through different synchronized and desynchronized states and intermittently received sensory inputs. We showed that cortical state transitions were determined by changes in stiff parameters associated with the activity of a core of neurons with low responses to stimuli and high centrality within the observed network. In contrast, stimulus-evoked responses evolved along sloppy dimensions associated with the activity of neurons with low centrality and displaying large ongoing and stimulus-evoked fluctuations without affecting the integrity of the network. Our results shed light on the interplay among stability, flexibility, and responsiveness of neuronal collective dynamics during intrinsic and induced activity.

scholarly journals Internal models for interpreting neural population activity during sensorimotor control

eLife ◽  
2015 ◽  
Vol 4 ◽  
Author(s):  
Matthew D Golub ◽  
Byron M Yu ◽  
Steven M Chase
Keyword(s):  
Internal Model ◽  
Sensory Information ◽  
Internal Models ◽  
Neural Population ◽  
Prior Beliefs ◽  
Population Activity ◽  
Motor Commands ◽  
Machine Interface ◽  
The Brain ◽  
Neural Population Activity

To successfully guide limb movements, the brain takes in sensory information about the limb, internally tracks the state of the limb, and produces appropriate motor commands. It is widely believed that this process uses an internal model, which describes our prior beliefs about how the limb responds to motor commands. Here, we leveraged a brain-machine interface (BMI) paradigm in rhesus monkeys and novel statistical analyses of neural population activity to gain insight into moment-by-moment internal model computations. We discovered that a mismatch between subjects’ internal models and the actual BMI explains roughly 65% of movement errors, as well as long-standing deficiencies in BMI speed control. We then used the internal models to characterize how the neural population activity changes during BMI learning. More broadly, this work provides an approach for interpreting neural population activity in the context of how prior beliefs guide the transformation of sensory input to motor output.

scholarly journals The Population Tracking Model: A Simple, Scalable Statistical Model for Neural Population Data

2017 ◽  
Vol 29 (1) ◽  
pp. 50-93 ◽  
Author(s):  
Cian O’Donnell ◽  
J. Tiago Gonçalves ◽  
Nick Whiteley ◽  
Carlos Portera-Cailliau ◽  
Terrence J. Sejnowski
Keyword(s):  
Statistical Model ◽  
Large Scale ◽  
Population Data ◽  
Population Coding ◽  
Network Activity ◽  
Neural Population ◽  
Population Activity ◽  
Tracking Model ◽  
Population Rate ◽  
Neural Population Activity

Our understanding of neural population coding has been limited by a lack of analysis methods to characterize spiking data from large populations. The biggest challenge comes from the fact that the number of possible network activity patterns scales exponentially with the number of neurons recorded ([Formula: see text]). Here we introduce a new statistical method for characterizing neural population activity that requires semi-independent fitting of only as many parameters as the square of the number of neurons, requiring drastically smaller data sets and minimal computation time. The model works by matching the population rate (the number of neurons synchronously active) and the probability that each individual neuron fires given the population rate. We found that this model can accurately fit synthetic data from up to 1000 neurons. We also found that the model could rapidly decode visual stimuli from neural population data from macaque primary visual cortex about 65 ms after stimulus onset. Finally, we used the model to estimate the entropy of neural population activity in developing mouse somatosensory cortex and, surprisingly, found that it first increases, and then decreases during development. This statistical model opens new options for interrogating neural population data and can bolster the use of modern large-scale in vivo Ca[Formula: see text] and voltage imaging tools.

scholarly journals New neural activity patterns emerge with long-term learning

2019 ◽  
Vol 116 (30) ◽  
pp. 15210-15215 ◽  
Author(s):  
Emily R. Oby ◽  
Matthew D. Golub ◽  
Jay A. Hennig ◽  
Alan D. Degenhart ◽  
Elizabeth C. Tyler-Kabara ◽  
...  
Keyword(s):  
Neural Activity ◽  
Activity Patterns ◽  
Causal Link ◽  
Neural Population ◽  
Population Activity ◽  
The Brain ◽  
Neural Population Activity

Learning has been associated with changes in the brain at every level of organization. However, it remains difficult to establish a causal link between specific changes in the brain and new behavioral abilities. We establish that new neural activity patterns emerge with learning. We demonstrate that these new neural activity patterns cause the new behavior. Thus, the formation of new patterns of neural population activity can underlie the learning of new skills.

Sign in / Sign up

Export Citation Format

Share Document