scholarly journals Applying stochastic spike train theory for high-accuracy MEG/EEG

2019 ◽  
Author(s):  
Niels Trusbak Haumann ◽  
Minna Huotilainen ◽  
Peter Vuust ◽  
Elvira Brattico
Keyword(s):  
Neural Networks ◽  
Large Scale ◽  
Brain Activity ◽  
Component Analysis ◽  
High Accuracy ◽  
Spike Timing ◽  
Clinical Diagnostics ◽  
Evoked Response ◽  
Brain Responses ◽  
The Brain

AbstractThe accuracy of electroencephalography (EEG) and magnetoencephalography (MEG) is challenged by overlapping sources from within the brain. This lack of accuracy is a severe limitation to the possibilities and reliability of modern stimulation protocols in basic research and clinical diagnostics. As a solution, we here introduce a theory of stochastic neuronal spike timing probability densities for describing the large-scale spiking activity in neural networks, and a novel spike density component analysis (SCA) method for isolating specific neural sources. Three studies are conducted based on 564 cases of evoked responses to auditory stimuli from 94 human subjects each measured with 60 EEG electrodes and 306 MEG sensors. In the first study we show that the large-scale spike timing (but not non-encephalographic artifacts) in MEG/EEG waveforms can be modeled with Gaussian probability density functions with high accuracy (median 99.7%-99.9% variance explained), while gamma and sine functions fail describing the MEG and EEG waveforms. In the second study we confirm that SCA can isolate a specific evoked response of interest. Our findings indicate that the mismatch negativity (MMN) response is accurately isolated with SCA, while principal component analysis (PCA) fails supressing interference from overlapping brain activity, e.g. from P3a and alpha waves, and independent component analysis (ICA) distorts the evoked response. Finally, we confirm that SCA accurately reveals inter-individual variation in evoked brain responses, by replicating findings relating individual traits with MMN variations. The findings of this paper suggest that the commonly overlapping neural sources in single-subject or patient data can be more accurately separated by applying the introduced theory of large-scale spike timing and method of SCA in comparison to PCA and ICA.Significance statementElectroencephalography (EEG) and magnetoencelopraphy (MEG) are among the most applied non-invasive brain recording methods in humans. They are the only methods to measure brain function directly and in time resolutions smaller than seconds. However, in modern research and clinical diagnostics the brain responses of interest cannot be isolated, because of interfering signals of other ongoing brain activity. For the first time, we introduce a theory and method for mathematically describing and isolating overlapping brain signals, which are based on prior intracranial in vivo research on brain cells in monkey and human neural networks. Three studies mutually support our theory and suggest that a new level of accuracy in MEG/EEG can achieved by applying the procedures presented in this paper.

scholarly journals Brain hierarchy score: Which deep neural networks are hierarchically brain-like?

2020 ◽  
Author(s):  
Soma Nonaka ◽  
Kei Majima ◽  
Shuntaro C. Aoki ◽  
Yukiyasu Kamitani
Keyword(s):  
Neural Networks ◽  
Image Recognition ◽  
High Performance ◽  
Deep Neural Networks ◽  
Recognition Performance ◽  
Brain Activity ◽  
Spatial Integration ◽  
Hierarchical Processing ◽  
Visual Areas ◽  
The Brain

SummaryAchievement of human-level image recognition by deep neural networks (DNNs) has spurred interest in whether and how DNNs are brain-like. Both DNNs and the visual cortex perform hierarchical processing, and correspondence has been shown between hierarchical visual areas and DNN layers in representing visual features. Here, we propose the brain hierarchy (BH) score as a metric to quantify the degree of hierarchical correspondence based on the decoding of individual DNN unit activations from human brain activity. We find that BH scores for 29 pretrained DNNs with varying architectures are negatively correlated with image recognition performance, indicating that recently developed high-performance DNNs are not necessarily brain-like. Experimental manipulations of DNN models suggest that relatively simple feedforward architecture with broad spatial integration is critical to brain-like hierarchy. Our method provides new ways for designing DNNs and understanding the brain in consideration of their representational homology.

scholarly journals Unsupervised seizure localisation with attention-based graph neural networks

2020 ◽  
Author(s):  
Daniele Grattarola ◽  
Lorenzo Livi ◽  
Cesare Alippi ◽  
Richard Wennberg ◽  
Taufik Valiante
Keyword(s):  
Neural Networks ◽  
Brain Activity ◽  
Functional Networks ◽  
Seizure Onset ◽  
The Past ◽  
Seizure Onset Zone ◽  
Brain States ◽  
Graph Neural Networks ◽  
Intracranial Electroencephalography ◽  
The Brain

Abstract Graph neural networks (GNNs) and the attention mechanism are two of the most significant advances in artificial intelligence methods over the past few years. The former are neural networks able to process graph-structured data, while the latter learns to selectively focus on those parts of the input that are more relevant for the task at hand. In this paper, we propose a methodology for seizure localisation which combines the two approaches. Our method is composed of several blocks. First, we represent brain states in a compact way by computing functional networks from intracranial electroencephalography recordings, using metrics to quantify the coupling between the activity of different brain areas. Then, we train a GNN to correctly distinguish between functional networks associated with interictal and ictal phases. The GNN is equipped with an attention-based layer which automatically learns to identify those regions of the brain (associated with individual electrodes) that are most important for a correct classification. The localisation of these regions is fully unsupervised, meaning that it does not use any prior information regarding the seizure onset zone. We report results both for human patients and for simulators of brain activity. We show that the regions of interest identified by the GNN strongly correlate with the localisation of the seizure onset zone reported by electroencephalographers. We also show that our GNN exhibits uncertainty on those patients for which the clinical localisation was also unsuccessful, highlighting the robustness of the proposed approach.

scholarly journals A neuromorphic implementation of multiple spike-timing synaptic plasticity rules for large-scale neural networks

2015 ◽  
Vol 9 ◽  
Author(s):  
Runchun M. Wang ◽  
Tara J. Hamilton ◽  
Jonathan C. Tapson ◽  
André van Schaik
Keyword(s):  
Neural Networks ◽  
Synaptic Plasticity ◽  
Large Scale ◽  
Spike Timing

scholarly journals Go with the FLOW: visualizing spatiotemporal dynamics in optical widefield calcium imaging

2021 ◽  
Vol 18 (181) ◽  
pp. 20210523
Author(s):  
Nathaniel J. Linden ◽  
Dennis R. Tabuena ◽  
Nicholas A. Steinmetz ◽  
William J. Moody ◽  
Steven L. Brunton ◽  
...  
Keyword(s):  
Coherent Structures ◽  
Calcium Imaging ◽  
Large Scale ◽  
Vector Fields ◽  
Brain Activity ◽  
Time Varying ◽  
Finite Time Lyapunov Exponent ◽  
Synthetic Datasets ◽  
The Brain ◽  
Analyse Time

Widefield calcium imaging has recently emerged as a powerful experimental technique to record coordinated large-scale brain activity. These measurements present a unique opportunity to characterize spatiotemporally coherent structures that underlie neural activity across many regions of the brain. In this work, we leverage analytic techniques from fluid dynamics to develop a visualization framework that highlights features of flow across the cortex, mapping wavefronts that may be correlated with behavioural events. First, we transform the time series of widefield calcium images into time-varying vector fields using optic flow. Next, we extract concise diagrams summarizing the dynamics, which we refer to as FLOW (flow lines in optical widefield imaging) portraits . These FLOW portraits provide an intuitive map of dynamic calcium activity, including regions of initiation and termination, as well as the direction and extent of activity spread. To extract these structures, we use the finite-time Lyapunov exponent technique developed to analyse time-varying manifolds in unsteady fluids. Importantly, our approach captures coherent structures that are poorly represented by traditional modal decomposition techniques. We demonstrate the application of FLOW portraits on three simple synthetic datasets and two widefield calcium imaging datasets, including cortical waves in the developing mouse and spontaneous cortical activity in an adult mouse.

scholarly journals A large single-participant fMRI dataset for probing brain responses to naturalistic stimuli in space and time

2019 ◽  
Author(s):  
K. Seeliger ◽  
R. P. Sommers ◽  
U. Güçlü ◽  
S. E. Bosch ◽  
M. A. J. van Gerven
Keyword(s):  
Neural Networks ◽  
Explanatory Models ◽  
Single Individual ◽  
Doctor Who ◽  
Training Set ◽  
Test Set ◽  
Brain Volumes ◽  
Brain Responses ◽  
Single Presentation ◽  
The Brain

AbstractVisual and auditory representations in the human brain have been studied with encoding, decoding and reconstruction models. Representations from convolutional neural networks have been used as explanatory models for these stimulus-induced hierarchical brain activations. However, none of the fMRI datasets currently available has adequate amounts of data for sufficiently sampling their representations. We recorded a densely sampled large fMRI dataset (TR=700 ms) in a single individual exposed to spatiotemporal visual and auditory naturalistic stimuli (30 episodes of BBC’s Doctor Who). The data consists of 120.830 whole-brain volumes (approx. 23 h) of single-presentation data (full episodes, training set) and 1.178 volumes (11 min) of repeated narrative short episodes (test set, 22 repetitions), recorded with fixation over a period of six months. This rich dataset can be used widely to study the way the brain represents audiovisual input across its sensory hierarchies.

scholarly journals GPT-2’s activations predict the degree of semantic comprehension in the human brain

2021 ◽  
Author(s):  
Charlotte Caucheteux ◽  
Alexandre Gramfort ◽  
Jean-Rémi King
Keyword(s):  
Brain Activity ◽  
Planum Temporale ◽  
Functional Magnetic Resonance ◽  
Resonance Imaging ◽  
Brain Responses ◽  
The Brain ◽  
Semantic Comprehension ◽  
Empirical Framework ◽  
Superior Frontal Cortex ◽  
Language Network

Language transformers, like GPT-2, have demonstrated remarkable abilities to process text, and now constitute the backbone of deep translation, summarization and dialogue algorithms. However, whether these models actually understand language is highly controversial. Here, we show that the representations of GPT-2 not only map onto the brain responses to spoken stories, but also predict the extent to which subjects understand the narratives. To this end, we analyze 101 subjects recorded with functional Magnetic Resonance Imaging while listening to 70 min of short stories. We then fit a linear model to predict brain activity from GPT-2 activations, and correlate this mapping with subjects’ comprehension scores as assessed for each story. The results show that GPT-2’s brain predictions significantly correlate with semantic comprehension. These effects are bilaterally distributed in the language network and peak with a correlation above 30% in the infero-frontal and medio-temporal gyri as well as in the superior frontal cortex, the planum temporale and the precuneus. Overall, this study provides an empirical framework to probe and dissect semantic comprehension in brains and deep learning algorithms.

scholarly journals Local and distributed cortical markers of effort expenditure during sustained goal pursuit

2020 ◽  
Author(s):  
Lauren M. Patrick ◽  
Kevin M. Anderson ◽  
Avram J. Holmes
Keyword(s):  
Goal Attainment ◽  
Brain Activity ◽  
Goal Pursuit ◽  
Physical Effort ◽  
Course Of Action ◽  
Brain Responses ◽  
Subjective Valuation ◽  
Medial Pfc ◽  
Past Effort ◽  
The Brain

AbstractThe adaptive adjustment of behavior in pursuit of desired goals is critical for survival. To accomplish this complex feat, individuals must weigh the potential benefits of a given course of action against time, energy, and resource costs. Prior research in this domain has greatly advanced understanding of the cortico-striatal circuits that support the anticipation and receipt of desired outcomes, characterizing core aspects of subjective valuation at discrete points in time. However, motivated goal pursuit is not a static or cost neutral process and the brain mechanisms that underlie individual differences in the dynamic updating of effort expenditure across time remain unclear. Here, 38 healthy right-handed participants underwent functional MRI (fMRI) while completing a novel paradigm to examine their willingness to exert physical effort over a prolonged trial, either to obtain monetary rewards or avoid punishments. During sustained goal pursuit, medial prefrontal cortex (mPFC) response scaled with trial-to-trial differences in effort expenditure as a function of both monetary condition and eventual task earnings. Multivariate pattern analysis (MVPA) searchlights were used to examine relations linking prior trial-level effort expenditure to subsequent brain responses to feedback. At reward feedback, whole-brain searchlights identified signals reflecting past effort expenditure in dorsal and ventral mPFC, encompassing broad swaths of frontoparietal and dorsal attention networks. These results suggest a core role for mPFC in scaling effort expenditure during sustained goal pursuit, with the subsequent tracking of effort costs following successful goal attainment extending to incorporate distributed brain networks that support executive functioning and externally oriented attention.Significance StatementHistorically, much of the research on subjective valuation has focused on discrete points in time. Here, we examine brain responses associated with willingness to exert physical effort during the sustained pursuit of desired goals. Our analyses reveal a distributed pattern of brain activity encompassing aspects of ventral mPFC that tracks with trial-level variability in effort expenditure. Indicating that the brain represents echoes of effort at the point of feedback, searchlight analyses revealed signals associated with past effort expenditure in broad swaths of dorsal and medial PFC. These data have important implications for the study of how the brain’s valuation mechanisms contend with the complexity of real-world dynamic environments with relevance for the study of behavior across health and disease.

scholarly journals LogicSNN: A Unified Spiking Neural Networks Logical Operation Paradigm

Electronics ◽  
2021 ◽  
Vol 10 (17) ◽  
pp. 2123 ◽  
Author(s):  
Lingfei Mo ◽  
Minghao Wang
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Network Structure ◽  
Large Scale ◽  
Spike Timing ◽  
Spiking Neural Networks ◽  
Logical Operation ◽  
Large Scale Network ◽  
Learning Capabilities ◽  
Scale Network

LogicSNN, a unified spiking neural networks (SNN) logical operation paradigm is proposed in this paper. First, we define the logical variables under the semantics of SNN. Then, we design the network structure of this paradigm and use spike-timing-dependent plasticity for training. According to this paradigm, six kinds of basic SNN binary logical operation modules and three kinds of combined logical networks based on these basic modules are implemented. Through these experiments, the rationality, cascading characteristics and the potential of building large-scale network of this paradigm are verified. This study fills in the blanks of the logical operation of SNN and provides a possible way to realize more complex machine learning capabilities.

scholarly journals Identifying optimal working points of individual Virtual Brains: A large-scale brain network modelling study

2020 ◽  
Author(s):  
Paul Triebkorn ◽  
Joelle Zimmermann ◽  
Leon Stefanovski ◽  
Dipanjan Roy ◽  
Ana Solodkin ◽  
...  
Keyword(s):  
Functional Connectivity ◽  
Brain Function ◽  
Large Scale ◽  
Brain Activity ◽  
Brain Network ◽  
Model Parameters ◽  
Network Modelling ◽  
Neural Populations ◽  
Global Coupling ◽  
The Brain

AbstractUsing The Virtual Brain (TVB, thevirtualbrian.org) simulation platform, we explored for 50 individual adult human brains (ages 18-80), how personalized connectome based brain network modelling captures various empirical observations as measured by functional magnetic resonance imaging (fMRI) and electroencephalography (EEG). We compare simulated activity based on individual structural connectomes (SC) inferred from diffusion weighted imaging with fMRI and EEG in the resting state. We systematically explore the role of the following model parameters: conduction velocity, global coupling and graph theoretical features of individual SC. First, a subspace of the parameter space is identified for each subject that results in realistic brain activity, i.e. reproducing the following prominent features of empirical EEG-fMRI activity: topology of resting-state fMRI functional connectivity (FC), functional connectivity dynamics (FCD), electrophysiological oscillations in the delta (3-4 Hz) and alpha (8-12 Hz) frequency range and their bimodality, i.e. low and high energy modes. Interestingly, FCD fit, bimodality and static FC fit are highly correlated. They all show their optimum in the same range of global coupling. In other words, only when our local model is in a bistable regime we are able to generate switching of modes in our global network. Second, our simulations reveal the explicit network mechanisms that lead to electrophysiological oscillations, their bimodal behaviour and inter-regional differences. Third, we discuss biological interpretability of the Stefanescu-Jirsa-Hindmarsh-Rose-3D model when embedded inside the large-scale brain network and mechanisms underlying the emergence of bimodality of the neural signal.With the present study, we set the cornerstone for a systematic catalogue of spatiotemporal brain activity regimes generated with the connectome-based brain simulation platform The Virtual Brain.Author SummaryIn order to understand brain dynamics we use numerical simulations of brain network models. Combining the structural backbone of the brain, that is the white matter fibres connecting distinct regions in the grey matter, with dynamical systems describing the activity of neural populations we are able to simulate brain function on a large scale. In order to make accurate prediction with this network, it is crucial to determine optimal model parameters. We here use an explorative approach to adjust model parameters to individual brain activity, showing that subjects have their own optimal point in the parameter space, depending on their brain structure and function. At the same time, we investigate the relation between bistable phenomena on the scale of neural populations and the changed in functional connectivity on the brain network scale. Our results are important for future modelling approaches trying to make accurate predictions of brain function.

scholarly journals Long-range phase synchronization of high-frequency oscillations in human cortex

2020 ◽  
Vol 11 (1) ◽  
Author(s):  
G. Arnulfo ◽  
S. H. Wang ◽  
V. Myrov ◽  
B. Toselli ◽  
J. Hirvonen ◽  
...  
Keyword(s):  
High Frequency ◽  
Large Scale ◽  
Phase Synchronization ◽  
Brain Activity ◽  
Brain Regions ◽  
Spike Timing ◽  
Human Cortex ◽  
Neuronal Communication ◽  
High Frequency Oscillations ◽  
Connectivity Patterns

Abstract Inter-areal synchronization of neuronal oscillations at frequencies below ~100 Hz is a pervasive feature of neuronal activity and is thought to regulate communication in neuronal circuits. In contrast, faster activities and oscillations have been considered to be largely local-circuit-level phenomena without large-scale synchronization between brain regions. We show, using human intracerebral recordings, that 100–400 Hz high-frequency oscillations (HFOs) may be synchronized between widely distributed brain regions. HFO synchronization expresses individual frequency peaks and exhibits reliable connectivity patterns that show stable community structuring. HFO synchronization is also characterized by a laminar profile opposite to that of lower frequencies. Importantly, HFO synchronization is both transiently enhanced and suppressed in separate frequency bands during a response-inhibition task. These findings show that HFO synchronization constitutes a functionally significant form of neuronal spike-timing relationships in brain activity and thus a mesoscopic indication of neuronal communication per se.

Sign in / Sign up

Export Citation Format

Share Document