scholarly journals Decoding Dynamic Brain Patterns from Evoked Responses: A Tutorial on Multivariate Pattern Analysis Applied to Time Series Neuroimaging Data

2017 ◽  
Vol 29 (4) ◽  
pp. 677-697 ◽  
Author(s):  
Tijl Grootswagers ◽  
Susan G. Wardle ◽  
Thomas A. Carlson

Multivariate pattern analysis (MVPA) or brain decoding methods have become standard practice in analyzing fMRI data. Although decoding methods have been extensively applied in brain–computer interfaces, these methods have only recently been applied to time series neuroimaging data such as MEG and EEG to address experimental questions in cognitive neuroscience. In a tutorial style review, we describe a broad set of options to inform future time series decoding studies from a cognitive neuroscience perspective. Using example MEG data, we illustrate the effects that different options in the decoding analysis pipeline can have on experimental results where the aim is to “decode” different perceptual stimuli or cognitive states over time from dynamic brain activation patterns. We show that decisions made at both preprocessing (e.g., dimensionality reduction, subsampling, trial averaging) and decoding (e.g., classifier selection, cross-validation design) stages of the analysis can significantly affect the results. In addition to standard decoding, we describe extensions to MVPA for time-varying neuroimaging data including representational similarity analysis, temporal generalization, and the interpretation of classifier weight maps. Finally, we outline important caveats in the design and interpretation of time series decoding experiments.

2014 ◽  
Vol 37 (2) ◽  
pp. 213-215 ◽  
Author(s):  
Nikolaas N. Oosterhof ◽  
Alison J. Wiggett ◽  
Emily S. Cross

AbstractCook et al. overstate the evidence supporting their associative account of mirror neurons in humans: most studies do not address a key property, action-specificity that generalizes across the visual and motor domains. Multivariate pattern analysis (MVPA) of neuroimaging data can address this concern, and we illustrate how MVPA can be used to test key predictions of their account.


2016 ◽  
Vol 28 (9) ◽  
pp. 1345-1357 ◽  
Author(s):  
Merim Bilalić

The fusiform face area (FFA) is considered to be a highly specialized brain module because of its central importance for face perception. However, many researchers claim that the FFA is a general visual expertise module that distinguishes between individual examples within a single category. Here, I circumvent the shortcomings of some previous studies on the FFA controversy by using chess stimuli, which do not visually resemble faces, together with more sensitive methods of analysis such as multivariate pattern analysis. I also extend the previous research by presenting chess positions, complex scenes with multiple objects, and their interrelations to chess experts and novices as well as isolated chess objects. The first experiment demonstrates that chess expertise modulated the FFA activation when chess positions were presented. In contrast, single chess objects did not produce different activation patterns among experts and novices even when the multivariate pattern analysis was used. The second experiment focused on the single chess objects and featured an explicit task of identifying the chess objects but failed to demonstrate expertise effects in the FFA. The experiments provide support for the general expertise view of the FFA function but also extend the scope of our understanding about the function of the FFA. The FFA does not merely distinguish between different exemplars within the same category of stimuli. More likely, it parses complex multiobject stimuli that contain numerous functional and spatial relations.


2018 ◽  
Author(s):  
Dylan D. Wagner ◽  
Robert Chavez ◽  
Timothy W. Broom

Multivariate pattern analysis and data driven approaches to understanding how the human brain encodes sensory information and higher level conceptual knowledge have become increasingly dominant in visual and cognitive neuroscience, however it is only in recent years that these methods have been applied to the domain of social information processing. This review examines recent research in the field of social cognitive neuroscience focusing on how multivariate pattern analysis (e.g., pattern classification, representational similarity analysis) and data-driven methods (e.g, reverse correlation, intersubject correlation) have been used to decode and characterize high-level information about the self, other persons and social groups. We begin with a review of what is known about how self-referential processing and person perception are represented in the medial prefrontal cortex based on conventional activation-based neuroimaging approaches. This is followed by a non-technical overview of current multivariate pattern-based and data-driven neuroimaging methods designed to characterize and/or decode neural representations. The remainder of the review focuses on examining how these methods have been applied to the topic of self, person perception and the perception of social groups. Throughout, we highlight recent trends (e.g., analysis of social networks, decoding race and social groups, the use of naturalistic stimuli) and discuss several theoretical challenges that arise from the application of these new methods to the question of how the brain represents knowledge about the self and others.


2016 ◽  
Vol 39 ◽  
Author(s):  
Carolyn Parkinson ◽  
Thalia Wheatley

AbstractMultivariate pattern analysis can address many of the challenges for cognitive neuroscience highlighted in After Phrenology (Anderson 2014) by illuminating the information content of brain regions and by providing insight into whether functional overlap reflects the recruitment of common or distinct computational mechanisms. Further, failing to consider submaximal but reliable population responses can lead to an overly modular account of brain function.


NeuroImage ◽  
2017 ◽  
Vol 159 ◽  
pp. 449-458 ◽  
Author(s):  
Sarah Alizadeh ◽  
Hamidreza Jamalabadi ◽  
Monika Schönauer ◽  
Christian Leibold ◽  
Steffen Gais

2021 ◽  
Author(s):  
Lina Teichmann ◽  
Denise Moerel ◽  
Chris I Baker ◽  
Tijl Grootswagers

Bayes Factors can be used to provide quantifiable evidence for contrasting hypotheses and have thus become increasingly popular in cognitive science. However, Bayes Factors are rarely used to statistically assess the results of neuroimaging experiments. Here, we provide an empirically-driven guide on implementing Bayes Factors for time-series neural decoding results. Using real and simulated Magnetoencephalography (MEG) data, we examine how parameters such as the shape of the prior and data size affect Bayes Factors. Additionally, we discuss benefits Bayes Factors bring to analysing multivariate pattern analysis data and show how using Bayes Factors can be used instead or in addition to traditional frequentist approaches.


2021 ◽  
Author(s):  
Kira Ashton ◽  
Benjamin Zinszer ◽  
Radoslaw Cichy ◽  
Charles Nelson ◽  
Richard Aslin ◽  
...  

Time-resolved multivariate pattern analysis (MVPA), a popular technique for analyzing magneto- and electro-encephalography (M/EEG) neuroimaging data, quantifies the extent and time-course by which neural representations support the discrimination of relevant stimuli dimensions. As EEG is widely used for infant neuroimaging, time-resolved MVPA of infant EEG data is a particularly promising tool for infant cognitive neuroscience. MVPA methods have recently been applied to common infant imaging methods such as EEG and fNIRS. In this tutorial, we provide and describe code to implement time-resolved, within-subject MVPA with infant EEG data. A pipeline for time-resolved MVPA based on linear SVM classification is described and implemented with accompanying code in both Matlab and Python. Results from a test dataset indicated that in both infants and adults this method reliably produced above chance classification accuracy. Extensions of the core pipeline are presented including both geometric- and accuracy-based representational similarity analysis, implemented in Python. Common choices of implementation are presented and discussed. As the amount of artifact-free EEG data contributed by each participant is lower in studies of infants than in studies of children and adults, we also explore and discuss the impact of varying participant-level inclusion thresholds on resulting MVPA findings in these datasets.


2021 ◽  
Vol 15 ◽  
Author(s):  
Karl M. Kuntzelman ◽  
Jacob M. Williams ◽  
Phui Cheng Lim ◽  
Ashok Samal ◽  
Prahalada K. Rao ◽  
...  

In recent years, multivariate pattern analysis (MVPA) has been hugely beneficial for cognitive neuroscience by making new experiment designs possible and by increasing the inferential power of functional magnetic resonance imaging (fMRI), electroencephalography (EEG), and other neuroimaging methodologies. In a similar time frame, “deep learning” (a term for the use of artificial neural networks with convolutional, recurrent, or similarly sophisticated architectures) has produced a parallel revolution in the field of machine learning and has been employed across a wide variety of applications. Traditional MVPA also uses a form of machine learning, but most commonly with much simpler techniques based on linear calculations; a number of studies have applied deep learning techniques to neuroimaging data, but we believe that those have barely scratched the surface of the potential deep learning holds for the field. In this paper, we provide a brief introduction to deep learning for those new to the technique, explore the logistical pros and cons of using deep learning to analyze neuroimaging data – which we term “deep MVPA,” or dMVPA – and introduce a new software toolbox (the “Deep Learning In Neuroimaging: Exploration, Analysis, Tools, and Education” package, DeLINEATE for short) intended to facilitate dMVPA for neuroscientists (and indeed, scientists more broadly) everywhere.


Sign in / Sign up

Export Citation Format

Share Document