scholarly journals Local Discriminant Hyperalignment for multi-subject fMRI data alignment

2016 ◽  
Author(s):  
Muhammad Yousefnezhad ◽  
Daoqiang Zhang

AbstractMultivariate Pattern (MVP) classification can map different cognitive states to the brain tasks. One of the main challenges in MVP analysis is validating the generated results across subjects. However, analyzing multi-subject fMRI data requires accurate functional alignments between neuronal activities of different subjects, which can rapidly increase the performance and robustness of the final results. Hyperalignment (HA) is one of the most effective functional alignment methods, which can be mathematically formulated by the Canonical Correlation Analysis (CCA) methods. Since HA mostly uses the unsupervised CCA techniques, its solution may not be optimized for MVP analysis. By incorporating the idea of Local Discriminant Analysis (LDA) into CCA, this paper proposes Local Discriminant Hyperalignment (LDHA) as a novel supervised HA method, which can provide better functional alignment for MVP analysis. Indeed, the locality is defined based on the stimuli categories in the train-set, where the correlation between all stimuli in the same category will be maximized and the correlation between distinct categories of stimuli approaches to near zero. Experimental studies on multi-subject MVP analysis confirm that the LDHA method achieves superior performance to other state-of-the-art HA algorithms.

2016 ◽  
Author(s):  
Nikolaas N. Oosterhof ◽  
Andrew C. Connolly ◽  
James V. Haxby

AbstractRecent years have seen an increase in the popularity of multivariate pattern (MVP) analysis of functional magnetic resonance (fMRI) data, and, to a much lesser extent, magneto-and electro-encephalography (M/EEG) data. We present CoSMoMVPA, a lightweight MVPA (MVP analysis) toolbox implemented in the intersection of the Matlab and GNU Octave languages, that treats both fMRI and M/EEG data as first-class citizens.CoSMoMVPA supports all state-of-the-art MVP analysis techniques, including searchlight analyses, classification, correlations, representational similarity analysis, and the time generalization method. These can be used to address both data-driven and hypothesis-driven questions about neural organization and representations, both within and across: space, time, frequency bands, neuroimaging modalities, individuals, and species.It uses a uniform data representation of fMRI data in the volume or on the surface, and of M/EEG data at the sensor and source level. Through various external toolboxes, it directly supports reading and writing a variety of fMRI and M/EEG neuroimaging formats, and, where applicable, can convert between them. As a result, it can be integrated readily in existing pipelines and used with existing preprocessed datasets.CoSMoMVPA overloads the traditional volumetric searchlight concept to support neighborhoods for M/EEG and surface-based fMRI data, which supports localization of multivariate effects of interest across space, time, and frequency dimensions. CoSMoMVPA also provides a generalized approach to multiple comparison correction across these dimensions using Threshold-Free Cluster Enhancement with state-of-the-art clustering and permutation techniques.CoSMoMVPA is highly modular and uses abstractions to provide a uniform interface for a variety of MVP measures. Typical analyses require a few lines of code, making it accessible to beginner users. At the same time, expert programmers can easily extend its functionality.CoSMoMVPA comes with extensive documentation, including a variety of runnable demonstration scripts and analysis exercises (with example data and solutions). It uses best software engineering practices including version control, distributed development, an automated test suite, and continuous integration testing. It can be used with the proprietary Matlab and the free GNU Octave software, and it complies with open source distribution platforms such as NeuroDebian.CoSMoMVPA is Free/Open Source Software under the permissive MIT license.Website: https://cosmomvpa.orgSource code: https://github.com/CoSMoMVPA/CoSMoMVPA


2017 ◽  
Author(s):  
Muhammad Yousefnezhad ◽  
Daoqiang Zhang

AbstractMultivariate Pattern (MVP) classification holds enormous potential for decoding visual stimuli in the human brain by employing task-based fMRI data sets. There is a wide range of challenges in the MVP techniques, i.e. decreasing noise and sparsity, defining effective regions of interest (ROIs), visualizing results, and the cost of brain studies. In overcoming these challenges, this paper proposes a novel model of neural representation, which can automatically detect the active regions for each visual stimulus and then utilize these anatomical regions for visualizing and analyzing the functional activities. Therefore, this model provides an opportunity for neuroscientists to ask this question: what is the effect of a stimulus on each of the detected regions instead of just study the fluctuation of voxels in the manually selected ROIs. Moreover, our method introduces analyzing snapshots of brain image for decreasing sparsity rather than using the whole of fMRI time series. Further, a new Gaussian smoothing method is proposed for removing noise of voxels in the level of ROIs. The proposed method enables us to combine different fMRI data sets for reducing the cost of brain studies. Experimental studies on 4 visual categories (words, consonants, objects and nonsense photos) confirm that the proposed method achieves superior performance to state-of-the-art methods.


2020 ◽  
Vol 34 (04) ◽  
pp. 5826-5833
Author(s):  
Yuhang Song ◽  
Jianyi Wang ◽  
Thomas Lukasiewicz ◽  
Zhenghua Xu ◽  
Shangtong Zhang ◽  
...  

Intrinsic rewards were introduced to simulate how human intelligence works; they are usually evaluated by intrinsically-motivated play, i.e., playing games without extrinsic rewards but evaluated with extrinsic rewards. However, none of the existing intrinsic reward approaches can achieve human-level performance under this very challenging setting of intrinsically-motivated play. In this work, we propose a novel megalomania-driven intrinsic reward (called mega-reward), which, to our knowledge, is the first approach that achieves human-level performance in intrinsically-motivated play. Intuitively, mega-reward comes from the observation that infants' intelligence develops when they try to gain more control on entities in an environment; therefore, mega-reward aims to maximize the control capabilities of agents on given entities in a given environment. To formalize mega-reward, a relational transition model is proposed to bridge the gaps between direct and latent control. Experimental studies show that mega-reward (i) can greatly outperform all state-of-the-art intrinsic reward approaches, (ii) generally achieves the same level of performance as Ex-PPO and professional human-level scores, and (iii) has also a superior performance when it is incorporated with extrinsic rewards.


Author(s):  
Roel M. Willems ◽  
Marcel A. J. van Gerven

The use of various techniques for measuring brain activation has led to a dramatic increase in knowledge about how the brain is involved in language. One of these techniques is functional magnetic resonance imaging (fMRI). This chapter describes ways of analyzing data that take away some of the classical limitations of fMRI. One important message from the chapter is that improved analysis techniques allow for the use of more naturalistic and continuously presented stimuli like spoken narratives or movies, than was considered possible before. Part 1 describes how some traditional limitations of fMRI for language research can relatively easily be overcome. In part 2, state-of-the-art approaches for the analysis of fMRI data are examined. It is intended that the description of these techniques will be inspirational for those who want to perform cognitive neuroscience studies of language, most notably at the level of discourse.


2019 ◽  
Author(s):  
Devarajan Sridharan ◽  
Shagun Ajmera ◽  
Hritik Jain ◽  
Mali Sundaresan

AbstractFlexible functional interactions among brain regions mediate critical cognitive functions. Such interactions can be measured from functional magnetic resonance imaging (fMRI) data with either instantaneous (zero-lag) or lag-based (time-lagged) functional connectivity; only the latter approach permits inferring directed functional interactions. Yet, the fMRI hemodynamic response is slow, and sampled at a timescale (seconds) several orders of magnitude slower than the underlying neural dynamics (milliseconds). It is, therefore, widely held that lag-based fMRI functional connectivity, measured with approaches like as Granger-Geweke causality (GC), provides spurious and unreliable estimates of underlying neural interactions. Experimental verification of this claim has proven challenging because neural ground truth connectivity is often unavailable concurrently with fMRI recordings. We address this challenge by combining machine learning with GC functional connectivity estimation. We estimated instantaneous and lag-based GC functional connectivity networks using fMRI data from 1000 participants, drawn from the Human Connectome Project database. A linear classifier, trained on either instantaneous or lag-based GC, reliably discriminated among seven different task and resting brain states, with over 80% cross-validation accuracy. With network simulations, we demonstrate that instantaneous and lag-based GC exploited interactions at fast and slow timescales, respectively, to achieve robust classification. With human fMRI data, instantaneous and lag-based GC identified distinct, cognitive core networks. Finally, variations in GC connectivity explained inter-individual variations in a variety of cognitive scores. Our findings show that instantaneous and lag-based methods reveal complementary aspects of functional connectivity in the brain, and suggest that slow, directed functional interactions, estimated with fMRI, provide robust markers of behaviorally relevant cognitive states.Author SummaryFunctional MRI (fMRI) is a leading, non-invasive technique for mapping networks in the human brain. Yet, fMRI signals are noisy and sluggish, and fMRI scans are acquired at a timescale of seconds, considerably slower than the timescale of neural spiking (milliseconds). Can fMRI, then, be used to infer dynamic processes in the brain such as the direction of information flow among brain networks? We sought to answer this question by applying machine learning to fMRI scans acquired from 1000 participants in the Human Connectome Project (HCP) database. We show that directed brain networks, estimated with a technique known as Granger-Geweke Causality (GC), accurately predicts individual subjects’ task-specific cognitive states inside the scanner, and also explains variations in a variety of behavioral scores across individuals. We propose that directed functional connectivity, as estimated with fMRI-GC, is relevant for understanding human cognitive function.


2019 ◽  
Vol 11 (19) ◽  
pp. 2288 ◽  
Author(s):  
Xin Song ◽  
Xinwei Jiang ◽  
Junbin Gao ◽  
Zhihua Cai

Dimensionality Reduction (DR) models are highly useful for tackling Hyperspectral Images (HSIs) classification tasks. They mainly address two issues: the curse of dimensionality with respect to spectral features, and the limited number of labeled training samples. Among these DR techniques, the Graph-Embedding Discriminant Analysis (GEDA) framework has demonstrated its effectiveness for HSIs feature extraction. However, most of the existing GEDA-based DR methods largely rely on manually tuning the parameters so as to obtain the optimal model, which proves to be troublesome and inefficient. Motivated by the nonparametric Gaussian Process (GP) model, we propose a novel supervised DR algorithm, namely Gaussian Process Graph-based Discriminate Analysis (GPGDA). Our algorithm takes full advantage of the covariance matrix in GP to constructing the graph similarity matrix in GEDA framework. In this way, more superior performance can be provided with the model parameters tuned automatically. Experiments on three real HSIs datasets demonstrate that the proposed GPGDA outperforms some classic and state-of-the-art DR methods.


Author(s):  
Bahman Abdi-Sargezeh ◽  
Antonio Valentin ◽  
Gonzalo Alarcon ◽  
Saeid Sanei

Interictal epileptiform discharges (IEDs) are elicited from an epileptic brain, whereas they can also be due to other neurological abnormalities. The diversity in their morphologies, their strengths, and their sources within the brain cause a great deal of uncertainty in their labeling by clinicians. The aim of this study is therefore to exploit and incorporate this uncertainty (the probability of the waveform being an IED) in the IED detection system which combines spatial component analysis (SCA) with the IED probabilities referred to as SCA-IEDP-based method. For comparison, we also propose and study SCA-based method in which probability of the waveform being an IED is ignored. The proposed models are employed to detect IEDs in two different classification approaches: (1) subject-dependent and (2) subject-independent classification approaches. The proposed methods are compared with two other state-of-the-art methods namely, time–frequency features and tensor factorization methods. The proposed SCA-IEDP model has achieved superior performance in comparison with the traditional SCA and other competing methods. It achieved 79.9% and 63.4% accuracy values in subject-dependent and subject-independent classification approaches, respectively. This shows that considering the IED probabilities in designing an IED detection system can boost its performance.


2018 ◽  
Author(s):  
Ian Charest ◽  
Nikolaus Kriegeskorte ◽  
Kendrick N. Kay

ABSTRACTGLMdenoise is a denoising technique for task-based fMRI. In GLMdenoise, estimates of spatially correlated noise (which may be physiological, instrumental, motion-related, or neural in origin) are derived from the data and incorporated as nuisance regressors in a general linear model (GLM) analysis. We previously showed that GLMdenoise outperforms a variety of other denoising techniques in terms of cross-validation accuracy of GLM estimates (Kay et al., 2013a). However, the practical impact of denoising for experimental studies remains unclear. Here we examine whether and to what extent GLMdenoise improves sensitivity in the context of multivariate pattern analysis of fMRI data. On a large number of participants (31 participants across 4 experiments; 3 T, gradient-echo, spatial resolution 2–3.75 mm, temporal resolution 1.3–2 s, number of conditions 32–75), we perform representational similarity analysis (Kriegeskorte et al., 2008a) as well as pattern classification (Haxby et al., 2001). We find that GLMdenoise substantially improves replicability of representational dissimilarity matrices (RDMs) across independent splits of each participant’s dataset (average RDM replicability increases from r = 0.46 to r = 0.61). Additionally, we find that GLMdenoise substantially improves pairwise classification accuracy (average classification accuracy increases from 79% correct to 84% correct). We show that GLMdenoise often improves and never degrades performance for individual participants and that GLMdenoise also improves across-participant consistency. We conclude that GLMdenoise is a useful tool that can be routinely used to maximize the amount of information extracted from fMRI activity patterns.


AI Magazine ◽  
2019 ◽  
Vol 40 (3) ◽  
pp. 41-57
Author(s):  
Manisha Mishra ◽  
Pujitha Mannaru ◽  
David Sidoti ◽  
Adam Bienkowski ◽  
Lingyi Zhang ◽  
...  

A synergy between AI and the Internet of Things (IoT) will significantly improve sense-making, situational awareness, proactivity, and collaboration. However, the key challenge is to identify the underlying context within which humans interact with smart machines. Knowledge of the context facilitates proactive allocation among members of a human–smart machine (agent) collective that balances auto­nomy with human interaction, without displacing humans from their supervisory role of ensuring that the system goals are achievable. In this article, we address four research questions as a means of advancing toward proactive autonomy: how to represent the interdependencies among the key elements of a hybrid team; how to rapidly identify and characterize critical contextual elements that require adaptation over time; how to allocate system tasks among machines and agents for superior performance; and how to enhance the performance of machine counterparts to provide intelligent and proactive courses of action while considering the cognitive states of human operators. The answers to these four questions help us to illustrate the integration of AI and IoT applied to the maritime domain, where we define context as an evolving multidimensional feature space for heterogeneous search, routing, and resource allocation in uncertain environments via proactive decision support systems.


Materials ◽  
2021 ◽  
Vol 14 (15) ◽  
pp. 4171
Author(s):  
Rabia Ikram ◽  
Badrul Mohamed Jan ◽  
Akhmal Sidek ◽  
George Kenanakis

An important aspect of hydrocarbon drilling is the usage of drilling fluids, which remove drill cuttings and stabilize the wellbore to provide better filtration. To stabilize these properties, several additives are used in drilling fluids that provide satisfactory rheological and filtration properties. However, commonly used additives are environmentally hazardous; when drilling fluids are disposed after drilling operations, they are discarded with the drill cuttings and additives into water sources and causes unwanted pollution. Therefore, these additives should be substituted with additives that are environmental friendly and provide superior performance. In this regard, biodegradable additives are required for future research. This review investigates the role of various bio-wastes as potential additives to be used in water-based drilling fluids. Furthermore, utilization of these waste-derived nanomaterials is summarized for rheology and lubricity tests. Finally, sufficient rheological and filtration examinations were carried out on water-based drilling fluids to evaluate the effect of wastes as additives on the performance of drilling fluids.


Sign in / Sign up

Export Citation Format

Share Document