scholarly journals Perceived Image Decoding From Brain Activity Using Shared Information of Multi-Subject fMRI Data

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 26593-26606
Author(s):  
Yusuke Akamatsu ◽  
Ryosuke Harakawa ◽  
Takahiro Ogawa ◽  
Miki Haseyama
2021 ◽  
Author(s):  
Takashi Nakano ◽  
Masahiro Takamura ◽  
Haruki Nishimura ◽  
Maro Machizawa ◽  
Naho Ichikawa ◽  
...  

AbstractNeurofeedback (NF) aptitude, which refers to an individual’s ability to change its brain activity through NF training, has been reported to vary significantly from person to person. The prediction of individual NF aptitudes is critical in clinical NF applications. In the present study, we extracted the resting-state functional brain connectivity (FC) markers of NF aptitude independent of NF-targeting brain regions. We combined the data in fMRI-NF studies targeting four different brain regions at two independent sites (obtained from 59 healthy adults and six patients with major depressive disorder) to collect the resting-state fMRI data associated with aptitude scores in subsequent fMRI-NF training. We then trained the regression models to predict the individual NF aptitude scores from the resting-state fMRI data using a discovery dataset from one site and identified six resting-state FCs that predicted NF aptitude. Next we validated the prediction model using independent test data from another site. The result showed that the posterior cingulate cortex was the functional hub among the brain regions and formed predictive resting-state FCs, suggesting NF aptitude may be involved in the attentional mode-orientation modulation system’s characteristics in task-free resting-state brain activity.


Author(s):  
Samuel A Nastase ◽  
Valeria Gazzola ◽  
Uri Hasson ◽  
Christian Keysers

Abstract Our capacity to jointly represent information about the world underpins our social experience. By leveraging one individual’s brain activity to model another’s, we can measure shared information across brains—even in dynamic, naturalistic scenarios where an explicit response model may be unobtainable. Introducing experimental manipulations allows us to measure, for example, shared responses between speakers and listeners or between perception and recall. In this tutorial, we develop the logic of intersubject correlation (ISC) analysis and discuss the family of neuroscientific questions that stem from this approach. We also extend this logic to spatially distributed response patterns and functional network estimation. We provide a thorough and accessible treatment of methodological considerations specific to ISC analysis and outline best practices.


2013 ◽  
Vol 347-350 ◽  
pp. 2516-2520
Author(s):  
Jian Hua Jiang ◽  
Xu Yu ◽  
Zhi Xing Huang

Over the last decade, functional magnetic resonance imaging (fMRI) has become a primary tool to predict the brain activity.During the past research, researchers transfer the focus from the picture to the word.The results of these researches are relatively successful. In this paper, several typical methods which are machine learning methods are introduced. And most of the methods are by using fMRI data associated with words features. The semantic features (properties or factors) support words neural representation, and have a certain commonality in the people.The purpose of the application of these methods is used for prediction or classification.


2009 ◽  
Vol 28 (3) ◽  
pp. 903-910 ◽  
Author(s):  
Firdaus Janoos ◽  
Boonthanome Nouanesengsy ◽  
Raghu Machiraju ◽  
Han Wei Shen ◽  
Steffen Sammet ◽  
...  

2021 ◽  
Author(s):  
Amrit Kashyap ◽  
Sergey Plis ◽  
Michael Schirner ◽  
Petra Ritter ◽  
Shella Keilholz

Brain Network Models (BNMs) are a family of dynamical systems that simulate whole brain activity using neural mass models to represent local activity in different brain regions that influence each other via a global structural network. Research has been interested in using these network models to explain measured whole brain activity measured via resting state functional magnetic resonance imaging (rs-fMRI). Properties computed over longer periods of simulated and measured data such as average functional connectivity (FC), have shown to be comparable with similar properties estimated from measured rs-fMRI data. While this shows that these network models have similar properties over the dynamical landscape, it is unclear how well simulated trajectories compare with empirical trajectories on a timepoint-by-timepoint basis. Previous studies have shown that BNMs are able to produce relevant features at shorter timescales, but analysis of short-term trajectories or transient dynamics as defined by synchronized predictions from BNM made at the same timescale as the collected data has not yet been conducted. Relevant neural processes exist in the time frame of measurements and are often used in task fMRI studies to understand neural responses to behavioral cues. Therefore, it is important to investigate how much of these dynamics are captured by our current brain simulations. To test the nature of BNMs short term trajectories against observed data, we utilize a deep learning technique known as Neural ODE that based on an observed sequence of fMRI measurements, estimates the initial conditions such that the BNMs simulation is synchronized to produce the closest trajectory relative to the observed data. We test to see if the parameterization of a specific well studied BNM, the Firing Rate Model, calculated by maximizing its accuracy in reproducing observed short term trajectories matches with the parameterized model that produces the best average long-term metrics. Our results show that such an agreement between parameterization using long and short simulation analysis exists if also considering other factors such as the sensitivity in accuracy with relative to changes in structural connectivity. Therefore, we conclude that there is evidence that by solving for initial conditions, BNMs can be simulated in a meaningful way when comparing against measured data trajectories, although future studies are necessary to establish how BNM activity relate to behavioral variables or to faster neural processes during this time period.


2019 ◽  
Author(s):  
Samuel A. Nastase ◽  
Valeria Gazzola ◽  
Uri Hasson ◽  
Christian Keysers

AbstractOur capacity to jointly represent information about the world underpins our social experience. By leveraging one individual’s brain activity to model another’s, we can measure shared information across brains—even in dynamic, naturalistic scenarios where an explicit response model may be unobtainable. Introducing experimental manipulations allows us to measure, for example, shared responses between speakers and listeners, or between perception and recall. In this tutorial, we develop the logic of intersubject correlation (ISC) analysis and discuss the family of neuroscientific questions that stem from this approach. We also extend this logic to spatially distributed response patterns and functional network estimation. We provide a thorough and accessible treatment of methodological considerations specific to ISC analysis, and outline best practices.


2019 ◽  
Author(s):  
Ru-Yuan Zhang ◽  
Xue-Xin Wei ◽  
Kendrick Kay

ABSTRACTPrevious studies have shown that neurons exhibit trial-by-trial correlated activity and that such noise correlations (NCs) greatly impact the accuracy of population codes. Meanwhile, multivariate pattern analysis (MVPA) has become a mainstream approach in functional magnetic resonance imaging (fMRI), but it remains unclear how NCs between voxels influence MVPA performance. Here, we tackle this issue by combining voxel-encoding modeling and MVPA. We focus on a well-established form of NC, tuning-compatible noise correlation (TCNC), whose sign and magnitude are systematically related to the tuning similarity between two units. We first replicate the classical finding that TCNCs impair population codes in a standard neuronal population. We then extend our analysis to fMRI data, and show that voxelwise TCNCs do not impair and can even improve MVPA performance when TCNCs are strong or the number of voxels is large. We also confirm these results using standard information-theoretic analyses in computational neuroscience. Further computational analyses demonstrate that the discrepancy between the effect of TCNCs in neuronal and voxel populations can be explained by tuning heterogeneity and pool sizes. Our results provide a theoretical foundation to understand the effect of correlated activity on population codes in macroscopic fMRI data. Our results also suggest that future fMRI research could benefit from a closer examination of the correlational structure of multivariate responses, which is not directly revealed by conventional MVPA approaches.


2021 ◽  
Author(s):  
Yingying Wang ◽  
Scott K. Holland

Magnetoencephalography (MEG) records brain activity with excellent temporal and good spatial resolution, while functional magnetic resonance imaging (fMRI) offers good temporal and excellent spatial resolution. The aim of this study is to implement a Bayesian framework to use fMRI data as spatial priors for MEG inverse solutions. We used simulated MEG data with both evoked and induced activity and experimental MEG data from sixteen participants to examine the effectiveness of using fMRI spatial priors in MEG source reconstruction. Our results provide empirical evidence that the use of fMRI spatial priors improves the accuracy of MEG source reconstruction.


1998 ◽  
Vol 5 (6) ◽  
pp. 420-428 ◽  
Author(s):  
Paul J. Reber ◽  
Craig E.L. Stark ◽  
Larry R. Squire

We collected functional neuroimaging data while volunteers performed similar categorization and recognition memory tasks. In the categorization task, volunteers first studied a series of 40 dot patterns that were distortions of a nonstudied prototype dot pattern. After a delay, while fMRI data were collected, they categorized 72 novel dot patterns according to whether or not they belonged to the previously studied category. In the recognition task, volunteers first studied five dot patterns eight times each. After a delay, while fMRI data were collected, they judged whether each of 72 dot patterns had been studied earlier. We found strikingly different patterns of brain activity in visual processing areas for the two tasks. During the categorization task, the familiar stimuli were associated with decreased activity in posterior occipital cortex, whereas during the recognition task, the familiar stimuli were associated with increased activity in this area. The findings indicate that these two types of memory have contrasting effects on early visual processing and reinforce the view that declarative and nondeclarative memory operate independently.


Sign in / Sign up

Export Citation Format

Share Document