A multifunctional method (ERP and fMRI) of analysis on facial expression. Three pilot studies
As social primates, one of the most important cognitive tasks we conduct, dozens of times a day, is to look at a face and extract the person's identity. During the last decade, the neural basis of face processing has been extensively investigated in humans with event-related potential (ERP) and functional MRI (fMRI). These two methods provide complementary information about the temporal and spatial aspects of the neural response, with ERPs allowing high temporal resolution of milliseconds but low spatial resolution of the neural generator and fMRI displaying a slow hemodynamic response but better spatial localization of the activated regions. Despite the extensive fMRI and ERP research of faces, only a few studies have assessed the relationship between the two methods and no study to date have collected simultaneous ERP and fMRI responses to face stimuli. In the current paper we will try to assess the spatial and temporal aspects of the neural response to faces by simultaneously collecting functional MRI and event-related potentials (ERP) to face stimuli. Our goals are twofold: 1) ERP and fMRI show a robust selective response to faces. In particular, two well-established face-specific phenomena, the RH superiority and the inversion effect are robustly found with both ERP and fMRI. Despite the extensive research of these effects with ERP and fMRI, it is still unknown to what extent their spatial (fMRI) and temporal (ERP) aspects are associated. In Study 1 we will employ an individual differences approach, to assess the relationship between these ERP and fMRI face-specific responses. 2) Face processing involves several stages starting from structural encoding of the face image through identity processing to storage for later retrieval. This representation undergoes several manipulations that take place at different time points and in different brain regions before the final percept is generated. By simultaneously recording ERP and fMRI we hope to gain a more comprehensive understanding of the timecourse that different brain areas participate in the generation of the face representation.