Multimodal representations of person identity individuated with fMRI

Visual Modality ◽

Auditory Information ◽

Person Identity ◽

Multimodal Representations ◽

Image Transformations ◽

AbtractRecognizing the identity of a person is fundamental to guide social interactions. We can recognize the identity of a person looking at her face, but also listening to her voice. An important question concerns how visual and auditory information come together, enabling us to recognize identity independently of the modality of the stimulus. This study reports converging evidence across univariate contrasts and multivariate classification showing that the posterior superior temporal sulcus (pSTS), previously known to encode polymodal visual and auditory representations, encodes information about person identity with invariance within and across modality. In particular, pSTS shows selectivity for faces, selectivity for voices, classification of face identity across image transformations within the visual modality, and classification of person identity across modality.

A region in the Posterior Superior Temporal Sulcus (pSTS) appears to be selectively engaged in the perception of social interactions.

Journal of Vision ◽

10.1167/11.11.630 ◽

2011 ◽

Vol 11 (11) ◽

pp. 630-630 ◽

Cited By ~ 1

Author(s):

K. Koldewyn ◽

S. Weigelt ◽

K. Semmelmann ◽

N. Kanwisher

Keyword(s):

Social Interactions ◽

Correction for Isik et al., Perceiving social interactions in the posterior superior temporal sulcus

Proceedings of the National Academy of Sciences ◽

10.1073/pnas.1721071115 ◽

2017 ◽

Vol 115 (1) ◽

pp. E113-E114

Keyword(s):

Social Interactions ◽

Perceiving social interactions in the posterior superior temporal sulcus

Proceedings of the National Academy of Sciences ◽

10.1073/pnas.1714471114 ◽

2017 ◽

Vol 114 (43) ◽

pp. E9145-E9152 ◽

Cited By ~ 60

Author(s):

Leyla Isik ◽

Kami Koldewyn ◽

David Beeler ◽

Nancy Kanwisher

Keyword(s):

Social Interactions ◽

Social World ◽

The Other ◽

Social Characteristics ◽

Visual Features ◽

Neural Correlate ◽

The Social ◽

Physical Interactions ◽

Primates are highly attuned not just to social characteristics of individual agents, but also to social interactions between multiple agents. Here we report a neural correlate of the representation of social interactions in the human brain. Specifically, we observe a strong univariate response in the posterior superior temporal sulcus (pSTS) to stimuli depicting social interactions between two agents, compared with (i) pairs of agents not interacting with each other, (ii) physical interactions between inanimate objects, and (iii) individual animate agents pursuing goals and interacting with inanimate objects. We further show that this region contains information about the nature of the social interaction—specifically, whether one agent is helping or hindering the other. This sensitivity to social interactions is strongest in a specific subregion of the pSTS but extends to a lesser extent into nearby regions previously implicated in theory of mind and dynamic face perception. This sensitivity to the presence and nature of social interactions is not easily explainable in terms of low-level visual features, attention, or the animacy, actions, or goals of individual agents. This region may underlie our ability to understand the structure of our social world and navigate within it.

Multivariate classification of alcoholics by means of the MMPI.

Journal of Abnormal Psychology ◽

10.1037/h0028467 ◽

1969 ◽

Vol 74 (6) ◽

pp. 661-669 ◽

Cited By ~ 89

Author(s):

Steven G. Goldstein ◽

James D. Linden

Keyword(s):

Multivariate Classification

High-pass filtering artifacts in multivariate classification of neural time series data

Journal of Neuroscience Methods ◽

10.1016/j.jneumeth.2021.109080 ◽

2021 ◽

Vol 352 ◽

pp. 109080

Author(s):

Joram van Driel ◽

Christian N.L. Olivers ◽

Johannes J. Fahrenfort

Keyword(s):

Time Series ◽

Time Series Data ◽

Series Data ◽

High Pass

Learning to See Biological Motion: Brain Activity Parallels Behavior

Journal of Cognitive Neuroscience ◽

10.1162/0898929042568569 ◽

2004 ◽

Vol 16 (9) ◽

pp. 1669-1679 ◽

Cited By ~ 85

Author(s):

Emily D. Grossman ◽

Randolph Blake ◽

Chai-Youn Kim

Keyword(s):

Neural Activity ◽

Biological Motion ◽

Brain Activity ◽

Daily Practice ◽

Fusiform Face Area ◽

Face Area ◽

Perceptual Performance ◽

Trained Observers ◽

Individuals improve with practice on a variety of perceptual tasks, presumably reflecting plasticity in underlying neural mechanisms. We trained observers to discriminate biological motion from scrambled (nonbiological) motion and examined whether the resulting improvement in perceptual performance was accompanied by changes in activation within the posterior superior temporal sulcus and the fusiform “face area,” brain areas involved in perception of biological events. With daily practice, initially naive observers became more proficient at discriminating biological from scrambled animations embedded in an array of dynamic “noise” dots, with the extent of improvement varying among observers. Learning generalized to animations never seen before, indicating that observers had not simply memorized specific exemplars. In the same observers, neural activity prior to and following training was measured using functional magnetic resonance imaging. Neural activity within the posterior superior temporal sulcus and the fusiform “face area” reflected the participants' learning: BOLD signals were significantly larger after training in response both to animations experienced during training and to novel animations. The degree of learning was positively correlated with the amplitude changes in BOLD signals.

Multivariate classification of patients with Alzheimer’s and dementia with Lewy bodies using high-dimensional cortical thickness measurements: an MRI surface-based morphometric study

Journal of Neurology ◽

10.1007/s00415-012-6768-z ◽

2012 ◽

Vol 260 (4) ◽

pp. 1104-1115 ◽

Cited By ~ 23

Author(s):

Alexander V. Lebedev ◽

E. Westman ◽

M. K. Beyer ◽

M. G. Kramberger ◽

C. Aguilar ◽

...

Keyword(s):

Cortical Thickness ◽

Dementia With Lewy Bodies ◽

Lewy Bodies ◽

High Dimensional ◽

Morphometric Study ◽

Thickness Measurements

Fast-HPLC Fingerprinting to Discriminate Olive Oil from Other Edible Vegetable Oils by Multivariate Classification Methods

Journal of AOAC International ◽

10.5740/jaoacint.16-0411 ◽

2017 ◽

Vol 100 (2) ◽

pp. 345-350 ◽

Cited By ~ 7

Author(s):

Ana M Jiménez-Carvelo ◽

Antonio González-Casado ◽

Estefanía Pérez-Castaño ◽

Luis Cuadros-Rodríguez

Keyword(s):

Olive Oil ◽

Vegetable Oils ◽

Edible Oils ◽

Support Vector ◽

Classification Methods ◽

Chromatographic Fingerprint ◽

K Nearest Neighbors ◽

Pls Discriminant Analysis

Abstract A new analytical method for the differentiation of olive oil from other vegetable oils using reversed-phaseLC and applying chemometric techniques was developed. A 3 cm short column was used to obtain the chromatographic fingerprint of the methyl-transesterified fraction of each vegetable oil. The chromatographic analysis tookonly 4 min. The multivariate classification methods used were k-nearest neighbors, partial least-squares (PLS) discriminant analysis, one-class PLS, support vector machine classification, and soft independent modeling of class analogies. The discrimination of olive oil from other vegetable edible oils was evaluated by several classification quality metrics. Several strategies for the classification of the olive oil wereused: one input-class, two input-class, and pseudo two input-class.