Using deep autoencoders to learn robust domain-invariant representations for still-to-video face recognition

AbstractIn real-life situations, the appearance of a person’s face can vary substantially across different encounters, making face recognition a challenging task for the visual system. Recent fMRI decoding studies have suggested that face recognition is supported by identity representations located in regions of the occipito-temporal cortex. Here, we used EEG to elucidate the temporal emergence of these representations. Human participants (both sexes) viewed a set of highly variable face images of four highly familiar celebrities (two male, two female), while performing an orthogonal task. Univariate analyses of event-related EEG responses revealed a pronounced differentiation between male and female faces, but not between identities of the same sex. Using multivariate representational similarity analysis, we observed a gradual emergence of face identity representations, with an increasing degree of invariance. Face identity information emerged rapidly, starting shortly after 100ms from stimulus onset. From 400ms after onset and predominantly in the right hemisphere, identity representations showed two invariance properties: (1) they equally discriminated identities of opposite sexes and of the same sex, and (2) they were tolerant to image-based variations. These invariant representations may be a crucial prerequisite for successful face recognition in everyday situations, where the appearance of a familiar person can vary drastically.Significance StatementRecognizing the face of a friend on the street is a task we effortlessly perform in our everyday lives. However, the necessary visual processing underlying familiar face recognition is highly complex. As the appearance of a given person varies drastically between encounters, for example across viewpoints or emotional expressions, the brain needs to extract identity information that is invariant to such changes. Using multivariate analyses of EEG data, we characterize how invariant representations of face identity emerge gradually over time. After 400ms of processing, cortical representations reliably differentiated two similar identities (e.g., two famous male actors), even across a set of highly variable images. These representations may support face recognition under challenging real-life conditions.

Download Full-text

Gender Differences in Familiar Face Recognition and the Influence of Sociocultural Gender Inequality

Scientific Reports ◽

10.1038/s41598-019-54074-5 ◽

2019 ◽

Vol 9 (1) ◽

Author(s):

Maruti V. Mishra ◽

Jirapat Likitlersuang ◽

Jeremy B Wilmer ◽

Sarah Cohan ◽

Laura Germine ◽

...

Keyword(s):

Gender Differences ◽

Face Recognition ◽

Gender Equality ◽

Gender Bias ◽

Web Based ◽

Familiar Face ◽

Female Advantage ◽

The Usa ◽

Invariant Representations ◽

Unfamiliar Faces

AbstractAre gender differences in face recognition influenced by familiarity and socio-cultural factors? Previous studies have reported gender differences in processing unfamiliar faces, consistently finding a female advantage and a female own-gender bias. However, researchers have recently highlighted that unfamiliar faces are processed less efficiently than familiar faces, which have more robust, invariant representations. To-date, no study has examined whether gender differences exist for familiar face recognition. The current study addressed this by using a famous faces task in a large, web-based sample of > 2000 participants across different countries. We also sought to examine if differences varied by socio-cultural gender equality within countries. When examining raw accuracy as well when controlling for fame, the results demonstrated that there were no participant gender differences in overall famous face accuracy, in contrast to studies of unfamiliar faces. There was also a consistent own-gender bias in male but not female participants. In countries with low gender equality, including the USA, females showed significantly better recognition of famous female faces compared to male participants, whereas this difference was abolished in high gender equality countries. Together, this suggests that gender differences in recognizing unfamiliar faces can be attenuated when there is enough face learning and that sociocultural gender equality can drive gender differences in familiar face recognition.

Download Full-text

Face Inversion Effect Emerges Under Critical Configural Discrepancy

Swiss Journal of Psychology ◽

10.1024/1421-0185/a000018 ◽

2010 ◽

Vol 69 (3) ◽

pp. 161-167 ◽

Cited By ~ 3

Author(s):

Jisien Yang ◽

Adrian Schwaninger

Keyword(s):

Face Recognition ◽

Face Processing ◽

Underlying Mechanism ◽

Inversion Effect ◽

Configural Processing ◽

Major Contributor ◽

Face Inversion Effect ◽

Configural Information ◽

Face Inversion ◽

The Face

Configural processing has been considered the major contributor to the face inversion effect (FIE) in face recognition. However, most researchers have only obtained the FIE with one specific ratio of configural alteration. It remains unclear whether the ratio of configural alteration itself can mediate the occurrence of the FIE. We aimed to clarify this issue by manipulating the configural information parametrically using six different ratios, ranging from 4% to 24%. Participants were asked to judge whether a pair of faces were entirely identical or different. The paired faces that were to be compared were presented either simultaneously (Experiment 1) or sequentially (Experiment 2). Both experiments revealed that the FIE was observed only when the ratio of configural alteration was in the intermediate range. These results indicate that even though the FIE has been frequently adopted as an index to examine the underlying mechanism of face processing, the emergence of the FIE is not robust with any configural alteration but dependent on the ratio of configural alteration.

Download Full-text

Perceptual Effects and Recollective Experience in Face Recognition

Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) ◽

10.1027/1618-3169.52.3.224 ◽

2005 ◽

Vol 52 (3) ◽

pp. 224-231 ◽

Cited By ~ 7

Author(s):

Chrisanthi Nega

Keyword(s):

Face Recognition ◽

Recognition Memory ◽

Congruency Effect ◽

Facial Recognition ◽

Memory Systems ◽

Study Time ◽

Perceptual Fluency ◽

Recollective Experience ◽

Trace Strength ◽

Size Congruency

Abstract. Four experiments were conducted investigating the effect of size congruency on facial recognition memory, measured by remember, know and guess responses. Different study times were employed, that is extremely short (300 and 700 ms), short (1,000 ms), and long times (5,000 ms). With the short study time (1,000 ms) size congruency occurred in knowing. With the long study time the effect of size congruency occurred in remembering. These results support the distinctiveness/fluency account of remembering and knowing as well as the memory systems account, since the size congruency effect that occurred in knowing under conditions that facilitated perceptual fluency also occurred independently in remembering under conditions that facilitated elaborative encoding. They do not support the idea that remember and know responses reflect differences in trace strength.

Download Full-text