EXPRESS: Identifying with the Beautiful: Facial attractiveness effects on unisensory and multisensory self-other distinction

People tend to evaluate their own traits and abilities favourably and such favourable self-perceptions extend to attractiveness. However, the exact mechanism underlying this self-enhancement bias remains unclear. One possibility could be the identification with attractive others through blurring of self-other boundaries. Across two experiments, we used the enfacement illusion to investigate the effect of others’ attractiveness in the multisensory perception of the self. In Experiment 1 (N=35), participants received synchronous or asynchronous interpersonal visuo-tactile stimulation with an attractive and non-attractive face. In Experiment 2 (N=35), two new faces were used and spatial incοngruency was introduced as a control condition. The results showed that increased ratings of attractiveness of an unfamiliar face lead to blurring of self-other boundaries, allowing the identification of our psychological self with another's physical self and, specifically, their face, and this seems to be unrelated to perceived own attractiveness. The effect of facial attractiveness on face ownership showed dissociable mechanisms, with multisensory integration modulating the effect on similarity but not identification, an effect that may be purely based on vision. Overall, our findings suggest that others’ attractiveness may lead to positive distortions of the self. This research provides a psychophysical starting point for studying the impact of others' attractiveness on self-face recognition, which can be particularly important for individuals with malleable, embodied self-other boundaries and body image disturbances.

Unimodal and cross-modal identity judgements using an audio-visual sorting task: Evidence for independent processing of faces and voices

Unimodal and cross-modal information provided by faces and voices contribute to identity percepts. To examine how these sources of information interact, we devised a novel audio-visual sorting task in which participants were required to group video-only and audio-only clips into two identities. In a series of three experiments, we show that unimodal face and voice sorting were more accurate than cross-modal sorting: While face sorting was consistently most accurate followed by voice sorting, cross-modal sorting was at chancel level or below. In Experiment 1, we compared performance in our novel audio-visual sorting task to a traditional identity matching task, showing that unimodal and cross-modal identity perception were overall moderately more accurate than the traditional identity matching task. In Experiment 2, separating unimodal from cross-modal sorting led to small improvements in accuracy for unimodal sorting, but no change in cross-modal sorting performance. In Experiment 3, we explored the effect of minimal audio-visual training: Participants were shown a clip of the two identities in conversation prior to completing the sorting task. This led to small, nonsignificant improvements in accuracy for unimodal and cross-modal sorting. Our results indicate that unfamiliar face and voice perception operate relatively independently with no evidence of mutual benefit, suggesting that extracting reliable cross-modal identity information is challenging.

Early Capture of Attention by Self-Face: Investigation Using a Temporal Order Judgment Task

Earlier work on self-face processing has reported a bias in the processing of self-face result in faster response to self-face in comparison to other familiar and unfamiliar faces (termed as self-face advantage or SFA). Even though most studies agree that the SFA occurs due to an attentional bias, there is little agreement regarding the stage at which it occurs. While a large number of studies show self-face influencing processing later at disengagement stage, early event-related potential components show differential activity for the self-face suggesting that SFA occurs early. We address this contradiction using a cueless temporal order judgment task that allows us to investigate early perceptual processing, while bias due to top-down expectation is controlled. A greater shift in point of subjective simultaneity for self-face would indicate a greater processing advantage at early perceptual stage. With help of two experiments, we show an early perceptual advantage for self-face, compared to both a friend’s face and an unfamiliar face (Experiment 1). This advantage is present even when the effect of criterion shift is minimized (Experiment 2). Interestingly, the magnitude of advantage is similar for self-friend and self-unfamiliar pair. The evidence from the two experiments suggests early capture of attention as a likely reason for the SFA, which is present for the self-face but not for other familiar faces.

Exploring perceptual similarity and its relation to image-based spaces: an effect of familiarity

One challenge in exploring the internal representation of faces is the lack of controlled stimuli transformations. Researchers are often limited to verbalizable transformations in the creation of a dataset. An alternative approach to verbalization for interpretability is finding image-based measures that allow us to quantify image transformations. In this study, we explore whether PCA could be used to create controlled transformations to a face by testing the effect of these transformations on human perceptual similarity and on computational differences in Gabor, Pixel and DNN spaces. We found that perceptual similarity and the three image-based spaces are linearly related, almost perfectly in the case of the DNN, with a correlation of 0.94. This provides a controlled way to alter the appearance of a face. In experiment 2, the effect of familiarity on the perception of multidimensional transformations was explored. Our findings show that there is a positive relationship between the number of components transformed and both the perceptual similarity and the same three image-based spaces used in experiment 1. Furthermore, we found that familiar faces are rated more similar overall than unfamiliar faces. That is, a change to a familiar face is perceived as making less difference than the exact same change to an unfamiliar face. The ability to quantify, and thus control, these transformations is a powerful tool in exploring the factors that mediate a change in perceived identity.

Two Factors in Face Recognition: Whether You Know the Person’s Face and Whether You Share the Person’s Race

One of the best-known phenomena in face recognition is the other-race effect, the observation that own-race faces are better remembered than other-race faces. However, previous studies have not put the magnitude of other-race effect in the context of other influences on face recognition. Here, we compared the effects of (a) a race manipulation (own-race/other-race face) and (b) a familiarity manipulation (familiar/unfamiliar face) in a 2 × 2 factorial design. We found that the familiarity effect was several times larger than the race effect in all performance measures. However, participants expected race to have a larger effect on others than it actually did. Face recognition accuracy depends much more on whether you know the person’s face than whether you share the same race.

GFMT2: A psychometric measure of face matching ability

We present an expanded version of a widely used measure of unfamiliar face matching ability, the Glasgow Face Matching Test (GFMT). The GFMT2 is created using the same source database as the original test but makes five key improvements. First, the test items include variation in head angle, pose, expression and subject-to-camera distance, making the new test more difficult and more representative of challenges in everyday face identification tasks. Second, short and long versions of the test each contain two forms that are calibrated to be of equal difficulty, allowing repeat tests to be performed to examine effects of training interventions. Third, the short form tests contain no repeating face identities, thereby removing any confounding effects of familiarity that may have been present in the original test. Fourth, separate short versions are created to target exceptionally high performing or exceptionally low performing individuals using established psychometric principles. Fifth, all tests are implemented in an executable program, allowing them to be administered automatically. All tests are available free for scientific use via www.gfmt2.org.

EXPRESS: Top-down influences on working memory representations of faces: Evidence from dual-target visual search

Variability in appearance across different images of the same unfamiliar face often causes participants to perceive different faces. Because perceptual information is not sufficient to link these encounters, top-down guidance may be critical in the initial stages of face learning. Here we examine the interaction between top-down guidance and perceptual information when forming memory representations of unfamiliar faces. In two experiments, we manipulated the names associated with images of a target face that participants had to find in a search array. In Experiment 1, wrongly labelling two images of the same face with different names resulted in more errors relative to when the faces were labelled correctly. In Experiment 2, we compared this cost of mislabelling to the established ‘dual-target search cost’ where searching for two targets produces more search errors relative to one target. We found search costs when searching for two different faces, but not when searching for mislabelled images of the same face. Together, these results suggest that perceptual and semantic information interact when we in the form face memory representations Mislabelling the identity of perceptually similar faces does not cause dual representations to be created, but rather that it impedes the process of forming a single robust representation.