From eye to arrow: Attention capture by direct gaze requires more than just the eyes

Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2–6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. Statement of significance The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.

Face Masks Do Not Alter Gaze Cueing of Attention: Evidence From the COVID-19 Pandemic

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work, we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a European (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that gaze cueing of attention is preserved even when the person perceived is wearing a face mask.

Cross-cultural asymmetries in oculomotor interference elicited by gaze distractors belonging to Asian and White faces

The averted gaze of others triggers reflexive attentional orienting in the corresponding direction. This phenomenon can be modulated by many social factors. Here, we used an eye-tracking technique to investigate the role of ethnic membership in a cross-cultural oculomotor interference study. Chinese and Italian participants were required to perform a saccade whose direction might be either congruent or incongruent with the averted-gaze of task-irrelevant faces belonging to Asian and White individuals. The results showed that, for Chinese participants, White faces elicited a larger oculomotor interference than Asian faces. By contrast, Italian participants exhibited a similar oculomotor interference effect for both Asian and White faces. Hence, Chinese participants found it more difficult to suppress eye-gaze processing of White rather than Asian faces. The findings provide converging evidence that social attention can be modulated by social factors characterizing both the face stimulus and the participants. The data are discussed with reference to possible cross-cultural differences in perceived social status.

How Neuroimaging Can Aid the Interpretation of Art

Cognitive neuroscience of art continues to be criticized for failing to provide interesting results about art itself. In particular, results of brain imaging experiments have not yet been utilized in interpretation of particular works of art. Here we revisit a recent study in which we explored the neuronal and behavioral response to painted portraits with a direct versus an averted gaze. We then demonstrate how fMRI results can be related to the art historical interpretation of a specific painting. The evidentiary status of neuroimaging data is not different from any other extra-pictorial facts that art historians uncover in their research and relate to their account of the significance of a work of art. They are not explanatory in a strong sense, yet they provide supportive evidence for the art writer’s inference about the intended meaning of a given work. We thus argue that brain imaging can assume an important role in the interpretation of particular art works.

Broken or socially-mistuned mirror neurons in autism? An investigation via transcranial magnetic stimulation

Individuals with an autism spectrum disorder (ASD) experience persistent difficulties during social interactions and communication. Previously, it has been suggested that deficits in the so-called ‘mirror neuron system’ (MNS), active during both action execution and observation, may underlie these social difficulties. It is still a topic of debate however whether deficiencies in the simulation of others’ actions (i.e. “broken” mirroring) forms a general feature of ASD, or whether these mostly reflect a lack of social attunement. The latter would suggest an overall intact MNS, but an impaired modulation of MNS activity according to variable social contexts. In this study, 25 adults with ASD and 28 age- and IQ-matched control participants underwent transcranial magnetic stimulation (TMS) during the observation of hand movements under variable conditions. Hand movements were presented via a live interaction partner, either without social context to assess basic motor mirroring, or in combination with direct and averted gaze from the acting model to assess socially modulated mirroring. Overall, no significant group differences were revealed, indicating no differential in MNS activity in ASD, compared to controls. Interestingly however, regression analyses revealed that, among ASD participants, higher social symptom severity was associated with both reduced basic motor mirroring and aberrant socially modulated mirroring (i.e. no enhancement of MNS activity upon direct vs. averted gaze). These findings further challenge the notion that MNS dysfunctions constitute a principal feature of ASD, but that variations in MNS function are related to differential expressions of (social) symptom severity.

Emotional Gaze: The Effects of Gaze Direction on the Perception of Facial Emotions

Previous research has found that when gaze direction matches the underlying behavioral intent communicated by the expression of a specific emotion, it enhances or facilitates the perception of that emotion; this is called the shared signal hypothesis (SSH). Specifically, a direct gaze shares an approach-orientated signal with the emotions of anger and joy, whereas an averted gaze shares an avoidance-orientated signal with fear and sadness. In this research, we attempted to verify the SSH by using different materials on Asian participants. In Experiment 1 we employed photos of models exhibiting direct and averted gazes for rating tasks, in order to study the effects of gaze direction on participants’ perception of emotion. In Experiment 2 we utilized smiling faces in a similar investigation. The results show that for neutral and smiling faces, a direct gaze (relative to a gaze of avoidance) increased the likelihood of a subject perceiving a happy mood; a gaze of avoidance increased the likelihood that anger and fear would be perceived. The effect of gaze direction on emotional expression perception was verified, but a “facilitating-impairing” pattern was not. The difference between our work and previous research may be attributable to the materials employed (which were more ecological), as well as the participants, who were from a different culture.

Cognitive Impact of Anthropomorphized Robot Gaze

Attentional control does not have fix functioning and can be strongly impacted by the presence of other human beings or humanoid robots. In two studies, this phenomenon was investigated while focusing exclusively on robot gaze as a potential determinant of attentional control along with the role of participants’ anthropomorphic inferences toward the robot. In study 1, we expected and found higher interference in trials including a direct robot gaze compared to an averted gaze on a task measuring attentional control (Eriksen flanker task). Participants’ anthropomorphic inferences about the social robot mediated this interference. In study 2, we found that averted gazes congruent with the correct answer (same task as study 1) facilitated performance. Again, this effect was mediated by anthropomorphic inferences. These two studies show the importance of anthropomorphic robotic gaze on human cognitive processing, especially attentional control, and also open new avenues of research in social robotics.

Social attention during COVID-19 pandemic: Face masks do not alter gaze cueing of attention

Interacting with others wearing a face mask has become a regular worldwide practice since the beginning of the COVID-19 pandemic. However, the impact of face masks on cognitive mechanisms supporting social interaction is still largely unexplored. In the present work we focused on gaze cueing of attention, a phenomenon tapping the essential ability which allows individuals to orient their attentional resources in response to eye gaze signals coming from others. Participants from both a Western (i.e., Italy; Experiment 1) and an Asian (i.e., China; Experiment 2) country were involved, namely two countries in which the daily use of face masks before COVID-19 pandemic was either extremely uncommon or frequently adopted, respectively. Both samples completed a task in which a peripheral target had to be discriminated while a task irrelevant averted gaze face, wearing a mask or not, acted as a central cueing stimulus. Overall, a reliable and comparable gaze cueing emerged in both experiments, independent of the mask condition. These findings suggest that social attention is preserved even when the person perceived is wearing a face mask.

Sclera color in humans facilitates gaze perception during daytime and nighttime

Species vary widely in the conspicuousness of their eye morphology and this could influence gaze perception. Eyes with conspicuous morphology can enhance gaze perception while eyes with camouflaged morphology may hinder gaze perception. While evidence suggests that conspicuous eye morphology enhances gaze perception, little is known about how environmental conditions affect this interaction. Thus, we investigated whether environmental light conditions affect gaze perception. Human subjects (Homo sapiens) were instructed to find direct-gaze faces within arrays of averted-gaze faces or to find averted-gaze faces within arrays of directed-gaze faces. The faces were displayed under conditions simulating nighttime or daytime conditions. Furthermore, the faces had naturally-colored sclera (white) or modified sclera (same color as the iris). Participants were fastest and most accurate in detecting faces during the daytime and nighttime conditions when the sclera were naturally-colored. Participants were worst at detecting faces with modified sclera during the nighttime conditions. These results suggest that eyes with conspicuous morphology enhance gaze perception during both daytime and nighttime conditions.