EXPRESS: Age-related changes in gaze behavior during social interaction: an eye-tracking study with an embodied conversational agent

2020 ◽  
pp. 174702182098216
Author(s):  
Katarina Pavic ◽  
Ali Oker ◽  
Mohamed Chetouani ◽  
Laurence Chaby
Keyword(s):  
Older Adults ◽  
Social Interaction ◽  
Eye Tracking ◽  
Virtual Agents ◽  
Conversational Agent ◽  
Gaze Behavior ◽  
Embodied Conversational Agent ◽  
Face To Face ◽  
Age Related ◽  
Gaze Behaviour

Previous research has highlighted age-related differences in social perception, in particular emotional expression processing. To date, such studies have largely focused on approaches that use static emotional stimuli that the participant has to identify passively without the possibility of any interaction. In this study, we propose an interactive virtual environment to better address age-related variations in social and emotional perception. A group of 22 young (18-30 years) and 20 older (60-80 years) adults were engaged in a face-to-face conversation with an embodied conversational agent. Participants were invited to interact naturally with the agent and to identify his facial expression. Their gaze behaviour was captured by an eye-tracking device throughout the interaction. We also explored whether the Big Five personality traits (particularly extraversion) and anxiety modulated gaze during the social interaction. Findings suggested that age-related differences in gaze behaviour was were only apparent when decoding social signals (i.e., listening to a partner's question, identifying facial expressions) and not when communicating social information (i.e. when speaking). Furthermore, higher extraversion levels consistently lead to a shorter amount of time gazing toward the eyes, whereas higher anxiety levels lead to slight modulations of gaze only when participants are were listening to questions. Face-to-face conversation with virtual agents can provide a more naturalistic framework for the assessment of online socio-emotional interaction in older adults, which is not easily observable in classical offline paradigms. This study provides novel and important insights into the specific circumstances in which older adults may experience difficulties in social interactions.

scholarly journals ADOS-Eye-Tracking: The Archimedean Point of View and Its Absence in Autism Spectrum Conditions

2021 ◽  
Vol 12 ◽  
Author(s):  
Ulrich Max Schaller ◽  
Monica Biscaldi ◽  
Anna Burkhardt ◽  
Christian Fleischhaker ◽  
Michael Herbert ◽  
...  
Keyword(s):  
Social Interaction ◽  
Eye Tracking ◽  
Children And Adolescents ◽  
Face Perception ◽  
Autism Spectrum ◽  
Autism Spectrum Conditions ◽  
Gaze Behavior ◽  
Face Region ◽  
Mobile Eye Tracking ◽  
Standardized Diagnostic

Face perception and emotion categorization are widely investigated under laboratory conditions that are devoid of real social interaction. Using mobile eye-tracking glasses in a standardized diagnostic setting while applying the Autism Diagnostic Observation Schedule (ADOS-2), we had the opportunity to record gaze behavior of children and adolescents with and without Autism Spectrum Conditions (ASCs) during social interaction. The objective was to investigate differences in eye-gaze behavior between three groups of children and adolescents either (1) with ASC or (2) with unconfirmed diagnosis of ASC or (3) with neurotypical development (NTD) during social interaction with an adult interviewer in a diagnostic standard situation using the ADOS-2. In a case control study, we used mobile eye-tracking glasses in an ecologically valid and highly standardized diagnostic interview to investigate suspected cases of ASC. After completion of the ASC diagnostic gold standard including the ADOS-2, the participants were assigned to two groups based on their diagnosis (ASC vs. non-ASC) and compared with a matched group of neurotypically developed controls. The primary outcome measure is the percentage of total dwell times assessed for different areas of interest (AOI) with regard to the face and body of a diagnostic interviewer and the surrounding space. Overall, 65 children and adolescents within an age range of 8.3–17.9 years were included in the study. The data revealed significant group differences, especially in the central-face area. Previous investigations under laboratory conditions gave preferential attention to the eye region during face perception to describe differences between ASC and NTD. In this study – using an ecologically valid setting within a standard diagnostic procedure – the results indicate that neurotypically developed controls seem to process faces and facial expressions in a holistic manner originating from the central-face region. Conversely, participants on the Autism Spectrum (tAS) seem to avoid the central-face region and show unsystematic gaze behavior, not using the preferred landing position in the central-face region as the Archimedean point of face perception. This study uses a new approach, and it will be important to replicate these preliminary findings in future research.

scholarly journals Use of machine learning to identify autism with natural social gaze behavior (Preprint)

2021 ◽  
Author(s):  
Zhong Zhao ◽  
Haiming Tang ◽  
Xiaobin Zhang ◽  
Xingda Qu ◽  
Jianping Lu
Keyword(s):  
Machine Learning ◽  
Eye Tracking ◽  
Classification Accuracy ◽  
Autism Spectrum ◽  
Support Vector ◽  
Gaze Behavior ◽  
Linear Discriminant ◽  
Face To Face ◽  
Area Of Interest ◽  
Social Gaze

BACKGROUND Abnormal gaze behavior is a prominent feature of the autism spectrum disorder (ASD). Previous eye tracking studies had participants watch images (i.e., picture, video and webpage), and the application of machine learning (ML) on these data showed promising results in identify ASD individuals. Given the fact that gaze behavior differs in face-to-face interaction from image viewing tasks, no study has investigated whether natural social gaze behavior could accurately identify ASD. OBJECTIVE The objective of this study was to examine whether and what area of interest (AOI)-based features extracted from the natural social gaze behavior could identify ASD. METHODS Both children with ASD and typical development (TD) were eye-tracked when they were engaged in a face-to-face conversation with an interviewer. Four ML classifiers (support vector machine, SVM; linear discriminant analysis, LDA; decision tree, DT; and random forest, RF) were used to determine the maximum classification accuracy and the corresponding features. RESULTS A maximum classification accuracy of 84.62% were achieved with three classifiers (LDA, DT and RF). Results showed that the mouth, but not the eyes AOI, was a powerful feature in detecting ASD. CONCLUSIONS Natural gaze behavior could be leveraged to identify ASD, suggesting that ASD might be objectively screened with eye tracking technology in everyday social interaction. In addition, the comparison between our and previous findings suggests that eye tracking features that could identify ASD might be culture dependent and context sensitive.

scholarly journals User Requirements Analysis of an Embodied Conversational Agent for Coaching Older Adults to Choose Active and Healthy Ageing Behaviors during the Transition to Retirement: A Cross-National User Centered Design Study

2021 ◽  
Vol 18 (18) ◽  
pp. 9681
Author(s):  
Sara Santini ◽  
Vera Stara ◽  
Flavia Galassi ◽  
Alessandra Merizzi ◽  
Cornelia Schneider ◽  
...  
Keyword(s):  
Older Adults ◽  
Older Workers ◽  
Well Being ◽  
End Users ◽  
Healthy Ageing ◽  
User Requirements ◽  
Conversational Agent ◽  
Embodied Conversational Agent ◽  
Active And Healthy Ageing ◽  
Transition To Retirement

Background: Retirement is recognized as a factor influencing the ageing process. Today, virtual health coaching systems can play a pivotal role in supporting older adults’ active and healthy ageing. This study wants to answer two research questions: (1) What are the user requirements of a virtual coach (VC) based on an Embodied Conversational Agent (ECA) for motivating older adults in transition to retirement to adopt a healthy lifestyle? (2) How could a VC address the active and healthy ageing dimensions, even during COVID-19 times? Methods: Two-wave focus-groups with 60 end-users aged 55 and over and 27 follow-up telephone interviews were carried out in Austria, Italy and the Netherlands in 2019–2020. Qualitative data were analysed by way of framework analysis. Results: End-users suggest the VC should motivate older workers and retirees to practice physical activity, maintain social contacts and emotional well-being. The ECA should be reactive, customizable, expressive, sympathetic, not directive nor patronizing, with a pleasant and motivating language. The COVID-19 outbreak increased the users’ need for functions boosting community relationships and promoting emotional well-being. Conclusions: the VC can address the active and healthy ageing paradigm by increasing the chances of doing low-cost healthy activities at any time and in any place.

scholarly journals Age-Related Differences in Fixation Pattern on a Companion Robot

Sensors ◽  
2020 ◽  
Vol 20 (13) ◽  
pp. 3807
Author(s):  
Young Hoon Oh ◽  
Da Young Ju
Keyword(s):  
Older Adults ◽  
Physical Attractiveness ◽  
The Body ◽  
Robot Design ◽  
Body Parts ◽  
Gaze Behavior ◽  
Younger Adults ◽  
The Gaze ◽  
Age Related ◽  
Companion Robots

Recent studies have addressed the various benefits of companion robots and expanded the research scope to their design. However, the viewpoints of older adults have not been deeply investigated. Therefore, this study aimed to examine the distinctive viewpoints of older adults by comparing them with those of younger adults. Thirty-one older and thirty-one younger adults participated in an eye-tracking experiment to investigate their impressions of a bear-like robot mockup. They also completed interviews and surveys to help us understand their viewpoints on the robot design. The gaze behaviors and the impressions of the two groups were significantly different. Older adults focused significantly more on the robot’s face and paid little attention to the rest of the body. In contrast, the younger adults gazed at more body parts and viewed the robot in more detail than the older adults. Furthermore, the older adults rated physical attractiveness and social likeability of the robot significantly higher than the younger adults. The specific gaze behavior of the younger adults was linked to considerable negative feedback on the robot design. Based on these empirical findings, we recommend that impressions of older adults be considered when designing companion robots.

Older Adults, Social Technologies, and the Coronavirus Pandemic: Challenges, Strengths, and Strategies for Support

2020 ◽  
Vol 6 (3) ◽  
pp. 205630512094816
Author(s):  
Ryan C. Moore ◽  
Jeffrey T. Hancock
Keyword(s):  
Older Adults ◽  
Social Interaction ◽  
Digital Media ◽  
Social Connection ◽  
Older Individuals ◽  
Social Distancing ◽  
Face To Face ◽  
Key Stakeholders ◽  
Social Technologies ◽  
Additional Challenge

COVID-19 is a threat to everyone’s health but can be especially devastating to older individuals. To prevent spread of the virus, social distancing has become the norm worldwide. However, with social distancing comes significantly less face-to-face interaction, which may be particularly harmful to older adults given their existing levels of loneliness. While social technologies can be used to provide critical social interaction during this time of necessary physical distancing, older adults tend to either lack access to these technologies or the skills and experience necessary to use them effectively. Once online, older adults face the additional challenge of being outsized targets of misinformation and scams, both of which abound in the context of COVID-19. In this essay, we discuss the challenges faced by older adults in their use of digital media for social connection in the present pandemic, as well as highlight some of the population’s untapped strengths which can be leveraged to help them live prosperous online lives. Finally, we provide recommendations for actions which key stakeholders can take to support older adults in this pursuit.

scholarly journals Robot Gaze Behavior Affects Honesty in Human-Robot Interaction

2021 ◽  
Author(s):  
Elef Schellen ◽  
Francesco Bossi ◽  
Agnieszka Wykowska
Keyword(s):  
Social Interaction ◽  
Eye Contact ◽  
Humanoid Robots ◽  
Human Robot Interaction ◽  
Gaze Behavior ◽  
Robot Interaction ◽  
Facial Cues ◽  
Social Agents ◽  
Face To Face ◽  
Deceptive Behavior

As the use of humanoid robots proliferates, an increasing amount of people may find themselves face-to-“face” with a robot in everyday life. Although there is a plethora of information available on facial social cues and how we interpret them in the field of human-human social interaction, we cannot assume that these findings flawlessly transfer to human-robot interaction. Therefore, more research on facial cues in human-robot interaction is required. This study investigated deception in human-robot interaction context, focusing on the effect that eye contact with a robot has on honesty towards this robot. In an iterative task, participants could assist a humanoid robot by providing it with correct information, or potentially secure a reward for themselves by providing it with incorrect information. Results show that participants are increasingly honest after the robot establishes eye contact with them, but only if this is in response to deceptive behavior. Behavior is not influenced by the establishment of eye contact if the participant is actively engaging in honest behavior. These findings support the notion that humanoid robots can be perceived as, and treated like, social agents, since the herein described effect mirrors one present in human-human social interaction.

scholarly journals I-CONECT: CHALLENGES AND OPPORTUNITIES

2019 ◽  
Vol 3 (Supplement_1) ◽  
pp. S224-S224
Author(s):  
Hiroko H Dodge ◽  
Jeffrey Kaye ◽  
Elena Goodrich ◽  
Jacob Lindsley ◽  
Mattie MacDonald ◽  
...  
Keyword(s):  
Older Adults ◽  
Social Interaction ◽  
Cognitive Stimulation ◽  
Control Group ◽  
Cognitive Domains ◽  
Face To Face ◽  
Challenges And Opportunities ◽  
Socially Isolated ◽  
Intervention Trials ◽  
User Friendly

Abstract In our previous NIH-funded randomized controlled behavioral clinical trial, we developed a conversation-based social interaction cognitive stimulation protocol delivered by trained interviewers through webcams and a user-friendly interactive Internet interface. Daily 30 minute face-to-face video-chats were conducted for 6 weeks. Despite a short duration, this proof of concept study demonstrated high adherence among older adults (mean age 80 years) and showed improvement in cognitive domains which tap language-based executive functions and semantic memory among the experimental group compared to the control group who did not engage in any video-chats. Building on these results, we are now conducting two NIH-funded projects (https://www.i-conect.org), targeting socially isolated older adults who are less likely to participate in clinical trials despite their high risk of cognitive decline. In this presentation, we introduce a series of projects outlined above and share the challenges and opportunities identified in our behavioral intervention trials focused on social interaction.

User requirements analysis of an Embodied Conversational Agent for coaching older adults to choose active and healthy ageing behaviors during the transition to retirement: a cross-national User Centered Design study (Preprint)

2021 ◽  
Author(s):  
Sara Santini ◽  
Vera Stara ◽  
Flavia Galassi ◽  
Alessandra Merizzi ◽  
Cornelia Schneider ◽  
...  
Keyword(s):  
Older Adults ◽  
Older Workers ◽  
Well Being ◽  
End Users ◽  
Healthy Ageing ◽  
Conversational Agent ◽  
User Centered Design ◽  
Embodied Conversational Agent ◽  
Virtual Coaching ◽  
Active And Healthy Ageing

BACKGROUND The ageing worldwide population involves an increase of multiple chronic diseases and the consequent demand for healthcare services by older people, thus challenging the healthcare systems’ sustainability and older people’s quality of life. In order to postpone older adults’ need for care, the promotion of healthy ageing is a key action that can be favored today by embodied conversational agents. Nevertheless, the role and benefit of this technology is still relatively ignored by the literature, especially when being applied to older workers and new retirees, and from a preventive perspective. OBJECTIVE This study wants to answer two research questions: 1) What are the user requirements of a virtual coaching based on an Embodied Conversational Agent for motivating older adults in transition to retirement to adopt a healthy lifestyle? 2) How could a virtual coaching system address the active and healthy ageing dimensions, especially during COVID-19 times? METHODS To answer the questions above, according to the User Centered Design approach, two-wave cross-national focus-groups with 60 end-users aged 55 and over and follow-up telephone interviews to 27 end-users were carried out in Austria, Italy and the Netherland between Spring 2019 and January 2021. Qualitative data were analysed through the Framework Analysis in order to highlight cross-country commonalities and national peculiarities. RESULTS End-users suggest the virtual coach motivates older workers and retirees to practice physical activity, maintain social contacts and provide them with practical activities to improve their mental and emotional well-being. It can be used every day based on users’ time, mood, family relationships and social condition. The embodied conversational agent should be reactive, customizable, expected to be expressive, sympathetic, not directive nor patronizing and its language should be appropriate, pleasant and motivating. The COVID-19 outbreak accelerated the acceptance of the system by increasing the users’ need for functions that boost community, physical and emotional well-being activities. CONCLUSIONS The study shows that the virtual coaching system can be one of the solutions that can best address the active and healthy ageing dimensions by suggesting activities that can improve individuals’ physical activity, mental well-being and socialisation. especially in the current worldwide epidemiological situation. Nevertheless, to be fully effective, it has to have a pleasant appearance and voice to motivate users without being patronising nor directive. Moreover, it should be customisable, yet non stigmatising, and should be able to adapt to the ageing process and to the evolution of the retirement transition.

Sign in / Sign up

Export Citation Format

Share Document