How to Deal with Incongruence? The Role of Social Perception and Bodily Facial Feedback in Emotion Recognition in Human Agent Interaction – Evidence from Psychology as Potential and Challenge for Multimodal User-Centered Approaches

2021 ◽  
pp. 28-39
Author(s):  
Cornelia Herbert
2010 ◽  
pp. 74-91
Author(s):  
Joseph C. Bullington

Social interaction represents a powerful new locus of research in the quest to build more truly humanlike artificial agents. The work in this area, as in the field of human computer interaction, generally, is becoming more interdisciplinary in nature. In this spirit, the present chapter will survey concepts and theory from social psychology, a field many researchers may be unfamiliar with. Dennett’s notion of the intentional system will provide some initial grounding for the notion of social interaction, along with a brief discussion of conversational agents. The body of the chapter will then survey the areas of animal behavior and social psychology most relevant to human-agent interaction, concentrating on the areas of interpersonal relations and social perception. Within the area of social perception, the focus will be on the topics of emotion and attribution theory. Where relevant, research in the area of agent-human interaction will be discussed. The chapter will conclude with a brief survey of the use of agent-based modeling and simulation in social theory. The future looks very promising for researchers in this area; the complex problems involved in developing artificial agents who have mind-like attributes will require an interdisciplinary effort.


Author(s):  
Joseph C. Bullington

Social interaction represents a powerful new locus of research in the quest to build more truly human-like artificial agents. The work in this area, as in the field of human computer interaction, generally, is becoming more interdisciplinary in nature. In this spirit, the present chapter will survey concepts and theory from social psychology, a field many researchers may be unfamiliar with. Dennett’s notion of the intentional system will provide some initial grounding for the notion of social interaction, along with a brief discussion of conversational agents. The body of the chapter will then survey the areas of animal behavior and social psychology most relevant to human-agent interaction, concentrating on the areas of interpersonal relations and social perception. Within the area of social perception, the focus will be on the topics of emotion and attribution theory. Where relevant, research in the area of agent-human interaction will be discussed. The chapter will conclude with a brief survey of the use of agent-based modeling and simulation in social theory. The future looks very promising for researchers in this area; the complex problems involved in developing artificial agents who have mind-like attributes will require an interdisciplinary effort.


2021 ◽  
Vol 12 ◽  
Author(s):  
David C. Jeong ◽  
Steffie Sofia Yeonjoo Kim ◽  
Jackie Jingyi Xu ◽  
Lynn C. Miller

Avatar research largely focuses on the effects of the appearance and external characteristics of avatars, but may also warrant further consideration of the effects of avatar movement characteristics. With Protean kinematics, we offer an expansion the avatar-user appearances-based effects of the Proteus Effect to a systematic exploration into the role of movement in affecting social perceptions (about others) and idealized perceptions (about self). This work presents both a theoretical (typology) and methodological (physics-based measurement) approach to understanding the complex blend of physical inputs and virtual outputs that occur in the perceptual experience of VR, particularly in consideration of the collection of hippocampal (e.g., place cells, grid cells) and entorhinal neurons (e.g., speed cells) that fire topologically relative to physical movement in physical space. Offered is a novel method that distills the blend of physical and virtual kinematics to contribute to modern understandings of human-agent interaction and cognitive psychology.


Author(s):  
Felix Jimenez ◽  
Tomohiro Yoshikawa ◽  
Takeshi Furuhashi ◽  
Masayoshi Kanoh

Abstract With the growth of robot technology, robots that assist learning have attracted increasing attention. However, users tend to lose interest in educational-support robots. To solve this problem, we propose a model of emotional expression based on human-agent interaction studies. This model in which the agent autonomously expresses the user’s emotions establishes effective interactions between agents and humans. This paper examines the psychological effect of a robot that is operated by the model of emotional expressions and the role of this effect in prompting collaborative learning.


2021 ◽  
Vol 54 (4) ◽  
pp. 1-43
Author(s):  
Katie Seaborn ◽  
Norihisa P. Miyake ◽  
Peter Pennefather ◽  
Mihoko Otake-Matsuura

Social robots, conversational agents, voice assistants, and other embodied AI are increasingly a feature of everyday life. What connects these various types of intelligent agents is their ability to interact with people through voice. Voice is becoming an essential modality of embodiment, communication, and interaction between computer-based agents and end-users. This survey presents a meta-synthesis on agent voice in the design and experience of agents from a human-centered perspective: voice-based human--agent interaction (vHAI). Findings emphasize the social role of voice in HAI as well as circumscribe a relationship between agent voice and body, corresponding to human models of social psychology and cognition. Additionally, changes in perceptions of and reactions to agent voice over time reveals a generational shift coinciding with the commercial proliferation of mobile voice assistants. The main contributions of this work are a vHAI classification framework for voice across various agent forms, contexts, and user groups, a critical analysis grounded in key theories, and an identification of future directions for the oncoming wave of vocal machines.


Sign in / Sign up

Export Citation Format

Share Document