scholarly journals Say What You Are Looking At: An Attention-Based Interactive System for Autistic Children

2021 ◽  
Vol 11 (16) ◽  
pp. 7426
Author(s):  
Furong Deng ◽  
Yu Zhou ◽  
Sifan Song ◽  
Zijian Jiang ◽  
Lifu Chen ◽  
...  
Keyword(s):  
Human Robot Interaction ◽  
Gaze Following ◽  
Service Robots ◽  
Interactive System ◽  
Robot Interaction ◽  
The Gaze ◽  
Intention Understanding ◽  
First Time ◽  
Children’S Rehabilitation ◽  
Image Caption

Gaze-following is an effective way for intention understanding in human–robot interaction, which aims to follow the gaze of humans to estimate what object is being observed. Most of the existing methods require people and objects to appear in the same image. Due to the limitation in the view of the camera, these methods are not applicable in practice. To address this problem, we propose a method of gaze following that utilizes a geometric map for better estimation. With the help of the map, this method is competitive for cross-frame estimation. On the basis of this method, we propose a novel gaze-based image caption system, which has been studied for the first time. Our experiments demonstrate that the system follows the gaze and describes objects accurately. We believe that this system is competent for autistic children’s rehabilitation training, pension service robots, and other applications.

Vision-based Human-Robot Interaction Components for URC Intelligent Service Robots

2006 ◽  
Author(s):  
Keun-chang Kwak ◽  
Do-hyung Kim ◽  
Byoung-youl Song ◽  
Dae-ha Lee ◽  
Soo-young Chi ◽  
...  
Keyword(s):  
Human Robot Interaction ◽  
Service Robots ◽  
Robot Interaction

scholarly journals Robot Partner Development Platform for Human-Robot Interaction Based on a User-Centered Design Approach

2020 ◽  
Vol 10 (22) ◽  
pp. 7992
Author(s):  
Jinseok Woo ◽  
Yasuhiro Ohyama ◽  
Naoyuki Kubota
Keyword(s):  
System Integration ◽  
Industrial Sector ◽  
Human Robot Interaction ◽  
Service Robots ◽  
Smart Devices ◽  
Smart Device ◽  
User Centered Design ◽  
Human Communication ◽  
Robot Interaction ◽  
Development Platform

This paper presents a robot partner development platform based on smart devices. Humans communicate with others based on the basic motivations of human cooperation and have communicative motives based on social attributes. Understanding and applying these communicative motives become important in the development of socially-embedded robot partners. Therefore, it is becoming more important to develop robots that can be applied according to needs while taking these human communication elements into consideration. The role of a robot partner is more important in not only on the industrial sector but also in households. However, it seems that it will take time to disseminate robots. In the field of service robots, the development of robots according to various needs is important and the system integration of hardware and software becomes crucial. Therefore, in this paper, we propose a robot partner development platform for human-robot interaction. Firstly, we propose a modularized architecture of robot partners using a smart device to realize a flexible update based on the re-usability of hardware and software modules. In addition, we show examples of implementing a robot system using the proposed architecture. Next, we focus on the development of various robots using the modular robot partner system. Finally, we discuss the effectiveness of the proposed robot partner system through social implementation and experiments.

Noticing Extroversion Effects Attention: How Robot and Participant Personality Affect Gaze Cueing

2018 ◽  
Vol 62 (1) ◽  
pp. 1557-1561
Author(s):  
Ali Momen ◽  
Eva Wiese
Keyword(s):  
Cognitive Performance ◽  
Social Cognitive ◽  
Human Robot Interaction ◽  
Current Paper ◽  
Cognitive Behavior ◽  
Gaze Behavior ◽  
Robot Interaction ◽  
Gaze Cueing ◽  
The Gaze ◽  
Positive Effects

Social robots with expressive gaze have positive effects on human-robot interaction. In particular, research suggests that when robots are programmed to express introverted or extroverted gaze behavior, individuals enjoy interacting more with robots that match their personality. However, how this affects social-cognitive performance during human-robot interactions has not been thoroughly examined yet. In the current paper, we examine whether the perceived match between human and robot personality positively affects the degree to which the robot’s gaze is followed (i.e., gaze cueing, as a proxy for more complex social-cognitive behavior). While social attention has been examined extensively outside of human-robot interaction, recent research shows that a robot’s gaze is attended to in a similar way as a human’s gaze. While our results did not support the hypothesis that gaze cueing would be strongest when the participant’s personality matched the robot’s personality, we did find evidence that participants followed the gaze of introverted robots more strongly than the gaze of extroverted robots. This finding suggests that agent’s displaying extroverted gaze behavior may hurt performance in human-robot interaction.

scholarly journals Noticing Extraversion Effects Attention: How Robot and Participant Personality Affect Social Attention

2018 ◽  
Author(s):  
Ali Momen ◽  
Eva Wiese
Keyword(s):  
Cognitive Performance ◽  
Social Cognitive ◽  
Social Attention ◽  
Human Robot Interaction ◽  
Cognitive Behavior ◽  
Gaze Behavior ◽  
Robot Interaction ◽  
Gaze Cueing ◽  
The Gaze ◽  
Positive Effects

Social robots with expressive gaze have positive effects on human-robot interaction. In particular, research suggests that when robots are programmed to express introverted or extraverted gaze behavior, individuals enjoy interacting more with robots that match their personality. However, how this affects social-cognitive performance during human-robot interactions has not been thoroughly examined yet. In the current paper, we examine whether the perceived match between human and robot personality positively affects the degree to which the robot’s gaze is followed (i.e., gaze cueing, as a proxy for more complex social-cognitive behavior). While social attention has been examined extensively outside of human-robot interaction, recent research shows that a robot’s gaze is attended to in a similar way as a human’s gaze. While our results did not support the hypothesis that gaze cueing would be strongest when the participant’s personality matched the robot’s personality, we did find evidence that participants followed the gaze of introverted robots more strongly than the gaze of extroverted robots. This finding suggests that agent’s displaying extraverted gaze behavior may hurt performance in human-robot interaction

scholarly journals Implications from Responsible Human-Robot Interaction with Anthropomorphic Service Robots for Design Science

2022 ◽  
Author(s):  
Merlind Knof ◽  
Judith S. Heinisch ◽  
Jérôme Kirchhoff ◽  
Niyati Rawal ◽  
Klaus David ◽  
...  
Keyword(s):  
Design Science ◽  
Human Robot Interaction ◽  
Service Robots ◽  
Robot Interaction

scholarly journals In natural interaction with embodied robots, we prefer it when they follow our gaze: a gaze-contingent mobile eyetracking study

2019 ◽  
Vol 374 (1771) ◽  
pp. 20180036 ◽  
Author(s):  
Cesco Willemse ◽  
Agnieszka Wykowska
Keyword(s):  
Joint Attention ◽  
Ecological Validity ◽  
Human Robot Interaction ◽  
Theme Issue ◽  
Robot Interaction ◽  
Natural Interaction ◽  
The Gaze ◽  
Technological Advances ◽  
Look Back ◽  
The Right

Initiating joint attention by leading someone's gaze is a rewarding experience which facilitates social interaction. Here, we investigate this experience of leading an agent's gaze while applying a more realistic paradigm than traditional screen-based experiments. We used an embodied robot as our main stimulus and recorded participants' eye movements. Participants sat opposite a robot that had either of two ‘identities’—‘Jimmy’ or ‘Dylan’. Participants were asked to look at either of two objects presented on screens to the left and the right of the robot. Jimmy then looked at the same object in 80% of the trials and at the other object in the remaining 20%. For Dylan, this proportion was reversed. Upon fixating on the object of choice, participants were asked to look back at the robot's face. We found that return-to-face saccades were conducted earlier towards Jimmy when he followed the gaze compared with when he did not. For Dylan, there was no such effect. Additional measures indicated that our participants also preferred Jimmy and liked him better. This study demonstrates (a) the potential of technological advances to examine joint attention where ecological validity meets experimental control, and (b) that social reorienting is enhanced when we initiate joint attention. This article is part of the theme issue ‘From social brains to social robots: applying neurocognitive insights to human–robot interaction’.

scholarly journals State-Transition Modeling of Human–Robot Interaction for Easy Crowdsourced Robot Control

Sensors ◽  
2020 ◽  
Vol 20 (22) ◽  
pp. 6529
Author(s):  
Masaya Iwasaki ◽  
Mizuki Ikeda ◽  
Tatsuyuki Kawamura ◽  
Hideyuki Nakanishi
Keyword(s):  
User Interface ◽  
Social Presence ◽  
Robot Control ◽  
State Transition ◽  
Human Robot Interaction ◽  
Sales Promotion ◽  
Robot Interaction ◽  
Sensor Information ◽  
Transition Modeling ◽  
First Time

Robotic salespeople are often ignored by people due to their weak social presence, and thus have difficulty facilitating sales autonomously. However, for robots that are remotely controlled by humans, there is a need for experienced and trained operators. In this paper, we suggest crowdsourcing to allow general users on the internet to operate a robot remotely and facilitate customers’ purchasing activities while flexibly responding to various situations through a user interface. To implement this system, we examined how our developed remote interface can improve a robot’s social presence while being controlled by a human operator, including first-time users. Therefore, we investigated the typical flow of a customer–robot interaction that was effective for sales promotion, and modeled it as a state transition with automatic functions by accessing the robot’s sensor information. Furthermore, we created a user interface based on the model and examined whether it was effective in a real environment. Finally, we conducted experiments to examine whether the user interface could be operated by an amateur user and enhance the robot’s social presence. The results revealed that our model was able to improve the robot’s social presence and facilitate customers’ purchasing activity even when the operator was a first-time user.

Sign in / Sign up

Export Citation Format

Share Document