Teaching System for Multimodal Object Categorization by Human-Robot Interaction in Mixed Reality

Author(s):  
Lotfi El Hafi ◽  
Hitoshi Nakamura ◽  
Akira Taniguchi ◽  
Yoshinobu Hagiwara ◽  
Tadahiro Taniguchi
2021 ◽  
Vol 12 (1) ◽  
pp. 402-422
Author(s):  
Kheng Lee Koay ◽  
Matt Webster ◽  
Clare Dixon ◽  
Paul Gainer ◽  
Dag Syrdal ◽  
...  

Abstract When studying the use of assistive robots in home environments, and especially how such robots can be personalised to meet the needs of the resident, key concerns are issues related to behaviour verification, behaviour interference and safety. Here, personalisation refers to the teaching of new robot behaviours by both technical and non-technical end users. In this article, we consider the issue of behaviour interference caused by situations where newly taught robot behaviours may affect or be affected by existing behaviours and thus, those behaviours will not or might not ever be executed. We focus in particular on how such situations can be detected and presented to the user. We describe the human–robot behaviour teaching system that we developed as well as the formal behaviour checking methods used. The online use of behaviour checking is demonstrated, based on static analysis of behaviours during the operation of the robot, and evaluated in a user study. We conducted a proof-of-concept human–robot interaction study with an autonomous, multi-purpose robot operating within a smart home environment. Twenty participants individually taught the robot behaviours according to instructions they were given, some of which caused interference with other behaviours. A mechanism for detecting behaviour interference provided feedback to participants and suggestions on how to resolve those conflicts. We assessed the participants’ views on detected interference as reported by the behaviour teaching system. Results indicate that interference warnings given to participants during teaching provoked an understanding of the issue. We did not find a significant influence of participants’ technical background. These results highlight a promising path towards verification and validation of assistive home companion robots that allow end-user personalisation.


Author(s):  
Mikhail Ostanin ◽  
Stanislav Mikhel ◽  
Alexey Evlampiev ◽  
Valeria Skvortsova ◽  
Alexandr Klimchik

Author(s):  
Eric Rosen ◽  
Thomas Groechel ◽  
Michael E. Walker ◽  
Christine T. Chang ◽  
Jessica Zosa Forde

IEEE Access ◽  
2021 ◽  
pp. 1-1
Author(s):  
Kyeong-Beom Park ◽  
Sung Ho Choi ◽  
Jae Yeol Lee ◽  
Yalda Ghasemi ◽  
Mustafa Mohammed ◽  
...  

2019 ◽  
pp. 1666-1696
Author(s):  
Maurice Dawson ◽  
Marwan Omar ◽  
Jonathan Abramson ◽  
Dustin Bessette

Hyperconnectivity is a growing trend that is driving cyber security experts to develop new security architectures for multiple platforms such as mobile devices, laptops, and even wearable displays. The futures of national and international security rely on complex countermeasures to ensure that a proper security posture is maintained during this state of hyperconnectivity. To protect these systems from exploitation of vulnerabilities it is essential to understand current and future threats to include the laws that drive their need to be secured. Examined within this chapter are the potential security-related threats with the use of social media, mobile devices, virtual worlds, augmented reality, and mixed reality. Further reviewed are some examples of the complex attacks that could interrupt human-robot interaction, children-computer interaction, mobile computing, social networks, and human-centered issues in security design.


Sign in / Sign up

Export Citation Format

Share Document