scholarly journals Teleoperated Service Robot with an Immersive Mixed Reality Interface

2021 ◽  
Vol 20 (6) ◽  
pp. 1187-1223
Author(s):  
Angelica Nakayama ◽  
Daniel Ruelas ◽  
Jesus Savage ◽  
Ernesto Bribiesca
Keyword(s):  
Virtual Environment ◽  
User Experience ◽  
Mixed Reality ◽  
Fast Response ◽  
Video Data ◽  
Service Robots ◽  
Service Robot ◽  
Remote Visualization ◽  
Teleoperation System ◽  
Remote Environment

Teleoperated service robots can perform more complex and precise tasks as they combine robot skills and human expertise. Communication between the operator and the robot is essential for remote operation and strongly affects system efficiency. Immersive interfaces are being used to enhance teleoperation experience. However, latency or time delay can impair the performance of the robot operation. Since remote visualization involves transmitting a large amount of video data, the challenge is to decrease communication instability. Then, an efficient teleoperation system must have a suitable operation interface capable of visualizing the remote environment, controlling the robot, and having a fast response time. This work presents the development of a service robot teleoperation system with an immersive mixed reality operation interface where the operator can visualize the real remote environment or a virtual 3D environment representing it. The virtual environment aims to reduce the latency on communication by reducing the amount of information sent over the network and improve user experience. The robot can perform navigation and simple tasks autonomously or change to the teleoperated mode for more complex tasks. The system was developed using ROS, UNITY 3D, and sockets to be exported with ease to different platforms. The experiments suggest that having an immersive operation interface provides improved usability for the operator. The latency appears to improve when using the virtual environment. The user experience seems to benefit from the use of mixed reality techniques; this may lead to the broader use of teleoperated service robot systems.

scholarly journals Improving the robustness of a service robot for continuous indoor monitoring: An incremental approach

2021 ◽  
Vol 18 (3) ◽  
pp. 172988142110121
Author(s):  
David Portugal ◽  
André G Araújo ◽  
Micael S Couceiro
Keyword(s):  
Real World ◽  
Service Robots ◽  
Service Robot ◽  
Technology Readiness ◽  
Incremental Approach ◽  
Technology Readiness Level ◽  
Readiness Level ◽  
Software And Hardware ◽  
Indoor Monitoring

To move out of the lab, service robots must reveal a proven robustness so they can be deployed in operational environments. This means that they should function steadily for long periods of time in real-world areas under uncertainty, without any human intervention, and exhibiting a mature technology readiness level. In this work, we describe an incremental methodology for the implementation of an innovative service robot, entirely developed from the outset, to monitor large indoor areas shared by humans and other obstacles. Focusing especially on the reliability of the fundamental localization system of the robot in the long term, we discuss all the incremental software and hardware features, design choices, and adjustments conducted, and show their impact on the performance of the robot in the real world, in three distinct 24-h long trials, with the ultimate goal of validating the proposed mobile robot solution for indoor monitoring.

Virtual Reality (VR) in Pediatrics: Innovative Perspectives With Special Reference To Clinical Applications and Pediatric Rehabilitation

2021 ◽  
Author(s):  
Stefan Bittmann
Keyword(s):  
Virtual Reality ◽  
Virtual Environment ◽  
Virtual Worlds ◽  
Virtual World ◽  
Mixed Reality ◽  
Clinical Applications ◽  
Virtual Space ◽  
Data Glove ◽  
Input Devices ◽  
Head Mounted Displays

Virtual reality (VR) is the term used to describe representation and perception in a computer-generated, virtual environment. The term was coined by author Damien Broderick in his 1982 novel “The Judas Mandala". The term "Mixed Reality" describes the mixing of virtual reality with pure reality. The term "hyper-reality" is also used. Immersion plays a major role here. Immersion describes the embedding of the user in the virtual world. A virtual world is considered plausible if the interaction is logical in itself. This interactivity creates the illusion that what seems to be happening is actually happening. A common problem with VR is "motion sickness." To create a sense of immersion, special output devices are needed to display virtual worlds. Here, "head-mounted displays", CAVE and shutter glasses are mainly used. Input devices are needed for interaction: 3D mouse, data glove, flystick as well as the omnidirectional treadmill, with which walking in virtual space is controlled by real walking movements, play a role here.

The robot-to-robot service encounter: an examination of the impact of inter-robot warmth

2021 ◽  
Vol 35 (9) ◽  
pp. 15-27
Author(s):  
Magnus Söderlund
Keyword(s):  
Design Methodology ◽  
Service Robots ◽  
Service Robot ◽  
Service Encounters ◽  
Experimental Setting ◽  
Content Type ◽  
Robot Systems ◽  
Synthetic Agents ◽  
High Level ◽  
The Impact

Purpose This study aims to examine humans’ reactions to service robots’ display of warmth in robot-to-robot interactions – a setting in which humans’ impressions of a service robot will not only be based on what this robot does in relation to humans, but also on what it does to other robots. Design/methodology/approach Service robot display of warmth was manipulated in an experimental setting in such a way that a service robot A expressed low versus high levels of warmth in relation to another service robot B. Findings The results indicate that a high level of warmth expressed by robot A vis-à-vis robot B boosted humans’ overall evaluations of A, and that this influence was mediated by the perceived humanness and the perceived happiness of A. Originality/value Numerous studies have examined humans’ reactions when they interact with a service robot or other synthetic agents that provide service. Future service encounters, however, will comprise also multi-robot systems, which means that there will be many opportunities for humans to be exposed to robot-to-robot interactions. Yet, this setting has hitherto rarely been examined in the service literature.

Ludic Learning

2013 ◽  
Vol 5 (2) ◽  
pp. 20-33 ◽  
Author(s):  
Aleshia T. Hayes ◽  
Carrie L. Straub ◽  
Lisa A. Dieker ◽  
Charlie E. Hughes ◽  
Michael C. Hynes
Keyword(s):  
Virtual Environments ◽  
User Experience ◽  
Social Presence ◽  
Mixed Reality ◽  
Emerging Technologies ◽  
Emerging Technology ◽  
Sense Of Presence ◽  
Suspension Of Disbelief

New and emerging technology in the field of virtual environments has permitted a certain malleability of learning milieus. These emerging environments allow learning and transfer through interactions that have been intentionally designed to be pleasurable experiences. TLE TeachLivE™ is just such an emerging environment that engages teachers in practice on pedagogical and content aspects of teaching in a simulator. The sense of presence, engagement, and ludus of TLE TeachLivE™ are derived from the compelling Mixed Reality that includes components of off-the shelf and emerging technologies. Some of the noted features that have been identified relevant to the ludic nature of TeachLivE include the flow, fidelity, unpredicability, suspension of disbelief, social presence, and gamelike elements. This article explores TLE TeachLivE™ in terms of the ludology, paideic user experience, the source of the ludus, and outcomes of the ludic nature of the experience.

Me and My VE, Part 5: Applications in Human Factors Research and Practice

2018 ◽  
Vol 62 (1) ◽  
pp. 2051-2055
Author(s):  
Randall Spain ◽  
Benjamin Goldberg ◽  
Jeffrey Hansberger ◽  
Tami Griffith ◽  
Jeremy Flynn ◽  
...  
Keyword(s):  
Virtual Reality ◽  
Human Factors ◽  
Virtual Environments ◽  
Virtual Environment ◽  
Human Performance ◽  
Mixed Reality ◽  
Research Training ◽  
Research And Practice ◽  
Set Up ◽  
Human Factors Research

Recent advances in technology have made virtual environments, virtual reality, augmented reality, and simulations more affordable and accessible to researchers, companies, and the general public, which has led to many novel use cases and applications. A key objective of human factors research and practice is determining how these technology-rich applications can be designed and applied to improve human performance across a variety of contexts. This session will demonstrate some of the distinct and diverse uses of virtual environments and mixed reality environments in an alternative format. The session will begin with each demonstrator providing a brief overview of their virtual environment (VE) and a description of how it has been used to address a particular problem or research need. Following the description portion of the session, each VE will be set-up at a demonstration station in the room, and session attendees will be encouraged to directly interact with the virtual environment and ask demonstrators questions about their research and inquire about the effectiveness of using VE for research, training, and evaluation purposes. The overall objective of this alternative session is to increase the awareness of how human factors professionals use VE technologies and increase the awareness of the capabilities and limitations of VE in supporting the work of HF professionals.

scholarly journals Application Problems and Solutions of Intelligent Airport Service Robots

2020 ◽  
Vol 198 ◽  
pp. 04030
Author(s):  
Dai Yanyan ◽  
Chen Meng
Keyword(s):  
Artificial Intelligence ◽  
Cloud Computing ◽  
Big Data ◽  
Large Scale ◽  
New Technologies ◽  
Effective Means ◽  
Third Party ◽  
Service Robots ◽  
Service Robot ◽  
Operation Conditions

With the development of new technologies such as artificial intelligence, big data, and cloud computing, the “intelligent airport” is considered to be an effective means to solve or alleviate the current industry problems such as large-scale airport business, the large number of operating entities, and the complicated operation conditions. This paper is about the collaboration between universities and enterprises based on the concept of service design. Relying on big data and cloud computing technology, this paper addresses the problems of airport service robots in inquiries, blind spots of security inspection, and full monomer smart navigation diffluence, combined with the basic technology of service robot artificial intelligence and the third-party interface to design solutions to effectively solve the problems of process.

Self-Calibration of Eye-to-Hand and Workspace for Mobile Service Robot

2012 ◽  
pp. 229-246
Author(s):  
Jwu-Sheng Hu ◽  
Yung-Jung Chang
Keyword(s):  
Visual Information ◽  
Calibration Method ◽  
Industrial Robots ◽  
Service Robots ◽  
Service Robot ◽  
Mobile Service ◽  
Robot Arm ◽  
Self Calibration ◽  
Laser Distance Sensor ◽  
Distance Sensor

The geometrical relationships among robot arm, camera, and workspace are important to carry out visual servo tasks. For industrial robots, the relationships are usually fixed and well calibrated by experienced operators. However, for service robots, particularly in mobile applications, the relationships might be changed. For example, when a mobile robot attempts to use the visual information from environmental cameras to perform grasping, it is necessary to know the relationships before taking actions. Moreover, the calibration should be done automatically. This chapter proposes a self-calibration method using a laser distance sensor mounted on the robot arm. The advantage of the method, as compared with pattern-based one, is that the workspace coordinate is also obtained at the same time using the projected laser spot. Further, it is not necessary for the robot arm to enter the view scope of the camera for calibration. This increases the safety when the workspace is unknown initially.

scholarly journals Gamification of assembly planning in virtual environment

2019 ◽  
Vol 39 (5) ◽  
pp. 931-943
Author(s):  
Samir Garbaya ◽  
Daniela M. Romano ◽  
Gunjeet Hattar
Keyword(s):  
Virtual Environment ◽  
User Experience ◽  
Low Cost ◽  
Subjective Evaluation ◽  
Virtual Assembly ◽  
Design Stage ◽  
Assembly Planning ◽  
User Performance ◽  
Content Type ◽  
Significant Difference

Purpose The purpose of this paper is to study the effect of the gamification of virtual assembly planning on the user performance, user experience and engagement. Design/methodology/approach A multi-touch table was used to manipulate virtual parts and gamification features were integrated into the virtual assembly environment. An experiment was conducted in two conditions: a gamified and a non-gamified virtual environment. Subjects had to assemble a virtual pump. The user performance was evaluated in terms of the number of errors, the feasibility of the generated assembly sequence and the user feedback. Findings The gamification reduced the number of errors and increased the score representing the number of right decisions. The results of the subjective and objective analysis showed that the number of errors decreased with engagement in the gamified assembly. The increase in the overall user experience reduced the number of errors. The subjective evaluation showed a significant difference between the gamified and the non-gamified assembly in terms of the level of engagement, the learning usability and the overall experience. Research limitations/implications The effective learning retention after training has not been tested, and longitudinal studies are necessary. The effect of the used gamification elements has been evaluated as a whole; further work could isolate the most beneficial features and add other elements that might be more beneficial for learning. Originality/value The research reported in this paper provides valuable insights into the gamification of virtual assembly using a low-cost multi-touch interface. The results are promising for training operators to assemble a product at the design stage.

Sign in / Sign up

Export Citation Format

Share Document