Spherical Layout with Proximity-Based Multimodal Feedback for Eyes-Free Target Acquisition in Virtual Reality

This research describes a theoretical framework for designing multimodal feedback for 3D buttons in a virtual environment. Virtual button implementations often suffer from inadequate feedback compared to their mechanical, real-world, counterparts. This lack of feedback can lead to accidental button actuations and reduce the user’s ability to discover how to interact with the virtual button. We propose a framework for more expressive virtual button feedback that communicates visual, audio, and haptic feedback to the user. We apply the theoretical framework by implementing a software library prototype to support multimodal feedback from virtual buttons in a 3D virtual reality workspace.

Download Full-text

Visuo-Haptic-Based Multimodal Feedback Virtual Reality Solution to Improve Anxiety Symptoms: A Proof-of-Concept Study

Psychiatry Investigation ◽

10.30773/pi.2018.12.25.1 ◽

2019 ◽

Vol 16 (2) ◽

pp. 167-171 ◽

Cited By ~ 2

Author(s):

Young Im Kim ◽

Seo-Yeon Jung ◽

Seulki Min ◽

Eunbi Seol ◽

Sungho Seo ◽

...

Keyword(s):

Virtual Reality ◽

Anxiety Symptoms ◽

Proof Of Concept ◽

Multimodal Feedback ◽

Concept Study

Download Full-text

Tech-note: Multimodal feedback in 3D target acquisition

2009 IEEE Symposium on 3D User Interfaces ◽

10.1109/3dui.2009.4811212 ◽

2009 ◽

Cited By ~ 1

Author(s):

Dalia El-Shimy ◽

Georgios Marentakis ◽

Jeremy R. Cooperstock

Keyword(s):

Target Acquisition ◽

Multimodal Feedback

Download Full-text

Investigating Bubble Mechanism for Ray-Casting to Improve 3D Target Acquisition in Virtual Reality

2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) ◽

10.1109/vr46266.2020.00021 ◽

2020 ◽

Author(s):

Yiqin Lu ◽

Chun Yu ◽

Yuanchun Shi

Keyword(s):

Virtual Reality ◽

Ray Casting ◽

Target Acquisition

Download Full-text

Fitts and VR: Evaluating Display and Input Devices with Fitts' Law

Proceedings of the Human Factors and Ergonomics Society Annual Meeting ◽

10.1177/1071181397041002119 ◽

1997 ◽

Vol 41 (2) ◽

pp. 1259-1262 ◽

Cited By ~ 2

Author(s):

Mike McGee ◽

Brian Amento ◽

Patrick Brooks ◽

Hope Harley

Keyword(s):

Virtual Reality ◽

Display Type ◽

Input Device ◽

Target Acquisition ◽

Evaluation Tool ◽

Acquisition Performance ◽

Input Devices ◽

Fitts Law ◽

Starting Point ◽

Computer Workstation

This paper describes an experiment using Fitts' Law to evaluate performance in target acquisition tasks comparing a typical virtual reality (VR) display and input device with a typical computer workstation display and input device. The objective was to determine the effects of using VR hardware on target acquisition performance and validate Fitts' Law in a VR setting. Participants performed 2D target acquisition tasks varying width of target, distance of target, and angle of target from starting point. Factors that showed significantly different acquisition times included input device, distance from target, width of target, and angle of target from starting point. Display type did not show significance. In addition, acquisition times significantly increased throughout the experiment, indicating fatigue. Extending the use of Fitts' Law as an evaluation tool for VR systems is discussed.

Download Full-text

Handshake: Realistic Human-Robot Interaction in Haptic Enhanced Virtual Reality

Presence Teleoperators & Virtual Environments ◽

10.1162/pres_a_00061 ◽

2011 ◽

Vol 20 (4) ◽

pp. 371-392 ◽

Cited By ~ 22

Author(s):

Zheng Wang ◽

Elias Giannopoulos ◽

Mel Slater ◽

Angelika Peer

Keyword(s):

Virtual Reality ◽

Subjective Evaluation ◽

Ground Truth ◽

Haptic Rendering ◽

Human Robot Interaction ◽

Human Interaction ◽

Haptic Interface ◽

Online Behavior ◽

Multimodal Feedback ◽

Basic Mode

This paper focuses on the development and evaluation of a haptic enhanced virtual reality system which allows a human user to make physical handshakes with a virtual partner through a haptic interface. Multimodal feedback signals are designed to generate the illusion that a handshake with a robotic arm is a handshake with another human. Advanced controllers of the haptic interface are developed to respond to user behaviors online. Techniques to achieve online behavior generation are presented, such as a hidden-Markov-model approach to human interaction strategy estimation. Human-robot handshake experiments were carried out to evaluate the performance of the system. Two different approaches to haptic rendering were compared in experiments: a controller in basic mode with an embedded curve in the robot that disregards the human partner, and an interactive robot controller for online behavior generation. The two approaches were compared with the ground truth of another human driving the robot via teleoperation instead of the controller implementing a virtual partner. In the evaluation results, the human approach is rated to be most human-like, with the interactive controller following closely behind, followed by the controller in basic mode. This paper mainly concentrates on discussing the development of the haptic rendering algorithm for the handshaking system, its integration with visual and haptic cues, and reports about the results of subjective evaluation experiments that were carried out.

Download Full-text