A New 3D Interaction Technique Accessible to the Visually Impaired

Author(s):  
Erico De Souza Veriscimo ◽  
Joao Luiz Bernardes
Author(s):  
Nikolaos Kaklanis ◽  
Konstantinos Moustakas ◽  
Dimitrios Tsovaras

This chapter describes an interaction technique wherein web pages are parsed so as to automatically generate a corresponding 3D virtual environment with haptic feedback. The automatically created 3D scene is composed of “hapgets” (haptically-enhanced widgets), which are three dimensional widgets providing a behavior that is analogous to the behavior of the original HTML components but are also enhanced with haptic feedback. Moreover, for each 2D map included in a web page a corresponding multimodal (haptic-aural) map is automatically generated. The proposed interaction technique enables the haptic navigation through the internet as well as the haptic exploration of conventional 2D maps for the visually impaired users. A rendering engine of web pages that was developed according to the proposed interaction technique is also presented.


2016 ◽  
Vol 78 (12-3) ◽  
Author(s):  
Arief Hydayat ◽  
Haslina Arshad ◽  
Nazlena Mohamad Ali ◽  
Lam Meng Chun

In a 3D user interface, interaction plays an important role in helping users to manipulate 3D objects in virtual environments. 3D devices, such as data glove and motion tracking, can potentially give users the opportunity to manipulate 3D objects in virtual reality environments such as checking, zooming, translating, rotating, merging and splitting 3D objects in a more natural and easy manner through the use of hand gestures. Hand gestures are often applied in 3D interaction techniques for converting the manipulation mode. This paper will discuss the interaction technique in a virtual environment using a combination of the Push and Pull navigation and the rotation technique. The unimanual use of these 3D interaction techniques can improve the effectiveness of users in their interaction with and manipulation of 3D objects. This study has enhanced the capability of the unimanual 3D interaction technique in terms of 3D interaction feedback in virtual environments.


Author(s):  
Giandomenico Caruso ◽  
Monica Bordegoni

The paper describes a novel 3D interaction technique based on Eye Tracking (ET) for Mixed Reality (MR) environments. We have developed a system that integrates a commercial ET technology with a MR display technology. The system elaborates the data coming from the ET in order to obtain the 3D position of the user’s gaze. A specific calibration procedure has been developed for correctly computing the gaze position according to the user. The accuracy and the precision of the system have been assessed by performing several tests with a group of users. Besides, we have compared the 3D gaze position in real, virtual and mixed environments in order to check if there are differences when the user sees real or virtual objects. The paper also proposes an application example by means of which we have assessed the global usability of the system.


Sign in / Sign up

Export Citation Format

Share Document