Multimodal Navigation for a Haptic-Based Virtual Assembly Application

Author(s):  
Paolo Belluco ◽  
Monica Bordegoni ◽  
Samuele Polistina

Some Virtual Reality applications are based on the use of haptic interfaces for a more intuitive and realistic manipulation of the virtual objects. Typically, the haptic devices have a fixed position in the real space, and their working space is rather limited. As a consequence, there are locations in the virtual space that are out of the working space of the haptic device, and thus cannot be reached by users during the virtual objects manipulation. The paper describes a multimodal navigation modality based on the integrated use of various and low cost interaction devices that can be operated by a user taking into account that one of his hands is engaged for the manipulation of the haptic device. Therefore, we have decided to implement the user interface by using the Nintendo® Wii Remote™ and the BalanceBoard™, which can be operated by the user using the other hand and his feet. The navigation modality has been integrated and tested in a Virtual Reality application for the virtual manual assembly of mechanical components. A preliminary validation of the application has been performed by an expert user with the aim of identifying major usability and performance issues by using the heuristic evaluation method.

Author(s):  
Masashi Okubo ◽  
Tomio Watanabe

In this paper, a collaboration support system for 3D shape evaluation by using network virtual reality is proposed on the basis of both studies in 3D shape evaluation and communication support in virtual space. Collaboration mainly consists of two tasks; one is each partner’s task that is performed by the individual, the other is communication with each other. Both of them are very important objectives for all the collaboration support system. The proposed system provides the two viewpoints for each task. One is the viewpoint of back side of user’s own avatar for the smooth communication. The other is that of avatar’s eye for 3D shape evaluation. Switching the viewpoints satisfies the task conditions for 3D shape evaluation and communication. The system basically consists of PC, HMD and sensors, and users can share the embodied interaction by observing interaction between their avatars in virtual space. However, the HMD and magnetic sensors, which are put on the users, would restrict the nonverbal communication. Then, we have tried to compensate the loss of nodding of partner’s avatar by introducing the speech-driven embodied interactive actor InterActor. Sensory evaluation by paired comparison of 3D shapes in the collaborative situation in virtual space and in real space and the questionnaire are performed. The result demonstrates the effectiveness of InterActor’s nodding in the collaborative situation.


Author(s):  
Taketo Kamasaka ◽  
◽  
Kodai Miyamoto ◽  
Takahiro Ishizu ◽  
Kenji Aoki ◽  
...  

In recent years, there has been a lot of research on how to achieve interaction between users and virtual objects using augmented reality. Interaction technologies in augmented reality need to enable users to handle virtual objects intuitively. In addition, since hands are the main means of interaction with objects in real life, it is also necessary to enable interaction operations with hands on virtual objects [1]. In order to make it possible to intuitively handle objects in virtual space using hands in real space, it is necessary to consider whether physical phenomena in real space and virtual space are correctly superimposed (physical consistency). In this study, we proposed a system that allows users to intuitively handle the deformation, movement, and merging of virtual objects in augmented reality. The system was then used by four university students to compare it with existing studies [2].


Author(s):  
Hugo I. Medellín-Castillo ◽  
Germánico González-Badillo ◽  
Eder Govea ◽  
Raquel Espinosa-Castañeda ◽  
Enrique Gallegos

The technological growth in the last years have conducted to the development of virtual reality (VR) systems able to immerse the user into a three-dimensional (3D) virtual environment where the user can interact in real time with virtual objects. This interaction is mainly based on visualizing the virtual environment and objects. However, with the recent beginning of haptic systems, the interaction with the virtual world has been extended to also feel, touch and manipulate virtual objects. Virtual reality has been successfully used in the development of applications in different scientific areas ranging from basic sciences, social science, education and entertainment. On the other hand, the use of haptics has increased in the last decade in domains from sciences and engineering to art and entertainment. Despite many developments, there is still relatively little knowledge about the confluence of software, enabling hardware, visual and haptic representations, to enable the conditions that best provide for an immersive sensory environment to convey information about a particular subject domain. In this paper, the state of the art of the research work regarding virtual reality and haptic technologies carried out by the authors in the last years is presented. The aim is to evidence the potential use of these technologies to develop usable systems for analysis and simulation in different areas of knowledge. The development of three different systems in the areas of engineering, medicine and art is presented. In the area of engineering, a system for the planning, evaluation and training of assembly and manufacturing tasks has been developed. The system, named as HAMS (Haptic Assembly and Manufacturing System), is able to simulate assembly tasks of complex components with force feedback provided by the haptic device. On the other hand, in the area of medicine, a surgical simulator for planning and training orthognathic surgeries has been developed. The system, named as VOSS (Virtual Osteotomy Simulator System), allows the realization of virtual osteotomies with force feedback. Finally, in the area of art, an interactive cinema system for blind people has been developed. The system is able to play a 3D virtual movie for the blind user to listen to and touch by means of the haptic device. The development of these applications and the results obtained from these developments are presented and discussed in this paper.


Urban Science ◽  
2020 ◽  
Vol 4 (4) ◽  
pp. 48
Author(s):  
Ming Hu ◽  
Jennifer Roberts

To date, the predominant tools for the evaluation of built environment quality and impact have been surveys, scorecards, or verbal comments—approaches that rely upon user-reported responses. The goal of this research project is to develop, test, and validate a data-driven approach for built environment quality evaluation/validation based upon measurement of real-time emotional responses to simulated environments. This paper presents an experiment that was conducted by combining an immersive virtual environment (virtual reality) and electroencephalogram (EEG) as a tool to evaluate Pre and Post Purple Line development. More precisely, the objective was to (a) develop a data-driven approach for built environment quality evaluation and (b) understand the correlation between the built environment characters and emotional state. The preliminary validation of the proposed evaluation method identified discrepancies between traditional evaluation results and emotion response indications through EEG signals. The validation and findings have laid a foundation for further investigation of relations between people’s general cognitive and emotional responses in evaluating built environment quality and characters.


Author(s):  
Eder Govea ◽  
Hugo I. Medellín-Castillo

Virtual Reality (VR) is one of the areas of knowledge that have taken advantage of the computer technological development and scientific visualization. It has been used in different applications such as engineering, medicine, education, entertainment, astronomy, archaeology and arts. A main issue of VR and computer assisted applications is the design and development of the virtual environment, which comprises the virtual objects. Thus, the process of designing virtual environment requires the modelling of the virtual scene and virtual objects, including their geometry and surface characteristics such as colours, textures, etc. This research work presents a new methodology to develop low-cost and high quality virtual environments and scenarios for biomechanics, biomedical and engineering applications. The proposed methodology is based on open-source software. Four case studies corresponding to two applications in medicine and two applications in engineering are presented. The results show that the virtual environments developed for these applications are realistic and similar to the real environments. When comparing these virtual reality scenarios with pictures of the actual devices, it can be observed that the appearance of the virtual scenarios is very good. In particular the use of textures greatly helps in assessing specific features such as simulation of bone or metal. Thus, the usability of the proposed methodology for developing virtual reality applications in biomedical and engineering is proved. It is important to mention that the quality of the virtual environment will also depend on the 3D modelling skills of the VR designer.


2016 ◽  
Vol 12 (04) ◽  
pp. 55 ◽  
Author(s):  
Fernando Carneiro ◽  
Manuel Rodrigues Quintas ◽  
Paulo Abreu ◽  
Maria Teresa Restivo

This work describes the design and testing of a 1 degree of freedom (DOF) haptic device, for interaction with virtual reality (VR) applications. This device was designed so that it could to be easily assembled by anyone at a reduced price. Instructions for device assembly, as well as some VR appli-cations are available online. The tests performed on the device proved that, despite its low cost, it is able to provide users with a good haptic experience and is adequate for not complex applications.


Author(s):  
Manuel Rodrigues Quintas ◽  
Maria Teresa Restivo ◽  
José Rodrigues ◽  
Pedro Ubaldo

The concept and the use of haptic devices need to be disseminated and they should become familiar among young people. At present haptics are used in many everyday tasks in different fields. Additionally, their use in interaction with virtual reality applications simulating real systems sense of touch will increase the usersâ?? realism and immersion and, consequently, they will contribute to improve the intrinsic knowledge to the simulationsâ?? goals. However, haptics are associated with expensive equipment and usually they offer several degrees of freedom. The objective of this work is to make their cost not much more expensive than a â??specialâ? mouse by offering a low cost solution with just one degree of freedom (1DOF) useful in many simple cases. Additionally, it is also an objective of this work the development of simple virtual reality systems requiring interactions only requiring one degree of freedom. A low cost, single-axis force-feedback haptic device of 1 degree of freedom has been developed. For evaluating the interest of this prototype a â??Spring Constantâ? application was built and used as a demonstrator. The complete system - the haptic interacting with the â??Spring Constantâ? - will be described in the present work.


2019 ◽  
Vol 29 ◽  
pp. S13-S21 ◽  
Author(s):  
Peter Casey ◽  
Rebecca Lindsay-Decusati ◽  
Ibrahim Baggili ◽  
Frank Breitinger

Author(s):  
Yuzhu Lu ◽  
Shana Smith

In this paper, we present a prototype system, which uses CAVE-based virtual reality to enhance immersion in an augmented reality environment. The system integrates virtual objects into a real scene captured by a set of stereo remote cameras. We also present a graphic processing unit (GPU)-based method for computing occlusion between real and virtual objects in real time. The method uses information from the captured stereo images to determine depth of objects in the real scene. Results and performance comparisons show that the GPU-based method is much faster than prior CPU-based methods.


Sign in / Sign up

Export Citation Format

Share Document