scholarly journals Multimodality with Eye tracking and Haptics: A New Horizon for Serious Games?

Author(s):  
Shujie Deng ◽  
Julie A. Kirkby ◽  
Jian Chang ◽  
Jian Jun Zhang

The goal of this review is to illustrate the emerging use of multimodal virtual reality that can benefit learning-based games. The review begins with an introduction to multimodal virtual reality in serious games and we provide a brief discussion of why cognitive processes involved in learning and training are enhanced under immersive virtual environments. We initially outline studies that have used eye tracking and haptic feedback independently in serious games, and then review some innovative applications that have already combined eye tracking and haptic devices in order to provide applicable multimodal frameworks for learning-based games. Finally, some general conclusions are identified and clarified in order to advance current understanding in multimodal serious game production as well as exploring possible areas for new applications.

2018 ◽  
Vol 4 (4) ◽  
pp. 149-172 ◽  
Author(s):  
Liliane S. Machado ◽  
Thaise Kelly de Lima Costa ◽  
Ronei Marcos de Moraes

O desenvolvimento de aplicações computacionais deve ser guiado pelas necessidades do cliente, considerando todas as etapas do projeto de um software. Quando estas aplicações são voltadas para educação em saúde, observa-se a necessidade de abordar aspectos relacionados a pelo menos quatro áreas: educação, saúde, estatística e computação, evidenciando a necessidade de uma abordagem multidisciplinar para a produção de ferramentas efetivas e eficientes para os problemas a que se destinam. Este artigo apresenta e discute etapas consideradas fundamentais no processo de desenvolvimento de serious games e simuladores de treinamento para a saúde baseados em realidade virtual.   PALAVRAS-CHAVE: realidade virtual; jogos em saúde; serious games.     ABSTRACT The development of computer applications must be guided by clients’ needs and must consider all step of software project. It is necessary to integrate knowledge of four areas: education, health, statistics and computer science when those applications are for education in health what makes evident the need of a multidisciplinar approach for the production of effective and efficient tools for the purpose expected. This paper presents and discusses fundamental steps for the development of serious games and training simulators for health based on virtual reality   KEYWORDS: virtual reality; games for health; serious games.     RESUMEN El desarrollo de las aplicaciones informáticas debe guiarse por las necesidades de los clientes y debe considerar todos los pasos del proyecto de software. Es necesario integrar el conocimiento de cuatro áreas: educación, salud, estadística e informática cuando esas aplicaciones son para la educación en salud, lo que hace evidente la necesidad de un enfoque multidisciplinario para la producción de herramientas eficaces y efectivas para el propósito esperado. Este artículo presenta y discute los pasos fundamentales para el desarrollo de juegos serios y simuladores de entrenamiento para la salud basados en la realidad virtual.   PALABRAS CLAVE: realidad virtual, juegos para salud, serious games.  


Author(s):  
John Sermarini ◽  
Joseph T. Kider ◽  
Joseph J. LaViola ◽  
Daniel S. McConnell

We present the results of a study investigating the influence of task and effector constraints on the kinematics of pointing movements performed in immersive virtual environments. We compared the effect of target width, as a task constraint, to the effect of movement distance, as an effector constraint, in terms of overall effect on movement time in a pointing task. We also compared a linear ray-cast pointing technique to a parabolic pointing technique to understand how interaction style may be understood in the context of task and effector constraints. The effect of target width as an information constraint on pointing performance was amplified in VR. Pointing technique acted as an effector constraint, with linear ray-cast pointing resulting in faster performance than parabolic pointers.


2010 ◽  
pp. 180-193 ◽  
Author(s):  
F. Steinicke ◽  
G. Bruder ◽  
J. Jerald ◽  
H. Frenz

In recent years virtual environments (VEs) have become more and more popular and widespread due to the requirements of numerous application areas in particular in the 3D city visualization domain. Virtual reality (VR) systems, which make use of tracking technologies and stereoscopic projections of three-dimensional synthetic worlds, support better exploration of complex datasets. However, due to the limited interaction space usually provided by the range of the tracking sensors, users can explore only a portion of the virtual environment (VE). Redirected walking allows users to walk through large-scale immersive virtual environments (IVEs) such as virtual city models, while physically remaining in a reasonably small workspace by intentionally injecting scene motion into the IVE. With redirected walking users are guided on physical paths that may differ from the paths they perceive in the virtual world. The authors have conducted experiments in order to quantify how much humans can unknowingly be redirected. In this chapter they present the results of this study and the implications for virtual locomotion user interfaces that allow users to view arbitrary real world locations, before the users actually travel there in a natural environment.


Author(s):  
Florian Hruby ◽  
Irma Castellanos ◽  
Rainer Ressl

Abstract Scale has been a defining criterion of mapmaking for centuries. However, this criterion is fundamentally questioned by highly immersive virtual reality (VR) systems able to represent geographic environments at a high level of detail and, thus, providing the user with a feeling of being present in VR space. In this paper, we will use the concept of scale as a vehicle for discussing some of the main differences between immersive VR and non-immersive geovisualization products. Based on a short review of diverging meanings of scale we will propose possible approaches to the issue of both spatial and temporal scale in immersive VR. Our considerations shall encourage a more detailed treatment of the specific characteristics of immersive geovisualization to facilitate deeper conceptual integration of immersive and non-immersive visualization in the realm of cartography.


2018 ◽  
Vol 11 (1) ◽  
Author(s):  
Helen Sara Farley

Affordable hardware and increased processing power have resulted in a surge in the number and adoption of virtual reality applications and immersive virtual environments. These applications are able to immerse the user in an environment other than that of their immediate geographical location. The one population that is unable to move even within their own geographical location are prisoners. Prisoners are secluded away from the general population, unable to travel, attend education beyond the prison walls or interact with a wide variety of people. At least to a certain extent, these constraints are able to be overcome with the use of virtual reality and immersive virtual environments.This paper briefly examines the constraints experienced by prisoners and the technical limitations of the prison environment. It explores the very few cases where these technologies are already used within the prison setting. A number of potential uses for virtual reality within prisons are proposed, including the justification for these approaches and a description of how these technologies are being used outside of the prison setting.


Author(s):  
Liliane Machado ◽  
Ronei Moraes

Training systems based on virtual reality, serious games, assessment methods, systems to support learning, assessment methodologies and technologies to extend interaction with educational content have been the focus of researches at LabTEVE. The interdisciplinarity can be observed in each project, highlighting the need for dialogue between areas for the production of solutions and technologies that can be used today as well as prospected for the future.


2000 ◽  
Vol 9 (5) ◽  
pp. 486-496 ◽  
Author(s):  
A. C. Boud ◽  
C. Baber ◽  
S. J. Steiner

This paper reports on an investigation into the proposed usability of virtual reality for a manufacturing application such as the assembly of a number of component parts into a final product. Before the assembly task itself is considered, the investigation explores the use of VR for the training of human assembly operators and compares the findings to conventionally adopted techniques for parts assembly. The investigation highlighted several limitations of using VR technology. Most significant was the lack of haptic feedback provided by current input devices for virtual environments. To address this, an instrumented object (IO) was employed that enabled the user to pick up and manipulate the IO as the representation of a component from a product to be assembled. The reported findings indicate that object manipulation times are superior when IOs are employed as the interaction device, and that IO devices could therefore be adopted in VEs to provide haptic feedback for diverse applications and, in particular, for assembly task planning.


2021 ◽  
Vol 2 ◽  
Author(s):  
Lauren Buck ◽  
Richard Paris ◽  
Bobby Bodenheimer

Spatial perception in immersive virtual environments, particularly regarding distance perception, is a well-studied topic in virtual reality literature. Distance compression, or the underestimation of distances, is and has been historically prevalent in all virtual reality systems. The problem of distance compression still remains open, but recent advancements have shown that as systems have developed, the level of distance compression has decreased. Here, we add evidence to this trend by beginning the assessment of distance compression in the HTC Vive Pro. To our knowledge, there are no archival results that report any findings about distance compression in this system. Using a familiar paradigm for studying distance compression in virtual reality hardware, we asked users to blind walk to a target object placed in a virtual environment and assessed their judgments based on those distances. We find that distance compression in the HTC Vive Pro mirrors that of the HTC Vive. Our results are not particularly surprising, considering the nature of the differences between the two systems, but they lend credence to the finding that resolution does not affect distance compression. More extensive study should be performed to reinforce these results.


Author(s):  
Ronei Marcos de Moares ◽  
Liliane S. Machado ◽  
Fátima de Lourdes dos Santos Nunes ◽  
Rosa Maria Esteves Moreira da Costa

Since the first electronic game produced in the 40s, a large market of entertainment games has been established. Since then, the main focus of games continues to be provide fun for users. However, Serious Games (SG) have been developed as a special class of games devoted to join fun activities with specific content. The multidisciplinary aspects necessary to the development of such applications is enhanced when they are devoted to training and education purposes. This chapter presents details of development of five serious games in which intelligent methodologies and/or virtual reality techniques were incorporated. The games include education for children and adults and training for professionals.


Sign in / Sign up

Export Citation Format

Share Document