[DEMO] Exploring multimodal interaction techniques for a mixed reality digital surface

2014 ◽  
Author(s):  
Martin Fischbach ◽  
Chris Zimmerer ◽  
Anke Giebler-Schubert ◽  
Marc Erich Latoschik
Keyword(s):  
Mixed Reality ◽  
Multimodal Interaction ◽  
Interaction Techniques

(Re)Engineering Cultural Heritage Contexts using Creative Human Computer Interaction Techniques and Mixed Reality Methodologies

2014 ◽  
pp. 441-451
Author(s):  
Carl Smith
Keyword(s):  
Augmented Reality ◽  
Human Computer Interaction ◽  
Cultural Heritage ◽  
Mixed Reality ◽  
Design Guidelines ◽  
Virtual Space ◽  
Interaction Patterns ◽  
Interaction Techniques ◽  
Current State ◽  
Computer Interaction

The contribution of this research is to argue that truly creative patterns for interaction within cultural heritage contexts must create situations and concepts that could not have been realised without the intervention of those interaction patterns. New forms of human-computer interaction and therefore new tools for navigation must be designed that unite the strengths, features, and possibilities of both the physical and the virtual space. The human-computer interaction techniques and mixed reality methodologies formulated during this research are intended to enhance spatial cognition while implicitly improving pattern recognition. This research reports on the current state of location-based technology including Mobile Augmented Reality (MAR) and GPS. The focus is on its application for use within cultural heritage as an educational and outreach tool. The key questions and areas to be investigated include: What are the requirements for effective digital intervention within the cultural heritage sector? What are the affordances of mixed and augmented reality? What mobile technology is currently being utilised to explore cultural heritage? What are the key projects? Finally, through a series of case studies designed and implemented by the author, some broad design guidelines are outlined. The chapter concludes with an overview of the main issues to consider when (re)engineering cultural heritage contexts.

Social and Physical Interactive Paradigms for Mixed Reality Entertainment

2011 ◽  
pp. 352-366
Author(s):  
Adrian David Cheok
Keyword(s):  
Augmented Reality ◽  
Case Studies ◽  
Mixed Reality ◽  
Gps Tracking ◽  
Tangible Interaction ◽  
Application Domain ◽  
Interaction Techniques ◽  
Technological Aspect ◽  
Design Decisions ◽  
System Description

In this chapter, we explore the applications of mixed reality technology for future social and physical entertainment systems. Throughout the case studies that will be presented here, we will show the very broad and significant impacts of mixed reality technology on variety aspects of human interactivity with regards to entertainment. On the technological aspect, the various systems we would be touching on incorporated different technologies ranging from the current mainstream ones such as GPS tracking, Bluetooth, RFID to pioneering researches of vision based tracking, augmented reality, tangible interaction techniques and 3D live mixed reality capture system. We will discuss each projects in detail in terms of their motivations and requirements of the particular application domain, their system description and design decisions, as well as their future impacts on the human social and physical entertainment field.

scholarly journals Technologies for Multimodal Interaction in Extended Reality—A Scoping Review

2021 ◽  
Vol 5 (12) ◽  
pp. 81
Author(s):  
Ismo Rakkolainen ◽  
Ahmed Farooq ◽  
Jari Kangas ◽  
Jaakko Hakulinen ◽  
Jussi Rantala ◽  
...  
Keyword(s):  
Scoping Review ◽  
Multimodal Interaction ◽  
Interaction Techniques ◽  
Research Gaps ◽  
Process Information ◽  
Head Mounted Display ◽  
Recent Advances ◽  
Video And Audio ◽  
Information Visualizations

When designing extended reality (XR) applications, it is important to consider multimodal interaction techniques, which employ several human senses simultaneously. Multimodal interaction can transform how people communicate remotely, practice for tasks, entertain themselves, process information visualizations, and make decisions based on the provided information. This scoping review summarized recent advances in multimodal interaction technologies for head-mounted display-based (HMD) XR systems. Our purpose was to provide a succinct, yet clear, insightful, and structured overview of emerging, underused multimodal technologies beyond standard video and audio for XR interaction, and to find research gaps. The review aimed to help XR practitioners to apply multimodal interaction techniques and interaction researchers to direct future efforts towards relevant issues on multimodal XR. We conclude with our perspective on promising research avenues for multimodal interaction technologies.

Sign in / Sign up

Export Citation Format

Share Document