Author(s):  
Hector Chimeremeze Okere ◽  
Suziah Sulaiman ◽  
Dayang Rohaya Awang Rambli ◽  
Oi-Mean Foong

The proliferation of multimodal interaction research have presented numerous advantages which include enhancement of realism, increased efficiency in user task performance and the achievement of an interactivity that is relatively identical to the conventional human to human interactions. Haptic, visual, and aural interactions have been widely utilized and applied in various domains ranging from military and scientific visualization realms into more multidisciplinary areas, such as art and culture, education, archeology, and complementary medicine. In Virtual reality stress therapy application particularly in the proliferation towards the virtualization and simulation of the traditional foot reflexology therapy, little is understood on the haptic, visual and aural interactive nature of the therapy and to what extent they contribute in the patients' relaxation and stress relief, which hinders the system developers from obtaining the appropriate system design requirements for foot reflexology virtual stress therapy applications. This paper presents an exploratory study that examines from both the patients' and practitioners' perspective, the haptic, visual and aural interactive nature in foot reflexology domain since the practices promote relaxation and stress relief. The study explored 2 traditional foot reflexology sessions; audio recorded semi-structured interview was used to collect data from the participant's while the session was going on for analysis. The study findings presented the haptic, visual and aural interactive nature involved from the patients' and practitioners' perspective, and a higher level design requirements for the haptic, aural, visual and general interactivity extracted from the study findings as well as from literature. Implications for future research are also discussed.


Author(s):  
Patrizia Grifoni

An important issue for communication processes in general, and for multimodal interaction in particular, is the information output arrangement and organization (multimodal fission). Considering information structure, intonation, and emphasis for the output by speech, considering moreover spatio-temporal coordination of pieces of information for visual (video, graphics, images, and texts) outputs, designing outputs for each kind of modality, and synchronizing the different outputs modalities is one of the most relevant challenges of the multimodal interaction design process; it is called fission. This challenge is becoming more and more important with the use of a lot of different interaction devices from laptop to mobile and smart-phones, in different contexts. This chapter provides some basic concepts involved in the fission processes design and describes some of the most relevant approaches discussed in the literature.


2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Chuyi Liu

There are many problems in the current process product design, such as poor interaction and low overall efficiency, so a process product design method based on multimode interaction design is proposed. Based on the relationship model, environment model, and object-oriented model of process product design, the process of process product development and design is analyzed. On this basis, the finite state machine is used to analyze the state of the designer to complete the task sequence, as well as the related design task planning, constructing craft products multimodal interaction mechanism, with the improved fuzzy analytic hierarchy process to evaluate the quality of the products, according to the evaluation results of technology of product design optimization. The experimental results show that both experts and ordinary users give a high evaluation of the product designed in this paper, and the design cycle of the product is significantly shortened, indicating that this method can fully save the design time and improve the overall efficiency.


1997 ◽  
Vol 6 (6) ◽  
pp. 687-700 ◽  
Author(s):  
Véronique Normand ◽  
Didier Pernel ◽  
Béatrice Bacconnet

The Thomson-CSF Corporate Research Laboratories are investigating the issues of user-interface design, spoken and multimodal interaction design and realization in virtual environments. This paper describes our technical approach to speech-enabled multimodal virtual environments, based on our past achievements in the multimodal interaction domain, and presents our main supporting projects in this area. These projects involve augmented reality for maintenance, military situation building and assessment, and collaborative virtual environments.


Sign in / Sign up

Export Citation Format

Share Document