Multimodal Interfaces of Human–Computer Interaction

In this paper we describe how existing software developing processes, such as Rational Unified Process, can be adapted in order to allow disciplined and more efficient development of user interfaces. The main objective of this paper is to demonstrate that standard modeling environments, based on the UML, can be adapted and efficiently used for user interfaces development. We have integrated the HCI knowledge into developing processes by semantically enriching the models created in each of the process activities of the process. By using UML, we can make easier use of HCI knowledge for ordinary software engineers who, usually, are not familiar with results of HCI researches, so these results can have broader and more practical effects. By providing a standard means for representing human computer interaction, we can seamlessly transfer UML models of multimodal interfaces between design and specialized analysis tools. Standardization provides a significant driving force for further progress because it codifies best practices enables and encourages reuse, and facilitates inter working between complementary tools. Proposed solutions can be valuable for software developers, who can improve quality of user interfaces and their communication with user interface designers, as well as for human computer interaction researchers, who can use standard methods to include their results into software developing processes.

Download Full-text

Advanced Multimodal Frameworks to Support Human-Computer Interaction on Social Computing Environments

Advances in Human and Social Aspects of Technology - Social Computing Theory and Practice ◽

10.4018/978-1-61692-904-6.ch011 ◽

2011 ◽

pp. 215-241

Author(s):

Danilo Avola ◽

Andrea Del Buono ◽

Angelo Spognardi

Keyword(s):

Human Computer Interaction ◽

Social Computing ◽

Multimodal Interfaces ◽

Wide Spread ◽

Computational Capability ◽

The Social ◽

Fast Network ◽

Computing Environments ◽

Algorithmic Approaches ◽

Computer Interaction

In recent years, the growing improvements of the computational capability of the mobile and desktop devices, jointly to the potentialities of the current fast network connections have allowed the wide spread of advanced and complex applications and services belonging to the social computing area. The most current approaches used to interact with this kind of applications and services (hereinafter called social computing environments) do not seem able to provide an effective and exhaustive support to the human-computer interaction process. For this reason, in order to overcome this kind of problems, it is necessary to turn to more suitable interaction methodologies. In this context, human-oriented interfaces can be profitably used to support every kind of social computing environment. More specifically, multimodal interfaces enable users an effortless and powerful communication way to represent concepts and commands on different mobile and desktop devices. This chapter explores the more suitable possibilities to employ multimodal frameworks (and related algorithmic approaches) in order to interact with different kinds of social computing environments.

Download Full-text

MuMIA: Multimodal Interactions to Better Understand Art Contexts

Applied Sciences ◽

10.3390/app11062695 ◽

2021 ◽

Vol 11 (6) ◽

pp. 2695

Author(s):

George E. Raptis ◽

Giannis Kavvetsos ◽

Christina Katsini

Keyword(s):

Human Computer Interaction ◽

Cultural Heritage ◽

Evaluation Study ◽

Multimodal Interfaces ◽

Interactive System ◽

Visitor Experience ◽

Multimodal Interactions ◽

Key Factor ◽

Natural Interactions ◽

Computer Interaction

Cultural heritage is a challenging domain of application for novel interactive technologies, where varying aspects in the way that cultural assets are delivered play a major role in enhancing the visitor experience, either onsite or online. Technology-supported natural human–computer interaction that is based on multimodalities is a key factor in enabling wider and enriched access to cultural heritage assets. In this paper, we present the design and evaluation of an interactive system that aims to support visitors towards a better understanding of art contexts through the use of a multimodal interface, based on visual and audio interactions. The results of the evaluation study shed light on the dimensions of evoking natural interactions within cultural heritage environments, using micro-narratives for self-exploration and understanding of cultural content, and the intersection between human–computer interaction and artificial intelligence within cultural heritage. We expect our findings to provide useful insights for practitioners and researchers of the broad human–computer interaction and cultural heritage communities on designing and evaluating multimodal interfaces to better support visitor experiences.

Download Full-text