Model-Based Design for Multimodal Interaction in a VE

Author(s):  
Karin Coninx ◽  
Joan De Boeck ◽  
Chris Raymaekers ◽  
Lode Vanacken

The creation of virtual environments is often a lengthy and expensive process. Especially defining the interaction dialog between the user and the environment is a difficult task, as the communication is often multimodal by nature. In this chapter, we elaborate on an approach which facilitates the development of this kind of user interfaces. In particular, we propose a model-based user interface design process (MBUID), in which the interface is defined by means of high level notations, rather than by writing low level programming code. The approach lifts the design to a higher level of abstraction, resulting in a shortened development cycle leaving the opportunity for creating intermediate prototypes and user evaluation, ultimately resulting in better and cheaper virtual environment interfaces.

2014 ◽  
Author(s):  
Sofia Larissa Da Costa ◽  
Valdemar Vicente Graciano Neto ◽  
Juliano Lopes De Oliveira ◽  
Bruno dos Reis Calçado

This paper presents a model-based approach to build Information Systems User Interfaces (ISUI). In this approach, UI presentation and behavioral aspects are modeled as UI Stereotypes, which are high level abstractions of UI appearance and interaction features. A taxonomy of ISUI elements is proposed as the basis for definition of UI stereotypes. These elements are orchestrated on a software architecture which manages model-based UI building and integration with the IS applications. The proposed approach reduces software development efforts and costs, facilitating maintenance and evolution of ISUI. Moreover, UI stereotypes improve usability, consistency, reuse and standardization of both presentation and behavior of ISUI.


Formalization approaches of user interface design (UID) in conjunction with model driven techniques aim to improve the usability in terms of conformity to standards or style guides and to leverage code generation of interactive software systems, so that various UI platforms for web, desktop or mobile Applications are supported. Because large parts of the UI are described platform independent instead of platform dependent implementations, re-usability of the UI concept is also improved. However, UI formalization requires the usage of a formal UI description language and a higher level of abstractness compared to concrete UI code. These languages need to be learned by the UI designer. In practice, most parts of a user interface are still manually designed and coded individually for every platform. This paper describes how HCI (Human Computer Interface) patterns that are described formally can be used in conjunction with model-based user interface design in order to make it easier for the designer to use formalization techniques for the development of user interfaces. The approach uses two UML profiles: The MBUID (Model-Based User Interface Design) profile and the HCI pattern profile. With these profiles formal models of interactive systems can be created on a platform independent level. The user interface is then automatically generated by model-driven development tool chain.


Author(s):  
Bruce G. Coury ◽  
John Sadowsky ◽  
Paul R. Schuster ◽  
Michael Kurnow ◽  
Marcus J. Huber ◽  
...  

Reducing the burden of interacting with complex systems has been a long standing goal of user interface design. In our approach to this problem, we have been developing user interfaces that allow users to interact with complex systems in a natural way and in high-level, task-related terms. These capabilities help users concentrate on making important decisions without the distractions of manipulating systems and user interfaces. To attain such a goal, our approach uses a unique combination of multi-modal interaction and interaction planning. In this paper, we motivate the basis for our approach, we describe the user interface technologies we have developed, and briefly discuss the relevant research and development issues.


2018 ◽  
Vol 14 (1) ◽  
pp. 107-122
Author(s):  
Pietro Murano

Purpose This paper aims to present a new user interface design for text proofreading portals in a digitization and crowdsourcing context. Several of the current proofreading portals lack usability in their user interfaces. The aim of the new design is to increase user performance and satisfaction. Design/methodology/approach An empirical experiment has been conducted to evaluate the new user interface as a comparison with 18thConnect – TypeWright proofreading portal. Two of the main measures involved times and errors and this approach is considered to be good for these kinds of measures allowing a good degree of control. Nevertheless, personal opinions are also very important and these are elicited by means of a post-experiment questionnaire. Findings The data were statistically analysed and overall the new user interface helped users to perform better in terms of task time. Errors were also better with the new user interface, but the differences were not statistically significant. Furthermore, users were more satisfied with the new user interface. User satisfaction measures were mostly statistically significant. Originality/value As far as has been ascertained, there have been no systematic studies evaluating a new design with an existing design of a proofreading portal. Therefore, this research is considered to be original, and if implemented widely, it would be very valuable to the mass digitization aims.


Author(s):  
Sybille Caffiau ◽  
Patrick Girard

In user interface design, model-driven approaches usually involve generative solutions, producing interface by successive transformations of a set of initial models. These approaches have obvious limitations, especially for advanced user interfaces. Moreover, top-down design approaches (as generative approaches are) are not appropriate for interactive application development in which users need to be included in the whole design process. Based on strong associations between task models and dialogue models, the authors propose a global process, which facilitates the design of interactive applications conforming to their models, including a rule-checking step. This process permits either to start from a task model or a user-defined prototype. In any case, it allows an iterative development, including iterative user modifications, in line with user-centered design standards.


2018 ◽  
pp. 119-137
Author(s):  
Alan Radley

A new philosophy of user interface design is described. Named the “Lookable User Interface,” or LUI, the approach is based on the concept of a Personal Reality (PR) system. Here the computer adapts to the user's worldview in a personalized way, and according to the specific requirements, behaviors, and perceptive skills of the individual. Typically, a PR system creates and adjusts (in real-time) 3D perspective view(s) of a data-set, including (potentially) the field of view of a scene and the apparent distance and scale of objects, whilst also creating an aesthetic “eye-friendly” context for computing operations. A Lookable User Interface (LUI) affords the maximum degree of visual accessibility to digital content. The authors examine the results of testing a Lookable User Interface. Spectasia is one example of a Personal Virtual Reality (PVR) that can be used to visualize links between universals and particulars within digital worlds.


2009 ◽  
pp. 127-142
Author(s):  
Stefano Forti ◽  
Barbara Purin ◽  
Claudio Eccher

This chapter presents a case study of using interaction design methods for exploring and testing usability and user experience of a Personal Health Record (PHR) user interface based on visual and graphical elements. To identify problems and improve the design of PHR user interface we conducted two taskoriented usability testing based on the think-aloud technique for observing users during their interaction with a high-fidelity PHR prototype, and questionnaires and semistructured interviews for measuring user satisfaction. Our study demonstrates that a user-centered approach to interaction design involving the final users in an iterative design-evaluation process is important for exploring innovative user interfaces and for identification of problems in the early stages of the development cycle of a PHR.


Author(s):  
Alan Radley

A new philosophy of user interface design is described. Named the “Lookable User Interface,” or LUI, the approach is based on the concept of a Personal Reality (PR) system. Here the computer adapts to the user's worldview in a personalized way, and according to the specific requirements, behaviors, and perceptive skills of the individual. Typically, a PR system creates and adjusts (in real-time) 3D perspective view(s) of a data-set, including (potentially) the field of view of a scene and the apparent distance and scale of objects, whilst also creating an aesthetic “eye-friendly” context for computing operations. A Lookable User Interface (LUI) affords the maximum degree of visual accessibility to digital content. The authors examine the results of testing a Lookable User Interface. Spectasia is one example of a Personal Virtual Reality (PVR) that can be used to visualize links between universals and particulars within digital worlds.


Sign in / Sign up

Export Citation Format

Share Document