Experiments with Adaptable Multimodal User Interfaces for Mobile Devices

2011 ◽  
pp. 9-16
Author(s):  
Andreas Truar ◽  
Norbert Kuhn
Keyword(s):  
Mobile Devices ◽  
User Interfaces ◽  
Multimodal User Interfaces

Mobility and Multimodal User Interfaces

2009 ◽  
pp. 1213-1222
Author(s):  
Christopher J. Pavlovski ◽  
Stella Mitchell
Keyword(s):  
User Interface ◽  
Mobile Devices ◽  
Mobile Phones ◽  
User Interfaces ◽  
Interface Design ◽  
User Interface Design ◽  
Internet Applications ◽  
Multimodal User Interfaces ◽  
Natural Solution ◽  
General Mobility

Traditional user interface design generally deals with the problem of enhancing the usability of a particular mode of user interaction, and a large body of literature exists concerning the design and implementation of graphical user interfaces. When considering the additional constraints that smaller mobile devices introduce, such as mobile phones and PDAs, an intuitive and heuristic user interface design is more difficult to achieve. Multimodal user interfaces employ several modes of interaction; this may include text, speech, visual gesture recognition, and haptics. To date, systems that employ speech and text for application interaction appear to be the mainstream multimodal solutions. There is some work on the design of multimodal user interfaces for general mobility accommodating laptops or desktop computers (Sinha & Landay, 2002). However, advances in multimodal technology to accommodate the needs of smaller mobile devices, such as mobile phones and portable digital assistants, are still emerging. Mobile phones are now commonly equipped with the mechanics for visual browsing of Internet applications, although their small screens and cumbersome text input methods pose usability challenges. The use of a voice interface together with a graphical interface is a natural solution to several challenges that mobile devices present. Such interfaces enable the user to exploit the strengths of each mode in order to make it easier to enter and access data on small devices. Furthermore, the flexibility offered by multiple modes for one application allows users to adapt their interactions based on preference and on environmental setting. For instance, handsfree speech operation may be conducted while driving, whereas graphical interactions can be adopted in noisy surroundings or when private data entry, such as a password, is required in a public environment. In this article we discuss multimodal technologies that address the technical and usability constraints of the mobile phone or PDA. These environments pose several additional challenges over general mobility solutions. This includes computational strength of the device, bandwidth constraints, and screen size restrictions. We outline the requirements of mobile multimodal solutions involving cellular phones. Drawing upon several trial deployments, we summarize the key designs points from both a technology and usability standpoint, and identify the outstanding problems in these designs. We also outline several future trends in how this technology is being deployed in various application scenarios, ranging from simple voice-activated search engines through to comprehensive mobile office applications.

scholarly journals Behavior and usability analysis for multimodal user interfaces

2021 ◽  
Author(s):  
Hamdi Dibeklioğlu ◽  
Elif Surer ◽  
Albert Ali Salah ◽  
Thierry Dutoit
Keyword(s):  
User Interfaces ◽  
Usability Analysis ◽  
Multimodal User Interfaces

scholarly journals Intelligent User Interfaces for Mobile Computing

2009 ◽  
pp. 2614-2626
Author(s):  
Michael J. O’Grady ◽  
Gregory M.P. O’Hare
Keyword(s):  
Mobile Computing ◽  
Mobile Devices ◽  
User Interfaces ◽  
Intelligence Quotient ◽  
Intelligent Agent ◽  
Mobile Services ◽  
Practical Issue ◽  
Intelligent User Interfaces ◽  
Software Engineers ◽  
New Generation

In this chapter, the practical issue of realizing a necessary intelligence quotient for conceiving intelligent user interfaces (IUIs) on mobile devices is considered. Mobile computing scenarios differ radically from the normal fixed workstation environment that most people are familiar with. It is in this dynamicity and complexity that the key motivations for realizing IUIs on mobile devices may be found. Thus, the chapter initially motivates the need for the deployment of IUIs in mobile contexts by reflecting on the archetypical elements that comprise the average mobile user’s situation or context. A number of broad issues pertaining to the deployment of AI techniques on mobile devices are considered before a practical realisation of this objective through the intelligent agent paradigm is presented. It is the authors hope that a mature understanding of the mobile computing usage scenario, augmented with key insights into the practical deployment of AI in mobile scenarios, will aid software engineers and HCI professionals alike in the successful utilisation of intelligent techniques for a new generation of mobile services.

Mobile and Handheld Security

2010 ◽  
pp. 313-327
Author(s):  
Lei Chen ◽  
Shaoen Wu ◽  
Yiming Ji ◽  
Ming Yang
Keyword(s):  
Mobile Devices ◽  
Operating Systems ◽  
User Interfaces ◽  
Work Life ◽  
Handheld Devices ◽  
Security Level ◽  
Security Services ◽  
Business Transactions ◽  
Bank Accounts ◽  
Online Bank

Mobile and handheld devices are becoming an integral part of people’s work, life and entertainment. These lightweight pocket-sized devices offer great mobility, acceptable computation power and friendly user interfaces. As people are making business transactions and managing their online bank accounts via handheld devices, they are concerned with the security level that mobile devices and systems provide. In this chapter we will discuss whether these devices, equipped with very limited computation power compared to full-sized computers, can make equivalent security services available to users. We focus on the security designs and technologies of hardware, operating systems and applications for mobile and handheld devices.

Mobility and Multimodal User Interfaces

2008 ◽  
pp. 996-1005
Author(s):  
Christopher J. Pavlovski ◽  
Stella Mitchell
Keyword(s):  
Mobile Phone ◽  
User Interfaces ◽  
Search Engines ◽  
Cellular Phones ◽  
Future Trends ◽  
Screen Size ◽  
Multimodal User Interfaces ◽  
Mobile Office ◽  
General Mobility

In this article we discuss multimodal technologies that address the technical and usability constraints of the mobile phone or PDA. These environments pose several additional challenges over general mobility solutions. This includes computational strength of the device, bandwidth constraints, and screen size restrictions. We outline the requirements of mobile multimodal solutions involving cellular phones. Drawing upon several trial deployments, we summarize the key designs points from both a technology and usability standpoint, and identify the outstanding problems in these designs. We also outline several future trends in how this technology is being deployed in various application scenarios, ranging from simple voice-activated search engines through to comprehensive mobile office applications.

Sign in / Sign up

Export Citation Format

Share Document