Introduction to the Special Issue on Highlights of ACM Intelligent User Interface (IUI) 2019

Because advances in broadband capabilities will soon allow first responders to access and use many forms of data when responding to emergencies, it is becoming critically important to design heads-up displays to present first responders with information in a manner that does not induce extraneous mental workload or cause undue interaction errors. Virtual reality offers a unique medium for envisioning and testing user interface concepts in a realistic and controlled environment. In this paper, we describe a virtual reality-based emergency response scenario that was designed to support user experience research for evaluating the efficacy of intelligent user interfaces for firefighters. We describe the results of a usability test that captured firefighters’ feedback and reactions to the VR scenario and the prototype intelligent user interface that presented them with task critical information through the VR headset. The paper concludes with lessons learned from our development process and a discussion of plans for future research.

Download Full-text

Human–robot interaction via voice-controllable intelligent user interface

Robotica ◽

10.1017/s0263574707003414 ◽

2007 ◽

Vol 25 (5) ◽

pp. 521-527 ◽

Cited By ~ 12

Author(s):

Harsha Medicherla ◽

Ali Sekmen

Keyword(s):

User Interface ◽

User Interfaces ◽

Spatial Reasoning ◽

User Preferences ◽

Human Robot Interaction ◽

Manual Control ◽

Reasoning Ability ◽

Robot Interaction ◽

Intelligent User Interface ◽

Voice Control

SUMMARYAn understanding of how humans and robots can successfully interact to accomplish specific tasks is crucial in creating more sophisticated robots that may eventually become an integral part of human societies. A social robot needs to be able to learn the preferences and capabilities of the people with whom it interacts so that it can adapt its behaviors for more efficient and friendly interaction. Advances in human– computer interaction technologies have been widely used in improving human–robot interaction (HRI). It is now possible to interact with robots via natural communication means such as speech. In this paper, an innovative approach for HRI via voice-controllable intelligent user interfaces is described. The design and implementation of such interfaces are described. The traditional approaches for human–robot user interface design are explained and the advantages of the proposed approach are presented. The designed intelligent user interface, which learns user preferences and capabilities in time, can be controlled with voice. The system was successfully implemented and tested on a Pioneer 3-AT mobile robot. 20 participants, who were assessed on spatial reasoning ability, directed the robot in spatial navigation tasks to evaluate the effectiveness of the voice control in HRI. Time to complete the task, number of steps, and errors were collected. Results indicated that spatial reasoning ability and voice-control were reliable predictors of efficiency of robot teleoperation. 75% of the subjects with high spatial reasoning ability preferred using voice-control over manual control. The effect of spatial reasoning ability in teleoperation with voice-control was lower compared to that of manual control.

Download Full-text

Cloud-Based Intelligent User Interface for Cloud Manufacturing: Model, Technology, and Application

Journal of Manufacturing Science and Engineering ◽

10.1115/1.4030332 ◽

2015 ◽

Vol 137 (4) ◽

Cited By ~ 19

Author(s):

Lei Ren ◽

Jin Cui ◽

Ni Li ◽

Qiong Wu ◽

Cuixia Ma ◽

...

Keyword(s):

User Interface ◽

Manufacturing Industry ◽

Multimodal Interaction ◽

Cloud Manufacturing ◽

Domain Specific ◽

Intelligent User Interface ◽

Usability Problems ◽

Key Characteristics ◽

Industry Practice ◽

Service Oriented

Cloud manufacturing is gradually transforming the way enterprises do business from traditional production-oriented manufacturing to service-oriented manufacturing. The development of cloud manufacturing in industry practice is closely related to domain-specific user experience. The huge amount of users with diverse roles and various requirements in manufacturing industry are facing great challenges of cloud system usability problems. Thus, user interface issues play a significant role in pushing this new area forward. In this paper, we discuss the key characteristics of intelligent user interface (IUI) for cloud manufacturing, i.e., naturality, smart mobility, self-configuration, and flexible customization. Further, a cloud-plus-IUI model for cloud end-users is presented. Then we discuss the enabling technologies, i.e., automatic configuration based on virtualization, context-aware adaption and recommendation, and multimodal interaction. Finally, we present SketchPart, a sketch-based pad system prototype for searching part drawings in the cloud, to show the advantages of the proposed cloud-plus-IUI solution.

Download Full-text