Touchless InteractionUsing Magnetometer for Mobile Games

This paper proposes an alternative method for conducting touchless interaction. Using a magnetometer sensor, we attempt to map some common gestures into something that can be understood by a magnetometer sensor. To demonstrate the concept, an application and a punching game that utilize this principlewere developed. Using the application, usersareable to perform a common swiping gesture using a magnetometer sensor. When the gamedetects a punch gesture, it will respond accordingly. The application was tested and compared against an existing touchless interaction technology. The test results showed that there are some aspects where the magnetometer solution is better compared to the existing solution. This suggests that touchless interaction using magnetometersmight have a promising future.

Gesture-controlled image system positioning for minimally invasive interventions

This work examines how a touchless interaction concept contributes to an efficient, direct, and sterile interaction workflow during CT-guided interventions. Two hand gesture sets were designed specifically under consideration of the clinical workflow and the hardware capabilities. These were used to change the position of an X-Ray tube and detector of a CT scanner without breaking sterility and are compared regarding usability and performance in a user study with 10 users. The user study revealed that it is possible to change the angle of the gantry within 10 seconds average in an experimental setup. A straight hand gesture showed higher acceptance than a pistol motivated gesture. Furthermore, the sequences were not optimal and confused the users. It turned out that it feels more natural to activate and confirm the system with the same gesture.

Gesture-Based User Interface for Vehicle On-Board System: A Questionnaire and Research Approach

Touchless interaction with electronic devices using gestures is gaining popularity and along with speech-based communication offers their users natural and intuitive control methods. Now, these interaction modes go beyond the entertainment industry and are successfully applied in real-life scenarios such as a car interior. In the paper, we analyse the potential of hand gesture interaction in the vehicle environment by physically challenged drivers. A survey conducted with potential users shows that the knowledge of gesture-based interaction and its practical use by people with disabilities is low. Based on these results we proposed a gesture-based system for vehicle on-board system. It has been developed on the available state-of-the-art solutions and investigated in terms of usability on a group of people with different physical limitations who drive a car on daily basis mostly using steering aid tools. The obtained results are compared with the performance of users without any disabilities.

Comparison of Kinect and Leap Motion for Intraoperative Image Interaction

Background. Touchless interaction devices have increasingly garnered attention for intraoperative imaging interaction, but there are limited recommendations on which touchless interaction mechanisms should be implemented in the operating room. The objective of this study was to evaluate the efficiency, accuracy, and satisfaction of 2 current touchless interaction mechanisms—hand motion and body motion for intraoperative image interaction. Methods. We used the TedCas plugin for ClearCanvas DICOM viewer to display and manipulate CT images. Ten surgeons performed 5 image interaction tasks—step-through, pan, zoom, circle measure, and line measure—on the 3 input interaction devices—the Microsoft Kinect, the Leap Motion, and a mouse. Results. The Kinect shared similar accuracy with the Leap Motion for most of the tasks. But it had an increased error rate in the step-through task. The Leap Motion led to shorter task completion time than the Kinect and was preferred by the surgeons, especially for the measure tasks. Discussion. Our study suggests that hand tracking devices, such as the Leap Motion, should be used for intraoperative imagining manipulation tasks that require high precision.