Live demonstration: BioSleeve, a wearable hands-free gesture control interface

Author(s):  
Chris Assad ◽  
Jaakko Karras ◽  
Javier Rodriguez ◽  
Eli Pivo ◽  
Calvin Huang ◽  
...  
2013 ◽  
Vol 73 (1) ◽  
pp. 491-517 ◽  
Author(s):  
Marcel Alcoverro ◽  
Xavier Suau ◽  
Josep R. Morros ◽  
Adolfo López-Méndez ◽  
Albert Gil ◽  
...  

Author(s):  
Dominic Canare ◽  
Barbara Chaparro ◽  
Alex Chaparro

Novel input devices can increase the bandwidth between users and their devices. Traditional desktop computing uses windows, icons, menus, and pointers – an interface built for the computer mouse and very effective for pointing-and-clicking. Alternative devices provide a variety of interactions including touch-free, gesture-based input and gaze-tracking to determine the user’s on-screen gaze location, but these input channels are not well-suited to a point-and-click interface. This study evaluates five new schemes, some multi-modal. These experimental schemes perform worse than mouse-based input for a picture sorting task, and motion-based gesture control creates more errors. Some gaze-based input has similar performance to the mouse while not creating additional workload.


2018 ◽  
Vol 49 (5) ◽  
pp. 497-514 ◽  
Author(s):  
Abdullah Alsalemi ◽  
Mohammed Al Disi ◽  
Yahya Alhomsi ◽  
Fayçal Bensaali ◽  
Abbes Amira ◽  
...  

Background.Simulation-based learning (SBL) employs the synergy between technology and people to immerse learners in highly-realistic situations in order to achieve quality clinical education. Due to the ever-increasing popularity of extracorporeal membrane oxygenation (ECMO) SBL, there is a pressing need for a proper technological infrastructure that enables high-fidelity simulation to better train ECMO specialists to deal with related emergencies. In this article, we tackle the control aspect of the infrastructure by presenting and evaluating an innovative cloud-based instructor, simulator controller, and simulation operations specialist application that enables real-time remote control of full-scale immersive ECMO simulation experiences for ECMO specialists as well as creating custom simulation scenarios for standardized training of individual healthcare professionals or clinical teams. Aim. This article evaluates the intuitiveness, responsiveness, and convenience of the ECMO instructor application as a viable ECMO simulator control interface. Method. A questionnaire-based usability study was conducted following institutional ethical approval. Nineteen ECMO practitioners were given a live demonstration of the instructor application in the context of an ECMO simulator demonstration during which they also had the opportunity to interact with it. Participants then filled in a questionnaire to evaluate the ECMO instructor application as per intuitiveness, responsiveness, and convenience. Results. The collected feedback data confirmed that the presented application has an intuitive, responsive, and convenient ECMO simulator control interface. Conclusion. The present study provided evidence signifying that the ECMO instructor application is a viable ECMO simulator control interface. Next steps will comprise a pilot study evaluating the educational efficacy of the instructor application in the clinical context with further technical enhancements as per participants’ feedback.


2020 ◽  
Vol 17 (3) ◽  
pp. 036025
Author(s):  
Jiayuan He ◽  
Manas Vijay Joshi ◽  
Jason Chang ◽  
Ning Jiang

Life becomes less complex, resourceful and very educative thanks to the use of smart devices like the Myo armband and Nao robots. This work discusses about the use of Myo Armband which is a wireless device for interacting with other devices such as computer, robots. It uses myographic sensor signals to control the robot. This involves developing a digital control interface to control the robot with the help of Myo Gesture Control Armband System. A PC loaded with Ubuntu OS acts as a control unit. It interfaces the inputs of the Myo band to control the Nao robot, thereby we can control the movement of the Nao robot by using its interactions. In this case we use Nao, an educational robot. PyoConnect is a Linux alternative to MyoConnect a scripting software for programming the Myo band in Windows. The Pyoconnect software is used to connect the Myo with the Ubuntu operating system. NAOqi is a programming framework used to program the NAO. By importing the NAOqi module in the python script we can access the different functions of the Nao robot. Nao robot which supports network communication protocols are Ethernet and Wi-Fi. The interface between Nao and Myo is achieved through IP (Internet Protocol). Based on the hand gestures recorded by Myo armband, the Nao Robot Arm’s can be controlled


Author(s):  
Jason Sterkenburg ◽  
Steven Landry ◽  
Myounghoon Jeon ◽  
Joshua Johnson

A pilot study was conducted to explore the potential of sonically-enhanced gestures as controls for future in-vehicle information systems (IVIS). Four concept menu systems were developed using a LEAP Motion and Pure Data: (1) 2x2 with auditory feedback, (2) 2x2 without auditory feedback, (3) 4x4 with auditory feedback, and (4) 4x4 without auditory feedback. Seven participants drove in a simulator while completing simple target-acquisition tasks using each of the four prototype systems. Driving performance and eye glance behavior were collected as well as subjective ratings of workload and system preference. Results from driving performance and eye tracking measures strongly indicate that the 2x2 grids yield better driving safety outcomes than 4x4 grids. Subjective ratings show similar patterns for driver workload and preferences. Auditory feedback led to similar improvements in driving performance and eye glance behavior as well as subjective ratings of workload and preference, compared to visual-only.


Author(s):  
Marco Hirsch ◽  
Jingyuan Cheng ◽  
Attila Reiss ◽  
Mathias Sundholm ◽  
Paul Lukowicz ◽  
...  
Keyword(s):  

Sign in / Sign up

Export Citation Format

Share Document