scholarly journals A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility

2020 ◽  
Vol 4 (4) ◽  
pp. 84
Author(s):  
Diyar Gür ◽  
Niklas Schäfer ◽  
Mario Kupnik ◽  
Philipp Beckerle
Keyword(s):  
Haptic Feedback ◽  
Measurement Unit ◽  
Input Devices ◽  
Text Input ◽  
Word Level ◽  
Prediction Function ◽  
Mouse Pointer ◽  
People With Physical Disabilities ◽  
Contact Pressures ◽  
Keyboard Layout

People with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard. Head motions are mapped to mouse pointer positions, while mouse button actions are triggered by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace the conventional keyboard. To allow for complex text entry, the sensory concept is complemented by an ambiguous keyboard layout with ten keys. The related word prediction function provides disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as well as the emulation of a two-button mouse.

Virtual Reality: A Tool for Assembly?

2000 ◽  
Vol 9 (5) ◽  
pp. 486-496 ◽  
Author(s):  
A. C. Boud ◽  
C. Baber ◽  
S. J. Steiner
Keyword(s):  
Virtual Reality ◽  
Virtual Environments ◽  
Haptic Feedback ◽  
Object Manipulation ◽  
Task Planning ◽  
Input Devices ◽  
Assembly Task ◽  
Current Input

This paper reports on an investigation into the proposed usability of virtual reality for a manufacturing application such as the assembly of a number of component parts into a final product. Before the assembly task itself is considered, the investigation explores the use of VR for the training of human assembly operators and compares the findings to conventionally adopted techniques for parts assembly. The investigation highlighted several limitations of using VR technology. Most significant was the lack of haptic feedback provided by current input devices for virtual environments. To address this, an instrumented object (IO) was employed that enabled the user to pick up and manipulate the IO as the representation of a component from a product to be assembled. The reported findings indicate that object manipulation times are superior when IOs are employed as the interaction device, and that IO devices could therefore be adopted in VEs to provide haptic feedback for diverse applications and, in particular, for assembly task planning.

scholarly journals A Wearable Sensor System for Physical Ergonomics Interventions Using Haptic Feedback

Sensors ◽  
2020 ◽  
Vol 20 (21) ◽  
pp. 6010
Author(s):  
Carl Mikael Lind ◽  
Jose Antonio Diaz-Olivares ◽  
Kaj Lindecrantz ◽  
Jörgen Eklund
Keyword(s):  
Haptic Feedback ◽  
Structured Interview ◽  
Measurement Unit ◽  
Upper Arm ◽  
Feedback Training ◽  
Work Related ◽  
Work Related Musculoskeletal Disorders ◽  
Physical Ergonomics ◽  
Manual Handling ◽  
Work Technique

Work-related musculoskeletal disorders are a major concern globally affecting societies, companies, and individuals. To address this, a new sensor-based system is presented: the Smart Workwear System, aimed at facilitating preventive measures by supporting risk assessments, work design, and work technique training. The system has a module-based platform that enables flexibility of sensor-type utilization, depending on the specific application. A module of the Smart Workwear System that utilizes haptic feedback for work technique training is further presented and evaluated in simulated mail sorting on sixteen novice participants for its potential to reduce adverse arm movements and postures in repetitive manual handling. Upper-arm postures were recorded, using an inertial measurement unit (IMU), perceived pain/discomfort with the Borg CR10-scale, and user experience with a semi-structured interview. This study shows that the use of haptic feedback for work technique training has the potential to significantly reduce the time in adverse upper-arm postures after short periods of training. The haptic feedback was experienced positive and usable by the participants and was effective in supporting learning of how to improve postures and movements. It is concluded that this type of sensorized system, using haptic feedback training, is promising for the future, especially when organizations are introducing newly employed staff, when teaching ergonomics to employees in physically demanding jobs, and when performing ergonomics interventions.

scholarly journals User-Experience with Haptic Feedback Technologies and Text Input in Interactive Multimedia Devices

Sensors ◽  
2020 ◽  
Vol 20 (18) ◽  
pp. 5316
Author(s):  
Bruno Silva ◽  
Hugo Costelha ◽  
Luis C. Bento ◽  
Marcio Barata ◽  
Pedro Assuncao
Keyword(s):  
Remote Control ◽  
Haptic Feedback ◽  
Positive Impact ◽  
Subjective Evaluation ◽  
Evaluation Study ◽  
User Preferences ◽  
Feedback Effects ◽  
User Input ◽  
Text Input ◽  
Control Devices

Remote control devices are commonly used for interaction with multimedia equipment and applications (e.g., smart TVs, gaming, etc.). To improve conventional keypad-based technologies, haptic feedback and user input capabilities are being developed for enhancing the UX and providing advanced functionalities in remote control devices. Although the sensation provided by haptic feedback is similar to mechanical push buttons, the former offers much greater flexibility, due to the possibility of dynamically choosing different mechanical effects and associating different functions to each of them. However, selecting the best haptic feedback effects among the wide variety that is currently enabled by recent technologies, remains a challenge for design engineers aiming to optimise the UX. Rich interaction further requires text input capability, which greatly influences the UX. This work is a contribution towards UX evaluation of remote control devices with haptic feedback and text input. A user evaluation study of a wide variety of haptic feedback effects and text input methods is presented, considering different technologies and different number of actuators on a device. The user preferences, given by subjective evaluation scores, demonstrate that haptic feedback has undoubtedly a positive impact on the UX. Moreover, it is also shown that different levels of UX are obtained, according to the technological characteristics of the haptic actuators and how many of them are used on the device.

scholarly journals  Progress in the Triboelectric Human–Machine Interfaces (HMIs)-Moving from Smart Gloves to AI/Haptic Enabled HMI in the 5G/IoT Era

2021 ◽  
Vol 1 (1) ◽  
pp. 81-120
Author(s):  
Zhongda Sun ◽  
Minglu Zhu ◽  
Chengkuo Lee
Keyword(s):  
Smart Home ◽  
Haptic Feedback ◽  
Sensory Information ◽  
Complementary Metal Oxide Semiconductor ◽  
Oxide Semiconductor ◽  
Measurement Unit ◽  
Triboelectric Nanogenerator ◽  
Wearable Robot ◽  
Human Machine Interfaces ◽  
Self Powered

Entering the 5G and internet of things (IoT) era, human–machine interfaces (HMIs) capable of providing humans with more intuitive interaction with the digitalized world have experienced a flourishing development in the past few years. Although the advanced sensing techniques based on complementary metal-oxide-semiconductor (CMOS) or microelectromechanical system (MEMS) solutions, e.g., camera, microphone, inertial measurement unit (IMU), etc., and flexible solutions, e.g., stretchable conductor, optical fiber, etc., have been widely utilized as sensing components for wearable/non-wearable HMIs development, the relatively high-power consumption of these sensors remains a concern, especially for wearable/portable scenarios. Recent progress on triboelectric nanogenerator (TENG) self-powered sensors provides a new possibility for realizing low-power/self-sustainable HMIs by directly converting biomechanical energies into valuable sensory information. Leveraging the advantages of wide material choices and diversified structural design, TENGs have been successfully developed into various forms of HMIs, including glove, glasses, touchpad, exoskeleton, electronic skin, etc., for sundry applications, e.g., collaborative operation, personal healthcare, robot perception, smart home, etc. With the evolving artificial intelligence (AI) and haptic feedback technologies, more advanced HMIs could be realized towards intelligent and immersive human–machine interactions. Hence, in this review, we systematically introduce the current TENG HMIs in the aspects of different application scenarios, i.e., wearable, robot-related and smart home, and prospective future development enabled by the AI/haptic-feedback technology. Discussion on implementing self-sustainable/zero-power/passive HMIs in this 5G/IoT era and our perspectives are also provided.

scholarly journals A custom virtual reality training solution for ophthalmologic surgical clinical trials

2021 ◽  
Vol 6 (1) ◽  
Author(s):  
Felix Heimann ◽  
Giulio Barteselli ◽  
André Brand ◽  
Andreas Dingeldey ◽  
Laszlo Godard ◽  
...  
Keyword(s):  
Clinical Trials ◽  
Virtual Reality ◽  
Haptic Feedback ◽  
Physical Simulation ◽  
Development Program ◽  
Simulation Models ◽  
Simulator Training ◽  
Phase Iii ◽  
Input Devices ◽  
Hand Piece

AbstractWe present a summary of the development and clinical use of two custom designed high-fidelity virtual-reality simulator training platforms. This simulator development program began in 2016 to support the phase III clinical trial Archway (ClinicalTrials.gov identifier, NCT03677934) intended to evaluate the Port Delivery System (PDS) developed by Genentech Inc. and has also been used to support additional clinical trials. The two simulators address two specific ophthalmic surgical procedures required for the successful use of PDS and provide state-of-the-art physical simulation models and graphics. The simulators incorporate customized active haptic feedback input devices that approximate different hand pieces including a custom hand piece specifically designed for PDS implantation. We further describe the specific challenges of the procedure and the development of corresponding training strategies realized within the simulation platform.

Collecting Words: A Clinical Example of a Morphology-Focused Orthographic Intervention

2020 ◽  
Vol 51 (3) ◽  
pp. 544-560 ◽  
Author(s):  
Kimberly A. Murphy ◽  
Emily A. Diehm
Keyword(s):  
Written Language ◽  
Morphological Knowledge ◽  
English Orthography ◽  
Word Level ◽  
Novel Approach ◽  
Language Pathology ◽  
The One ◽  
Critical Intervention ◽  
Reading And Spelling ◽  
Reading And Spelling Difficulties

Purpose Morphological interventions promote gains in morphological knowledge and in other oral and written language skills (e.g., phonological awareness, vocabulary, reading, and spelling), yet we have a limited understanding of critical intervention features. In this clinical focus article, we describe a relatively novel approach to teaching morphology that considers its role as the key organizing principle of English orthography. We also present a clinical example of such an intervention delivered during a summer camp at a university speech and hearing clinic. Method Graduate speech-language pathology students provided a 6-week morphology-focused orthographic intervention to children in first through fourth grade ( n = 10) who demonstrated word-level reading and spelling difficulties. The intervention focused children's attention on morphological families, teaching how morphology is interrelated with phonology and etymology in English orthography. Results Comparing pre- and posttest scores, children demonstrated improvement in reading and/or spelling abilities, with the largest gains observed in spelling affixes within polymorphemic words. Children and their caregivers reacted positively to the intervention. Therefore, data from the camp offer preliminary support for teaching morphology within the context of written words, and the intervention appears to be a feasible approach for simultaneously increasing morphological knowledge, reading, and spelling. Conclusion Children with word-level reading and spelling difficulties may benefit from a morphology-focused orthographic intervention, such as the one described here. Research on the approach is warranted, and clinicians are encouraged to explore its possible effectiveness in their practice. Supplemental Material https://doi.org/10.23641/asha.12290687

Factors Influencing Cognate Performance for Young Multilingual Children's Vocabulary: A Research Synthesis

2020 ◽  
Vol 29 (4) ◽  
pp. 2170-2188
Author(s):  
Lindsey R. Squires ◽  
Sara J. Ohlfest ◽  
Kristen E. Santoro ◽  
Jennifer L. Roberts
Keyword(s):  
Test Validity ◽  
Reaction Times ◽  
Bilingual Children ◽  
Second Grade ◽  
High Quality Research ◽  
Word Level ◽  
Research Questions ◽  
Word Characteristics ◽  
Study Inclusion ◽  
Task Level

Purpose The purpose of this systematic review was to determine evidence of a cognate effect for young multilingual children (ages 3;0–8;11 [years;months], preschool to second grade) in terms of task-level and child-level factors that may influence cognate performance. Cognates are pairs of vocabulary words that share meaning with similar phonology and/or orthography in more than one language, such as rose – rosa (English–Spanish) or carrot – carotte (English–French). Despite the cognate advantage noted with older bilingual children and bilingual adults, there has been no systematic examination of the cognate research in young multilingual children. Method We conducted searches of multiple electronic databases and hand-searched article bibliographies for studies that examined young multilingual children's performance with cognates based on study inclusion criteria aligned to the research questions. Results The review yielded 16 articles. The majority of the studies (12/16, 75%) demonstrated a positive cognate effect for young multilingual children (measured in higher accuracy, faster reaction times, and doublet translation equivalents on cognates as compared to noncognates). However, not all bilingual children demonstrated a cognate effect. Both task-level factors (cognate definition, type of cognate task, word characteristics) and child-level factors (level of bilingualism, age) appear to influence young bilingual children's performance on cognates. Conclusions Contrary to early 1990s research, current researchers suggest that even young multilingual children may demonstrate sensitivity to cognate vocabulary words. Given the limits in study quality, more high-quality research is needed, particularly to address test validity in cognate assessments, to develop appropriate cognate definitions for children, and to refine word-level features. Only one study included a brief instruction prior to assessment, warranting cognate treatment studies as an area of future need. Supplemental Material https://doi.org/10.23641/asha.12753179

Sign in / Sign up

Export Citation Format

Share Document