Towards a Unified and Efficient Command Selection Mechanism for Touch-Based Devices Using Soft Keyboard Hotkeys

We advocate for the usage of hotkeys on touch-based devices by capitalising on soft keyboards through four studies. First, we evaluated visual designs and recommended icons with command names for novices while letters with command names for experts. Second, we investigated the discoverability by asking crowdworkers to use our prototype, with some tasks only doable upon successfully discovering the technique. Discovery rates were high regardless of conditions that vary the familiarity and saliency of modifier keys. However, familiarity with desktop hotkeys boosted discoverability. Our third study focused on how prior knowledge of hotkeys could be leveraged and resulted in a 5% selection time improvement and identified the role of spatial memory in retention. Finally, we compared our soft keyboard layout with a grid layout similar to FastTap. The latter offered a 12–16% gain on selection speed, but at a high cost in terms of screen estate and low spatial stability.

Eye gaze controlled adaptive virtual keyboard for users with SSMI

BACKGROUND: Users with Severe Speech and Motor Impairment (SSMI) often use a communication chart through their eye gaze or limited hand movement and care takers interpret their communication intent. There is already significant research conducted to automate this communication through electronic means. Developing electronic user interface and interaction techniques for users with SSMI poses significant challenges as research on their ocular parameters found that such users suffer from Nystagmus and Strabismus limiting number of elements in a computer screen. This paper presents an optimized eye gaze controlled virtual keyboard for English language with an adaptive dwell time feature for users with SSMI. OBJECTIVE: Present an optimized eye gaze controlled English virtual keyboard that follows both static and dynamic adaptation process. The virtual keyboard can automatically adapt to reduce eye gaze movement distance and dwell time for selection and help users with SSMI type better without any intervention of an assistant. METHODS: Before designing the virtual keyboard, we undertook a pilot study to optimize screen region which would be most comfortable for SSMI users to operate. We then proposed an optimized two-level English virtual keyboard layout through Genetic algorithm using static adaptation process; followed by dynamic adaptation process which tracks users’ interaction and reduces dwell time based on a Markov model-based algorithm. Further, we integrated the virtual keyboard for a web-based interactive dashboard that visualizes real-time Covid data. RESULTS: Using our proposed virtual keyboard layout for English language, the average task completion time for users with SSMI was 39.44 seconds in adaptive condition and 29.52 seconds in non-adaptive condition. Overall typing speed was 16.9 lpm (letters per minute) for able-bodied users and 6.6 lpm for users with SSMI without using any word completion or prediction features. A case study with an elderly participant with SSMI found a typing speed of 2.70 wpm (words per minute) and 14.88 lpm (letters per minute) after 6 months of practice. CONCLUSIONS: With the proposed layout for English virtual keyboard, the adaptive system increased typing speed statistically significantly for able bodied users than a non-adaptive version while for 6 users with SSMI, task completion time reduced by 8.8% in adaptive version than nonadaptive one. Additionally, the proposed layout was successfully integrated to a web-based interactive visualization dashboard thereby making it accessible for users with SSMI.

Engram: A Systematic Approach to Optimize Keyboard Layouts for Touch Typing, With Example for the English Language

Most computer keyboard layouts (mappings of characters to keys) do not reflect the ergonomics of the human hand, resulting in preventable repetitive strain injuries. We present a set of ergonomics principles relevant to touch typing, introduce a scoring model that encodes these principles, and outline a systematic approach for developing optimized keyboard layouts in any language based on this scoring model coupled with character-pair frequencies. We then create a keyboard layout optimized for touch typing in English by constraining key assignments to reduce lateral finger movements and enforce easy access to high-frequency letters and letter pairs, applying open source software to generate millions of layouts, and evaluating them based on Google’s N-gram data. We use two independent scoring methods to compare the resulting Engram layout against 10 other prominent keyboard layouts based on a variety of publicly available text sources. The Engram layout scores consistently higher than other keyboard layouts.

The Spanish and Portuguese Keyboards, the Best Options to Type in all Romance Languages for US-QWERTY Users

While adequate for English-speaking users in the United States, as well as many Commonwealth countries and other English-speaking jurisdictions (e.g., Canada, Australia, New Zealand or South Africa among others), typing in Romance Languages (Spanish, French, Portuguese and Italian) by using a standard US-QWERTY Keyboard is not easy since it is not adapted to special characters such as accented vowels, tildes and cedillas or ligatures, used in Romance Languages. With regard to the International Layout, intended to enable access to the most common diacritics used in Western European Languages, the problem comes from the fact that accented vowels are spread throughout the Keyboard layout, and their uppercase versions need chord combinations which can require good manual dexterity. This paper will analyze how the Spanish or Portuguese Keyboards are the best options for these users since they are QWERTY-based and the most compatible ones for the different character sets in Spanish, French, Portuguese and Italian Languages.

The Effects of Keyboard Layout and Size on Smartphone Typing Performance

Usability and typing performance on a smartphone with two unique QWERTY keyboard layouts (standard vs. curved) on two phone sizes (4.0-inch vs. 5.5-inch displays) was investigated in this study. The effect of hand posture was also investigated (one- vs. two-thumbs). Results show users typed the slowest when using one thumb with the curved keyboard on the small phone (15 WPM), and the fastest when using two thumbs with the standard keyboard on the large phone (24 WPM). Typing performance with the curved keyboard on the large phone size (19 WPM) did not differ between typing with one thumb using the standard keyboard on the large or small phone, or with two thumbs using the standard keyboard on the small phone. Error rates were higher when using the curved keyboard, regardless of phone size. Subjectively, the curved keyboard was rated inferior for both phone sizes in comparison to the standard layout.

A Human–Computer Interface Replacing Mouse and Keyboard for Individuals with Limited Upper Limb Mobility

People with physical disabilities in their upper extremities face serious issues in using classical input devices due to lacking movement possibilities and precision. This article suggests an alternative input concept and presents corresponding input devices. The proposed interface combines an inertial measurement unit and force sensing resistors, which can replace mouse and keyboard. Head motions are mapped to mouse pointer positions, while mouse button actions are triggered by contracting mastication muscles. The contact pressures of each fingertip are acquired to replace the conventional keyboard. To allow for complex text entry, the sensory concept is complemented by an ambiguous keyboard layout with ten keys. The related word prediction function provides disambiguation at word level. Haptic feedback is provided to users corresponding to their virtual keystrokes for enhanced closed-loop interactions. This alternative input system enables text input as well as the emulation of a two-button mouse.