Eye gaze controlled adaptive virtual keyboard for users with SSMI

2021 ◽  
pp. 1-20
Author(s):  
Jeevithashree DV ◽  
Puneet Jain ◽  
Abhishek Mukhopadhyay ◽  
Kamal Preet Singh Saluja ◽  
Pradipta Biswas
Keyword(s):  
Completion Time ◽  
Dwell Time ◽  
English Language ◽  
Eye Gaze ◽  
Task Completion ◽  
Adaptation Process ◽  
Web Based ◽  
Virtual Keyboard ◽  
Adaptive Condition ◽  
Keyboard Layout

BACKGROUND: Users with Severe Speech and Motor Impairment (SSMI) often use a communication chart through their eye gaze or limited hand movement and care takers interpret their communication intent. There is already significant research conducted to automate this communication through electronic means. Developing electronic user interface and interaction techniques for users with SSMI poses significant challenges as research on their ocular parameters found that such users suffer from Nystagmus and Strabismus limiting number of elements in a computer screen. This paper presents an optimized eye gaze controlled virtual keyboard for English language with an adaptive dwell time feature for users with SSMI. OBJECTIVE: Present an optimized eye gaze controlled English virtual keyboard that follows both static and dynamic adaptation process. The virtual keyboard can automatically adapt to reduce eye gaze movement distance and dwell time for selection and help users with SSMI type better without any intervention of an assistant. METHODS: Before designing the virtual keyboard, we undertook a pilot study to optimize screen region which would be most comfortable for SSMI users to operate. We then proposed an optimized two-level English virtual keyboard layout through Genetic algorithm using static adaptation process; followed by dynamic adaptation process which tracks users’ interaction and reduces dwell time based on a Markov model-based algorithm. Further, we integrated the virtual keyboard for a web-based interactive dashboard that visualizes real-time Covid data. RESULTS: Using our proposed virtual keyboard layout for English language, the average task completion time for users with SSMI was 39.44 seconds in adaptive condition and 29.52 seconds in non-adaptive condition. Overall typing speed was 16.9 lpm (letters per minute) for able-bodied users and 6.6 lpm for users with SSMI without using any word completion or prediction features. A case study with an elderly participant with SSMI found a typing speed of 2.70 wpm (words per minute) and 14.88 lpm (letters per minute) after 6 months of practice. CONCLUSIONS: With the proposed layout for English virtual keyboard, the adaptive system increased typing speed statistically significantly for able bodied users than a non-adaptive version while for 6 users with SSMI, task completion time reduced by 8.8% in adaptive version than nonadaptive one. Additionally, the proposed layout was successfully integrated to a web-based interactive visualization dashboard thereby making it accessible for users with SSMI.

scholarly journals MouseView.js: Reliable and valid attention tracking in web-based experiments using a cursor-directed aperture

2021 ◽  
Author(s):  
Alexander L. Anwyl-Irvine ◽  
Thomas Armstrong ◽  
Edwin S. Dalmaijer
Keyword(s):  
Eye Tracking ◽  
Dwell Time ◽  
Peripheral Vision ◽  
Eye Gaze ◽  
Psychological Research ◽  
Self Report ◽  
Web Based ◽  
Participant Recruitment ◽  
Free Viewing ◽  
Psychological Experiments

AbstractPsychological research is increasingly moving online, where web-based studies allow for data collection at scale. Behavioural researchers are well supported by existing tools for participant recruitment, and for building and running experiments with decent timing. However, not all techniques are portable to the Internet: While eye tracking works in tightly controlled lab conditions, webcam-based eye tracking suffers from high attrition and poorer quality due to basic limitations like webcam availability, poor image quality, and reflections on glasses and the cornea. Here we present MouseView.js, an alternative to eye tracking that can be employed in web-based research. Inspired by the visual system, MouseView.js blurs the display to mimic peripheral vision, but allows participants to move a sharp aperture that is roughly the size of the fovea. Like eye gaze, the aperture can be directed to fixate on stimuli of interest. We validated MouseView.js in an online replication (N = 165) of an established free viewing task (N = 83 existing eye-tracking datasets), and in an in-lab direct comparison with eye tracking in the same participants (N = 50). Mouseview.js proved as reliable as gaze, and produced the same pattern of dwell time results. In addition, dwell time differences from MouseView.js and from eye tracking correlated highly, and related to self-report measures in similar ways. The tool is open-source, implemented in JavaScript, and usable as a standalone library, or within Gorilla, jsPsych, and PsychoJS. In sum, MouseView.js is a freely available instrument for attention-tracking that is both reliable and valid, and that can replace eye tracking in certain web-based psychological experiments.

Age-Related Decrements in Automobile Instrument Panel Task Performance

1989 ◽  
Vol 33 (3) ◽  
pp. 159-163 ◽  
Author(s):  
Brian C. Hayes ◽  
Ko Kurokawa ◽  
Walter W. Wierwille
Keyword(s):  
Task Performance ◽  
Completion Time ◽  
Dwell Time ◽  
Age Groups ◽  
Instrument Panel ◽  
Task Completion ◽  
Task Completion Time ◽  
Age Related ◽  
Instrumented Vehicle ◽  
And Task

This research was undertaken, in part, to determine the magnitudes of performance decrements associated with automotive instrument panel tasks as a function of driver age. Driver eye scanning and dwell time measures and task completion measures were collected while 24 drivers aged 18 to 72 performed a variety of instrument panel tasks as each drove an instrumented vehicle along preselected routes. The results indicated a monotonically increasing relationship between driver age and task completion time and the number of glances to the instrument panel. Mean glance dwell times, either to the roadway or the instrument, were not significantly different among the various age groups. The nature of these differences for the various task categories used in the present study was examined.

The evaluation of eye gaze using an eye tracking system in simulation training of real-time ultrasound-guided venipuncture

2021 ◽  
pp. 112972982098736
Author(s):  
Kaji Tatsuru ◽  
Yano Keisuke ◽  
Onishi Shun ◽  
Matsui Mayu ◽  
Nagano Ayaka ◽  
...  
Keyword(s):  
Medical Students ◽  
Eye Tracking ◽  
Success Rate ◽  
Real Time ◽  
Completion Time ◽  
Tracking System ◽  
Eye Gaze ◽  
Task Completion ◽  
Short Axis ◽  
The Us

Purpose: Real-time ultrasound (RTUS)-guided central venipuncture using the short-axis approach is complicated and likely to result in losing sight of the needle tip. Therefore, we focused on the eye gaze in our evaluation of the differences in eye gaze between medical students and experienced participants using an eye tracking system. Methods: Ten medical students (MS group), five residents (R group) and six pediatric surgeon fellows (F group) performed short-axis RTUS-guided venipuncture simulation using a modified vessel training system. The eye gaze was captured by the tracking system (Tobii Eye Tacker 4C) and recorded. The evaluation endpoints were the task completion time, total time and number of occurrences of the eye tracking marker outside US monitor and success rate of venipuncture. Result: There were no significant differences in the task completion time and total time of the tracking marker outside the US monitor. The number of occurrences of the eye tracking marker outside US monitor in the MS group was significantly higher than in the F group (MS group: 9.5 ± 3.4, R group: 6.0 ± 2.9, F group: 5.2 ± 1.6; p  = 0.04). The success rate of venipuncture in the R group tended to be better than in the F group. Conclusion: More experienced operators let their eye fall outside the US monitor fewer times than less experienced ones. The eye gaze was associated with the success rate of RTUS-guided venipuncture. Repeated training while considering the eye gaze seems to be pivotal for mastering RTUS-guided venipuncture.

scholarly journals MouseView.js: Reliable and valid attention tracking in web-based experiments using a cursor-directed aperture

2021 ◽  
Author(s):  
Alexander Leslie Anwyl-Irvine ◽  
Thomas Armstrong ◽  
Edwin S. Dalmaijer
Keyword(s):  
Eye Tracking ◽  
Dwell Time ◽  
Peripheral Vision ◽  
Eye Gaze ◽  
Psychological Research ◽  
Self Report ◽  
Web Based ◽  
Participant Recruitment ◽  
Free Viewing ◽  
Psychological Experiments

Psychological research is increasingly moving online, where web-based studies allow for data collection at scale. Behavioural researchers are well-supported by existing tools for participant recruitment, and for building and running experiments with decent timing. However, not all techniques are portable to the internet: While eye tracking works in tightly controlled conditions in the lab, webcam-based eye tracking suffers from high attrition and poorer quality due to basic limitations like webcam availability, poor image quality, and reflections on glasses and the cornea. Here we present MouseView.js, an alternative to eye tracking that can be employed in web-based attention research. Inspired by the visual system, MouseView.js blurs the display to mimic peripheral vision, but allows participants to move a sharp aperture that is roughly the size of the fovea. Like eye gaze, the aperture can be directed to fixate on stimuli of interest. We validated MouseView.js in an online version (N=165) of an established free viewing task (N=83), where it proved as reliable as gaze, and produced the same pattern of dwell time results. In addition, dwell time differences from MouseView.js and from previous gaze studies correlated with self-report measures in similar ways. The tool is open-source, implemented in JavaScript, and usable within Gorilla and jsPsych, or as standalone library. In sum, MouseView.js is a freely available instrument for attention-tracking that is both reliable and valid, and that can replace eye tracking in certain web-based psychological experiments.

A Review on the Application of Blog, Blogger, Widget and Hypertext to Develop a Web-Based Instructional Tool

2019 ◽  
Vol 1 (2) ◽  
pp. 54
Author(s):  
Boon Yih Mah ◽  
Suzana Ab Rahim
Keyword(s):  
Second Language ◽  
Perceptual Learning ◽  
User Interfaces ◽  
English Language ◽  
Learning Preferences ◽  
Graphical Form ◽  
Instructional Tool ◽  
Web Based ◽  
Writing Skill ◽  
The Impact

The use of the internet for teaching and learning has become a global trend among the education practitioners over the recent decades. The integration of technology and media into Malaysian English as a Second Language (ESL) classrooms has altered the methods in English Language Teaching (ELT). In response to the impact of technology in ELT, the needs of a supplementary instructional platform, and the limitations of the learning management system (LMS) in fostering second language (L2) writing skill, a web-based instructional tool was designed and developed based on a theoretical-and-pedagogical framework namely Web-based Cognitive Writing Instruction (WeCWI). To determine the key concepts while identifying the research gap, this study conducted a literature review using online search on specific keywords including “blog”, “Blogger”, “widget”, and “hyperlink” found in the scholarly articles. Based on the review of literature, Blogger was opted due to its on-screen customisable layout editing features that can be embedded with web widgets and hypertext that share the identical features. By looking into the relationship between perceptual learning preferences on perceived information and the visual representations in iconic and symbolic views, the blogs can come with two different user interfaces embedded with web widgets or hypertext. The blog with web widgets appears in a graphical form of iconic view; while hypertext only displays textual form of symbolic view without involving the visual references. With the injection of web widgets and hypertext into the blogs, WeCWI attempts to offer a technological enhanced ELT solution to overcome the poor writing skill with a better engagement while learning online through the learners’ preferred perceptual learning preferences.

The Effects of Language Barriers and Time Constraints on Online Learning Performance: An Eye-Tracking Study

2021 ◽  
pp. 001872082110109
Author(s):  
Auður Anna Jónsdóttir ◽  
Ziho Kang ◽  
Tianchen Sun ◽  
Saptarshi Mandal ◽  
Ji-Eun Kim
Keyword(s):  
Online Learning ◽  
Eye Movement ◽  
Completion Time ◽  
Language Use ◽  
Time Pressure ◽  
Time Constraints ◽  
Task Completion ◽  
Esl Students ◽  
Task Completion Time ◽  
Eye Fixation

Objective The goal of this study is to model the effect of language use and time pressure on English as a first language (EFL) and English as a second language (ESL) students by measuring their eye movements in an on-screen, self-directed learning environment. Background Online learning is becoming integrated into learners’ daily lives due to the flexibility in scheduling and location that it offers. However, in many cases, the online learners often have no interaction with one another or their instructors, making it difficult to determine how the learners are reading the materials and whether they are learning effectively. Furthermore, online learning may pose challenges to those who face language barriers or are under time pressure. Method The effects of two factors, language use (EFL vs. ESL) and time constraints (high vs. low time pressure), were investigated during the presentation of online materials. The effects were analyzed based on eye movement measures (eye fixation rate—the total number of eye fixations divided by the task duration and gaze entropy) and behavioral measures (correct rate and task completion time). Results The results show that the ESL students had higher eye fixation rates and longer task completion times than the EFL students. Moreover, high time pressure resulted in high fixation rates, short task completion time, low correct rates, and high gaze entropy. Conclusion and Application The results suggest the possibility of using unobtrusive eye movement measures to develop ways to better assist those who struggle with learning in the online environment.

Correlation Between Gestures’ Qualitative Properties and Usa- bility metrics

2020 ◽  
Vol 64 (1) ◽  
pp. 726-730
Author(s):  
Daniela Chanci ◽  
Naveen Madapana ◽  
Glebys Gonzalez ◽  
Juan Wachs
Keyword(s):  
Linear Regression ◽  
User Satisfaction ◽  
Completion Time ◽  
User Study ◽  
Task Completion ◽  
Time Error ◽  
Qualitative Properties ◽  
Regression Techniques ◽  
Overall Efficiency ◽  
Usability Metrics

The choice of best gestures and commands for touchless interfaces is a critical step that determines the user- satisfaction and overall efficiency of surgeon computer interaction. In this regard, usability metrics such as task completion time, error rate, and memorability have a long-standing as potential entities in determining the best gesture vocabulary. In addition, some previous works concerned with this problem have utilized qualitative measures to identify the best gesture. In this work, we hypothesize that there is a correlation between the qualitative properties of gestures (v) and their usability metrics (u). Therefore, we conducted an experiment with linguists to quantify the properties of the gestures. Next, a user study was conducted with surgeons, and the usability metrics were measured. Lastly, linear and non-linear regression techniques were used to find the correlations between u and v. Results show that usability metrics are correlated with the gestures’ qualitative properties ( R2 = 0.4).

scholarly journals Bandwidth-Aware Rescheduling Mechanism in SDN-Based Data Center Networks

Electronics ◽  
2021 ◽  
Vol 10 (15) ◽  
pp. 1774
Author(s):  
Ming-Chin Chuang ◽  
Chia-Cheng Yen ◽  
Chia-Jui Hung
Keyword(s):  
Data Center ◽  
Completion Time ◽  
Network Performance ◽  
Data Locality ◽  
Task Completion ◽  
Data Center Networks ◽  
Task Completion Time ◽  
Data Packets ◽  
Network Bandwidth ◽  
Data Process

Recently, with the increase in network bandwidth, various cloud computing applications have become popular. A large number of network data packets will be generated in such a network. However, most existing network architectures cannot effectively handle big data, thereby necessitating an efficient mechanism to reduce task completion time when large amounts of data are processed in data center networks. Unfortunately, achieving the minimum task completion time in the Hadoop system is an NP-complete problem. Although many studies have proposed schemes for improving network performance, they have shortcomings that degrade their performance. For this reason, in this study, we propose a centralized solution, called the bandwidth-aware rescheduling (BARE) mechanism for software-defined network (SDN)-based data center networks. BARE improves network performance by employing a prefetching mechanism and a centralized network monitor to collect global information, sorting out the locality data process, splitting tasks, and executing a rescheduling mechanism with a scheduler to reduce task completion time. Finally, we used simulations to demonstrate our scheme’s effectiveness. Simulation results show that our scheme outperforms other existing schemes in terms of task completion time and the ratio of data locality.

Sign in / Sign up

Export Citation Format

Share Document