scholarly journals Identification of Words and Phrases Through a Phonemic-Based Haptic Display

2021 ◽  
Vol 18 (3) ◽  
pp. 1-22
Author(s):  
Charlotte M. Reed ◽  
Hong Z. Tan ◽  
Yang Jiao ◽  
Zachary D. Perez ◽  
E. Courtenay Wilson

Stand-alone devices for tactile speech reception serve a need as communication aids for persons with profound sensory impairments as well as in applications such as human-computer interfaces and remote communication when the normal auditory and visual channels are compromised or overloaded. The current research is concerned with perceptual evaluations of a phoneme-based tactile speech communication device in which a unique tactile code was assigned to each of the 24 consonants and 15 vowels of English. The tactile phonemic display was conveyed through an array of 24 tactors that stimulated the dorsal and ventral surfaces of the forearm. Experiments examined the recognition of individual words as a function of the inter-phoneme interval (Study 1) and two-word phrases as a function of the inter-word interval (Study 2). Following an average training period of 4.3 hrs on phoneme and word recognition tasks, mean scores for the recognition of individual words in Study 1 ranged from 87.7% correct to 74.3% correct as the inter-phoneme interval decreased from 300 to 0 ms. In Study 2, following an average of 2.5 hours of training on the two-word phrase task, both words in the phrase were identified with an accuracy of 75% correct using an inter-word interval of 1 sec and an inter-phoneme interval of 150 ms. Effective transmission rates achieved on this task were estimated to be on the order of 30 to 35 words/min.

1982 ◽  
Vol 26 (5) ◽  
pp. 435-435
Author(s):  
Dennis B. Beringer ◽  
Susan R. Maxwell

Interest in optimized human-computer interfaces has resulted in the development of a number of interesting devices that allow the computer and human operator to interact through a common drawing surface. These devices include the lightpen, lightgun (Goodwin, 1975), and a variety of touch-sensitive display overlay devices. Although touch devices were being investigated as early as 1965 (Orr and Hopkin, circa 1966), behavioral and performance data are scarce in relation to other sources of human-machine interface data. Availability of these devices has increased in the last 10 years and it is now possible to retrofit such devices to a wide variety of video display terminals at a reasonable cost. With the possibility of increased use looming on the horizon, it would be quite useful to examine the ergonomics of such devices and the behavioral adaptation or maladaptation that occurs for each user. Performance data available at this point from previous studies suggests that some positive increments in performance can be expected for graphic-based tasks while no serious decrements should be expected for discrete data entry tasks (Beringer, 1980; Stammers and Bird, 1980). The performance gains expected from this format of interaction are not to be won without some sacrifice elsewhere, however. Positioning of the display surface for optimum viewing may cause serious operator fatigue problems after extended use of the device if the device is to be used with relatively high frequency. The relationship of device positioning, device sensing resolution, and task type are being examined as they contribute to the comission of errors and the onset of fatigue. Experimentation was planned to examine how positioning of the device, or what can truly be called a “control/display unit”, affected the performance of visual discrimination tasks and manual designation tasks. Initial investigations used a single task to examine these questions by requiring the operator/subject to visually detect and manually designate the location of a break in one of 54 circles presented on a color c.r.t. display (essentially a Landholt C target). Responses were accepted by an infrared touch panel mounted on the display face. The c.r.t. was placed at four declinations during the blocks of trials; 90, 67, 45, and 35 degrees to the line of sight. Although a very strong learning effect was observed over the first 8 blocks of 25 trials each, performance leveled off, on the average, beginning with the ninth block of trials. No reliable effects of screen declination were found in the examination of response times or number of errors. Responses did tend to be located slightly lower than the target, however, for the greater declinations of the display surface. Subjective reports of physical difficulty of responding and fatigue did vary regularly with declination of the display. The relatively high location of the device resulted in shoulder and arm fatigue when the display was at 90 degrees and wrist fatigue when the display was at 35 degrees. Subsequent phases of the investigation will allow subjects to adjust parameters of height and declination (Brown and Schaum, 1980) and will use hand skin temperature and quantified postural information to assess the degree of fatigue incurred during device operation.


2021 ◽  
Vol 5 (10) ◽  
pp. 64
Author(s):  
Miguel Angel Garcia-Ruiz ◽  
Bill Kapralos ◽  
Genaro Rebolledo-Mendez

This paper describes an overview of olfactory displays (human–computer interfaces that generate and diffuse an odor to a user to stimulate their sense of smell) that have been proposed and researched for supporting education and training. Past research has shown that olfaction (the sense of smell) can support memorization of information, stimulate information recall, and help immerse learners and trainees into educational virtual environments, as well as complement and/or supplement other human sensory channels for learning. This paper begins with an introduction to olfaction and olfactory displays, and a review of techniques for storing, generating and diffusing odors at the computer interface. The paper proceeds with a discussion on educational theories that support olfactory displays for education and training, and a literature review on olfactory displays that support learning and training. Finally, the paper summarizes the advantages and challenges regarding the development and application of olfactory displays for education and training.


Sign in / Sign up

Export Citation Format

Share Document