Methodology based on Computer Vision and Machine Learning to guide the Design of Augmentative and Alternative Communication Systems using Personalized Gestural Interaction

2021 ◽  
Author(s):  
Rúbia E. O. Schultz Ascari ◽  
Luciano Silva ◽  
Roberto Pereira
Keyword(s):  
Machine Learning ◽  
Computer Vision ◽  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Alternative Communication ◽  
Gestural Interaction

Instruction Using Augmentative and Alternative Communication Supports: Description of Current Practices by Speech-Language Pathologists Who Work With Children With Autism Spectrum Disorder

2020 ◽  
Vol 29 (2) ◽  
pp. 586-596 ◽  
Author(s):  
Kaitlyn A. Clarke ◽  
Diane L. Williams
Keyword(s):  
Autism Spectrum Disorder ◽  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Diagnostic Category ◽  
Children With Autism ◽  
Autism Spectrum ◽  
Spectrum Disorder ◽  
Alternative Communication ◽  
Speech Language Pathologists ◽  
Processing Differences

Purpose The aim of this research study was to examine common practices of speech-language pathologists (SLPs) who work with children with autism spectrum disorder (ASD) with respect to whether or not SLPs consider processing differences in ASD or the effects of input during their instruction. Method Following a qualitative research method, how SLPs instruct and present augmentative and alternative communication systems to individuals with ASD, their rationale for method selection, and their perception of the efficacy of selected interventions were probed. Semistructured interviews were conducted as part of an in-depth case report with content analysis. Results Based on completed interviews, 4 primary themes were identified: (a) instructional method , (b) input provided , (c) decision-making process , and (d) perceived efficacy of treatment . Additionally, one secondary theme, training and education received , was identified . Conclusions Clinicians reported making decisions based on the needs of the child; however, they also reported making decisions based on the diagnostic category that characterized the child (i.e., ASD). The use of modeling when teaching augmentative and alternative communication to individuals with ASD emerged as a theme, but variations in the method of modeling were noted. SLPs did not report regularly considering processing differences in ASD, nor did they consider the effects of input during instruction.

Thoughts on Grammar Intervention in AAC

2008 ◽  
Vol 17 (2) ◽  
pp. 43-49 ◽  
Author(s):  
Marc Fey
Keyword(s):  
Language Impairment ◽  
Specific Language Impairment ◽  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Target Language ◽  
Alternative Communication ◽  
Physical Limitations ◽  
Communication Needs ◽  
Communication Interventions ◽  
Planning Intervention

Abstract In this article, I propose that, for several reasons, grammar should be an early focus of communication interventions for young children using augmentative and alternative communication (AAC) systems. The basic goals for such programs should be to facilitate the child's comprehension of the language of the community, or the target language, thus leading the way to literacy, and to foster the child's use of symbol combinations that mirror the grammatical patterns of speaking children acquiring the target language, even if they cannot be fully grammatically complete. I introduce five principles that underlie most successful approaches to grammar interventions with children with specific language impairment. My initial attempts to apply these principles to interventions with children with complex communication needs indicate that they may be of considerable value to clinicians planning intervention programs. On the other hand, the challenges posed by the intellectual and physical limitations of many AAC users and their communication systems make it necessary to modify at least Principle 5 if the basic goals of intervention are to be met.

scholarly journals Implementation of conventional communication system in deep learning

2017 ◽  
Vol 7 (1.1) ◽  
pp. 696
Author(s):  
Satyanarayana P ◽  
Charishma Devi. V ◽  
Sowjanya P ◽  
Satish Babu ◽  
N Syam Kumar ◽  
...  
Keyword(s):  
Machine Learning ◽  
Computer Vision ◽  
Communication Network ◽  
Deep Learning ◽  
Communication System ◽  
Communication Systems ◽  
Physical Layer ◽  
Learning Capacity ◽  
Constrained Learning ◽  
Complex Channel

Machine learning (ML) has been broadly connected to the upper layers of communication systems for different purposes, for example, arrangement of cognitive radio and communication network. Nevertheless, its application to the physical layer is hindered by complex channel conditions and constrained learning capacity of regular ML algorithms. Deep learning (DL) has been as of late connected for some fields, for example, computer vision and normal dialect preparing, given its expressive limit and advantageous enhancement ability. This paper describes about a novel use of DL for the physical layer. By deciphering a communication system as an auto encoder, we build up an essential better approach to consider communication system outline as a conclusion to-end reproduction undertaking that tries to together enhance transmitter and receiver in a solitary procedure. This DL based technique demonstrates promising execution change than traditional communication system.  

Guidelines for Teaching Speech-Language Pathologists About the AAC Assessment Process

2011 ◽  
Vol 20 (3) ◽  
pp. 82-86
Author(s):  
Iris Fishman
Keyword(s):  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Feature Matching ◽  
Assessment Process ◽  
High Tech ◽  
Alternative Communication ◽  
Team Process ◽  
Basic Principles ◽  
Communication Needs ◽  
The Individual

Abstract Although students may not become augmentative and alternative communication (AAC) clinical specialists, they often will work with individuals demonstrating complex communication needs who benefit from AAC. This necessitates knowledge of some basic principles of assessment including AAC assessment as a team process involving planning and implementing interventions for current and future communication needs; the inclusion of no-tech, low-tech, and high-tech communication systems; and assessing communication needs with partners in the individual's social network. The assessment also must include a capability profile and feature matching to select the appropriate components of the AAC system. Because the system we provide for today will become the system we use tomorrow, assessment must be considered an ongoing process throughout the lifespan of the individual.

scholarly journals Tracking and Classification of Head Movement for Augmentative and Alternative Communication Systems

Sensors ◽  
2022 ◽  
Vol 22 (2) ◽  
pp. 435
Author(s):  
Carlos Wellington P. Gonçalves ◽  
Rogério A. Richa ◽  
Antonio P. L. Bo
Keyword(s):  
Neurological Disorders ◽  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Markov Models ◽  
Assistive Technologies ◽  
Alternative Communication ◽  
Functional Movement ◽  
Involuntary Movements ◽  
Motor Disabilities

The use of assistive technologies can mitigate or reduce the challenges faced by individuals with motor disabilities to use computer systems. However, those who feature severe involuntary movements often have fewer options at hand. This work describes an application that can recognize the user’s head using a conventional webcam, track its motion, model the desired functional movement, and recognize it to enable the use of a virtual keyboard. The proposed classifier features a flexible structure and may be personalized for different user need. Experimental results obtained with participants with no neurological disorders have shown that classifiers based on Hidden Markov Models provided similar or better performance than a classifier based on position threshold. However, motion segmentation and interpretation modules were sensitive to involuntary movements featured by participants with cerebral palsy that took part in the study.

scholarly journals Design and Implementation of an Augmentative and Alternative Communication System Based on MATLAB GUI

2021 ◽  
Vol 2113 (1) ◽  
pp. 012032
Author(s):  
Zihe Wang ◽  
Boyu Si ◽  
Jingwen Wang
Keyword(s):  
Communication Skills ◽  
Social Communication ◽  
Communication System ◽  
Augmentative And Alternative Communication ◽  
Communication Systems ◽  
Word List ◽  
Augmentative Communication ◽  
Single Subject ◽  
Alternative Communication ◽  
Training Tool

Abstract In clinical practice, augmentative and alternative communication (AAC) is an effective training tool to improve the communication skills of individuals with language impairment, hearing impairment, and autism. However, there are few studies on the development of augmentative communication systems based on Mandarin Chinese in China. This study presents an augmentative communication system developed using the MATLAB GUI platform. The system consists of two parts: a learning part and a communication part, where the learning part provides the basis of the vocabulary content for the system, covering 5558 words, and its content is mainly a word list designed based on the content of special school language textbooks. The communication part provides the system with a complete discourse training content, mainly by arranging and combining the vocabulary content of the learning part to form a complete discourse. This aided communication system can expand the vocabulary of people with language expression disorders and improve their social communication skills. In addition, the effectiveness of the system was tested in a single-subject experiment, and the results showed that the augmentative communication system is effective in learning pronunciation, expanding vocabulary, and improving the social communication.

Sign in / Sign up

Export Citation Format

Share Document