Recording and Transcribing Interactions of Individuals Using Augmentative Communication Technologies

The purpose of this article is to provide the reader with tools and recommendations for collecting data and making microanalytic transcriptions of interaction involving people using Augmentative Communication Technologies (ACTs). This is of interest for clinicians, as well as anyone else engaged in video-based microanalysis of technology mediated interaction in other contexts. The information presented here has particular relevance to young researchers developing their own methodologies, and experienced scientists interested in social interaction research in ACTs or as well as other digital communication technologies. Tools and methods for recording social interactions to support microanalysis by making unobtrusive recordings of naturally occurring or task-driven social interactions while minimizing recording-related distractions which could alter the authenticity of the social interaction are discussed. Recommendations for the needed functionality of video and audio recording equipment are made with tips for how to capture actions that are important to the research question as opposed to capturing 'generally usable' video. In addition, tips for processing video and managing video data are outlined, including how to develop optimally functional naming conventions for stored videos, how and where to store video data (i. e. use of external hard drives, compressing videos for storage) and syncing multiple videos, offering different views of a single interaction (i. e. syncing footage of the overall interaction with footage of the device display). Finally, tools and strategies for transcription are discussed including a brief description of the role transcription plays in analysis, a suggested framework for how transcription might proceed through multiple passes, each focused on a different aspect of communication, transcription software options along with discussion of specific features that aide transcription. In addition, special issues that arise in transcribing interactions involving ACTs are addressed.

Fish Swarm Optimized Deep Hopfield Neural Network-Assisted HCI System for Augmentative Communication Using a Visual Feedback System

In this context, the uses of computers, the Human-computer interface (HCI) system, can assist interaction on-demand services. HCI method facilitates ventilated patients to interact with computers about their needs using their brain’s electrical activity. To accomplish this, an HCI framework is developed in this research to facilitate visual feedback system (VFS) using an augmentative communication approach. Augmentative communication (AC.) or icon-based services are incorporated with a portable monitor placed in front of a patient; they can look at the screen to select (ask) their appropriate needs-related icons. The services have been achieved by capturing and processing patients’ electromagnetic brain activates during the icon selection by their eye flickering moment recording using wearable Electroencephalogram (EEG). The flickering icons on the screen conveying an appropriate message to the monitoring unit computer, and the monitoring unit can respond to the patient’s request using VFS. The HCI system is comprised of the following methodologies to achieve augmentative communication-based services such as EEG signals acquisition, filtering, partition-based feature extraction, and fusion and fish swarm optimized Deep Hopfield neural network FSODHNN based classifier. The evolution results of the VSF based HCI framework are demonstrated successfully. It obtained the highest accuracy of 99.11%, specificity of 99.05%, the sensitivity of 99.09%, and the lowest RMSE of 0.98, MSE of 0.92 in icon identification/selection.

Alternative Augmentative Communication "Wofal" for Children with Down Syndrome

This research is motivated by the existence of communication problems in children with Down syndrome. Communication problems on the subject are related to the use of language in their environment. The data obtained from the subject's parents, teachers and tutors experienced problems in expressing their own desires. The purpose of this study is to help subjects communicate with their environment. Communication uses tools that are made based on the needs and abilities of the current subject. The tool created is called "Wofal". This tool is in the form of modified images with an attractive shape and easy to use subjects. The first stage of using the tool introduces the images that the subject will use in communicating. Second, the subject was asked to stick to his wishes and choose an image. The picture consists of the subjects' daily activities at home and at school. After intervention to the subject, the results were obtained. According to teachers, parents and tutors, this tool makes it easier for subjects to communicate. Usually teachers, tutors and parents do not understand what the subject wants. After this tool the crying behavior of the subject became less. So, this tool makes it easier for subjects to communicate in their environment.

Design and Implementation of an Augmentative and Alternative Communication System Based on MATLAB GUI

In clinical practice, augmentative and alternative communication (AAC) is an effective training tool to improve the communication skills of individuals with language impairment, hearing impairment, and autism. However, there are few studies on the development of augmentative communication systems based on Mandarin Chinese in China. This study presents an augmentative communication system developed using the MATLAB GUI platform. The system consists of two parts: a learning part and a communication part, where the learning part provides the basis of the vocabulary content for the system, covering 5558 words, and its content is mainly a word list designed based on the content of special school language textbooks. The communication part provides the system with a complete discourse training content, mainly by arranging and combining the vocabulary content of the learning part to form a complete discourse. This aided communication system can expand the vocabulary of people with language expression disorders and improve their social communication skills. In addition, the effectiveness of the system was tested in a single-subject experiment, and the results showed that the augmentative communication system is effective in learning pronunciation, expanding vocabulary, and improving the social communication.

Iranian Speech-language Pathologists’ Awareness of Alternative and Augmentative Communication Methods

Objectives: Alternative and Augmentative Communication (AAC) provides a means of effective communication to individuals with severe impairments in speech comprehension and production. The present study aimed to examine the awareness of Iranian Speech-Language Pathologists (SLPs) of AAC services. Methods: In total, 111 SLPs who were selected by convenience sampling method participated in this cross-sectional study. Using a researcher-made questionnaire, information on SLPs’ familiarity with the term AAC and its methods; patients who can benefit from AAC methods; the kind of AAC method that could be used per patient, and the effectiveness of each method were obtained. This research was conducted at rehabilitation clinics in Tehran City, Iran. Results: The obtained results revealed that only 8.1% of the respondents were familiar with the concept of AAC; however, 92.8% of SLPs had contact with Patients With Communication Problems (PWCP). Only 0.9% of SLPs were familiar with high-tech devices. Additionally, 88.3% of the respondents were willing to further educational opportunities concerning AAC. Discussion: Iranian SLPs had little familiarity with AAC and the target population of these services. Overall, there appeared to be a lack of AAC expertise within the profession in Iran. Therefore, training these professionals, both theoretically and clinically, is essential.

An Overview of the Technological Options for Promoting Communication Skills of Children With Cerebral Palsy

This chapter provides the reader with a selective overview of the empirical contributions available in literature on the use of assistive technology-based interventions for promoting communication skills of children with cerebral palsy. Four categories were selected regarding (1) microswitches and computers, (2) aided-alternative and augmentative communication devices, (3) eye tracking, and (4) robots. Overall, 18 studies were retained, and 47 participants were included. Results were largely positive although a few failures occurred. Clinical, psychological, and rehabilitative implications for research and practice were critically discussed.

Evaluation of alternative and augmentative communication in patients with amyotrophic lateral sclerosis, based on ICF

Introdução: A comunicação alternativa e aumentativa (CAA) é uma ferramenta que busca de proporcionar uma comunicação funcional eficiente em pacientes com dificuldade de habilidade comunicativa. Objetivo: avaliar o uso da CAA em pacientes com Esclerose Lateral Amiotrófica (ELA) de acordo com a Classificação Internacional de Funcionalidade (CIF). Métodos: pacientes com diagnóstico de ELA que tinham indicação de CAA ou que já utilizavam algum recurso, mas apresentavam queixas em relação ao uso, passaram por um processo de avaliação por meio de um questionário baseado na CIF, posteriormente receberam um novo recurso CAA junto a adequações posturais necessárias para a utilização do recurso; receberam treinamento e suporte para utilização; utilizaram o novo recurso por cerca de dois meses e retornaram para a reavaliação. Resultados: Foram avaliados cinco pacientes com idades entre 43 e 76 anos, de ambos os sexos. Os achados apontam impacto positivo da CAA na dificuldade de comunicação ao transmitir uma mensagem utilizando o novo recurso de CAA disponibilizado. Conclusão: mesmo com a progressão da ELA, todos os pacientes apresentaram redução da dificuldade comunicativa, confirmando os benefícios comunicativos em relação ao seu uso.