Neuroscience Technology and Interfaces for Speech, Language, and Musical Communication

2019 ◽  
pp. 403-419
Author(s):  
Dionysios Politis ◽  
Miltiadis Tsalighopoulos ◽  
Georgios Kyriafinis
Keyword(s):  
Hearing Aids ◽  
Brain Activity ◽  
Oral Communication ◽  
Speech Communication ◽  
Learning Potential ◽  
Great Expectations ◽  
Computer Interfaces ◽  
Language Communication ◽  
Audio Communication ◽  
Musical Communication

Medical practice is extensively using monitoring devices that are more or less invasive and immersive. For aural and oral communication these could be hearing aids, prosthetics, cochlear implants, or goggles detecting vestibular effects and vertigo. Recently, a wide variety of trendy mobile or wearable devices has been offered to the general public, provoking a frenzy for augmentation alongside the great expectations that the popularization of brain-computer interfaces has caused to both the consumer market and the scientific community. The use of bionic devices clinched with synapses of the nerves does not merely mingle input activity to brain activity, but also it provides a virtual channel for augmenting and manipulating speech communication, language communication, and even further, musical communication. The electromechanical parameters, the medical practices, and the learning potential for this new world of augmented human-computer interaction platforms and devices are examined under the prism of audio communication.

Neuroscience Technology and Interfaces for Speech, Language, and Musical Communication

2018 ◽  
pp. 5886-5900
Author(s):  
Dionysios Politis ◽  
Miltiadis Tsalighopoulos ◽  
Georgios Kyriafinis
Keyword(s):  
Hearing Aids ◽  
Brain Activity ◽  
Oral Communication ◽  
Speech Communication ◽  
Learning Potential ◽  
Great Expectations ◽  
Computer Interfaces ◽  
Language Communication ◽  
Audio Communication ◽  
Musical Communication

Medical practice is extensively using monitoring devices that are more or less invasive and immersive. For aural and oral communication these could be hearing aids, prosthetics, cochlear implants or goggles detecting vestibular effects and vertigo. Recently, a wide variety of trendy mobile or wearable devices has been offered to the general public, provoking a frenzy for augmentation alongside the great expectations that the popularization of Brain Computer Interfaces has caused to both the consumer market and the scientific community. The use of bionic devices clinched with synapses of the nerves does not merely mingle input activity to brain activity, but also it provides a virtual channel for augmenting and manipulating speech communication, language communication and even further musical communication. The electromechanical parameters, the medical practices and the learning potential for this new world of augmented Human Computer Interaction platforms and devices are examined under the prism of audio communication.

scholarly journals Η αντιληπτική λειτουργία παιδιών 8-13 ετών με προγλωσσική απώλεια ακοής

2021 ◽  
Vol 26 (1) ◽  
pp. 169
Author(s):  
Χρήστος Γεωργοκωστόπουλος ◽  
Μαρία Τζουριάδου
Keyword(s):  
Cochlear Implant ◽  
Sign Language ◽  
Hearing Aids ◽  
Hard Of Hearing ◽  
Oral Communication ◽  
Main Method ◽  
Co Morbidity ◽  
Language Communication ◽  
Hearing Children ◽  
Perceptual Function

In this study, we investigated the perceptual function of deaf/hard of hearing children. The sample of the study consisted of 58 pupils aged 8-13 years old (3rd-6th graders) with severe (60-90 db) or profound (90 db and above) neurosensory hearing loss – pre-lingual with or without cochlear implants. Children with co-morbidity (intellectual disabilities, syndromes, autism, motor disorders, etc.) and children with post-lingual deafness/hearing impairment were excluded. In order to investigate their perceptual function, the Perceptual Functionality Criterion was used. The results of the study show that deaf/hard of hearing participants exhibit a “sporadic” profile regarding the general perceptual functionality. In particular, the participants were found to perform similarly in terms of visual-perceptive skills, while there was one exception, i.e. their visual-motor skills were worse. Higher scores have been shown in the domain of kinesthetic and tactile perception and lower ones regarding vestigial perception, especially in terms of the sense of balance. In addition, the perceptual function was investigated among the cochlear implant participants and those with conventional hearing aids. The results showed no significant differences between the two groups regarding the perceptual function, although the visual perception was found to be significantly better among the users of conventional hearing aids relative to cochlear implant users. Finally, the perceptual function was investigated in terms of the main method of language/communication used. The data indicated that participants, regardless of whether they use sign language, total/bilingual or oral communication, performed roughly similarly on the test variables. Among the different types of main method of language/communication, statistically significant differences were absent, though regarding the visual and kinesthetic perception sign language users outperformed the users of oral communication.

Brain Computer Interfaces for Silent Speech

2016 ◽  
Vol 25 (2) ◽  
pp. 208-230 ◽  
Author(s):  
Yousef Rezaei Tabar ◽  
Ugur Halici
Keyword(s):  
Brain Activity ◽  
Computer Interface ◽  
Speech Communication ◽  
Disabled People ◽  
Computer Interfaces ◽  
Life Problems ◽  
Signal Processing Methods ◽  
Silent Speech ◽  
Bci System ◽  
Different Parts

Brain Computer Interface (BCI) systems provide control of external devices by using only brain activity. In recent years, there has been a great interest in developing BCI systems for different applications. These systems are capable of solving daily life problems for both healthy and disabled people. One of the most important applications of BCI is to provide communication for disabled people that are totally paralysed. In this paper, different parts of a BCI system and different methods used in each part are reviewed. Neuroimaging devices, with an emphasis on EEG (electroencephalography), are presented and brain activities as well as signal processing methods used in EEG-based BCIs are explained in detail. Current methods and paradigms in BCI based speech communication are considered.

Automated System for Epileptic Seizures Prediction based on Multi-Channel Recordings of Electrical Brain Activity

2018 ◽  
pp. 115-122 ◽  
Author(s):  
V. A. Maksimenko ◽  
A. A. Harchenko ◽  
A. Lüttjohann
Keyword(s):  
Epileptic Seizure ◽  
Brain Activity ◽  
Epileptic Seizures ◽  
Automated System ◽  
Brain Computer Interfaces ◽  
Electrical Brain Activity ◽  
Computer Interfaces ◽  
Prediction And Prevention ◽  
The Brain

Introduction: Now the great interest in studying the brain activity based on detection of oscillatory patterns on the recorded data of electrical neuronal activity (electroencephalograms) is associated with the possibility of developing brain-computer interfaces. Braincomputer interfaces are based on the real-time detection of characteristic patterns on electroencephalograms and their transformation  into commands for controlling external devices. One of the important areas of the brain-computer interfaces application is the control of the pathological activity of the brain. This is in demand for epilepsy patients, who do not respond to drug treatment.Purpose: A technique for detecting the characteristic patterns of neural activity preceding the occurrence of epileptic seizures.Results:Using multi-channel electroencephalograms, we consider the dynamics of thalamo-cortical brain network, preceded the occurrence of an epileptic seizure. We have developed technique which allows to predict the occurrence of an epileptic seizure. The technique has been implemented in a brain-computer interface, which has been tested in-vivo on the animal model of absence epilepsy.Practical relevance:The results of our study demonstrate the possibility of epileptic seizures prediction based on multichannel electroencephalograms. The obtained results can be used in the development of neurointerfaces for the prediction and prevention of seizures of various types of epilepsy in humans. 

scholarly journals Identification of Words and Phrases Through a Phonemic-Based Haptic Display

2021 ◽  
Vol 18 (3) ◽  
pp. 1-22
Author(s):  
Charlotte M. Reed ◽  
Hong Z. Tan ◽  
Yang Jiao ◽  
Zachary D. Perez ◽  
E. Courtenay Wilson
Keyword(s):  
Speech Communication ◽  
Haptic Display ◽  
Communication Aids ◽  
Remote Communication ◽  
Computer Interfaces ◽  
Speech Reception ◽  
Communication Device ◽  
Human Computer Interfaces ◽  
Sensory Impairments ◽  
Effective Transmission

Stand-alone devices for tactile speech reception serve a need as communication aids for persons with profound sensory impairments as well as in applications such as human-computer interfaces and remote communication when the normal auditory and visual channels are compromised or overloaded. The current research is concerned with perceptual evaluations of a phoneme-based tactile speech communication device in which a unique tactile code was assigned to each of the 24 consonants and 15 vowels of English. The tactile phonemic display was conveyed through an array of 24 tactors that stimulated the dorsal and ventral surfaces of the forearm. Experiments examined the recognition of individual words as a function of the inter-phoneme interval (Study 1) and two-word phrases as a function of the inter-word interval (Study 2). Following an average training period of 4.3 hrs on phoneme and word recognition tasks, mean scores for the recognition of individual words in Study 1 ranged from 87.7% correct to 74.3% correct as the inter-phoneme interval decreased from 300 to 0 ms. In Study 2, following an average of 2.5 hours of training on the two-word phrase task, both words in the phrase were identified with an accuracy of 75% correct using an inter-word interval of 1 sec and an inter-phoneme interval of 150 ms. Effective transmission rates achieved on this task were estimated to be on the order of 30 to 35 words/min.

scholarly journals Anytime collaborative brain–computer interfaces for enhancing perceptual group decision-making

2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Saugat Bhattacharyya ◽  
Davide Valeriani ◽  
Caterina Cinel ◽  
Luca Citi ◽  
Riccardo Poli
Keyword(s):  
Decision Making ◽  
Group Decision Making ◽  
Group Decision ◽  
Brain Activity ◽  
Event Related Potentials ◽  
Brain Computer Interfaces ◽  
Appearance Time ◽  
Perceptual Group ◽  
Computer Interfaces ◽  
Related Potentials

AbstractIn this paper we present, and test in two realistic environments, collaborative Brain-Computer Interfaces (cBCIs) that can significantly increase both the speed and the accuracy of perceptual group decision-making. The key distinguishing features of this work are: (1) our cBCIs combine behavioural, physiological and neural data in such a way as to be able to provide a group decision at any time after the quickest team member casts their vote, but the quality of a cBCI-assisted decision improves monotonically the longer the group decision can wait; (2) we apply our cBCIs to two realistic scenarios of military relevance (patrolling a dark corridor and manning an outpost at night where users need to identify any unidentified characters that appear) in which decisions are based on information conveyed through video feeds; and (3) our cBCIs exploit Event-Related Potentials (ERPs) elicited in brain activity by the appearance of potential threats but, uniquely, the appearance time is estimated automatically by the system (rather than being unrealistically provided to it). As a result of these elements, in the two test environments, groups assisted by our cBCIs make both more accurate and faster decisions than when individual decisions are integrated in more traditional manners.

MUSIC COMMUNICATION: WAYS OF REPRODUCTION AND CHANNELS OF PERCEPTION OF MUSIC (historical and analytical view)

2020 ◽  
Vol 1 (2) ◽  
pp. 53-61
Author(s):  
A. N. Yakoupov ◽  
Keyword(s):  
Oral Communication ◽  
Recording Equipment ◽  
Professional Musicians ◽  
Stage Design ◽  
New Era ◽  
Musical Notation ◽  
Theatrical Performance ◽  
Musical Thinking ◽  
Oral Method ◽  
Musical Communication

In the article the means of musical communication and their evolution are considered in the historical and analytical aspect. There are two types of communication tools: acoustic, using the airspace as a channel for transmitting encoded information, and visual, which include stage design, allowing to perceive music as a kind of theatrical performance, and musical notation, graphically fixing all the components of the musical text. As the earliest means of nonwritten communication, the oral method is put forward, a vivid example of which is folklore, often called the musical memory of generations. Other examples of oral communication are cult music, improvisation and musical meditation. It is stated that musical writing, in particular, musical notation, and later printing tools have created conditions for overcoming spatial and temporal barriers to the spread of music. The next step is the invention of technical sound recording, which opened a new era in the development of communications. Magnetic recording of the visual series made it possible to create concert films and opera films. Even greater involvement of people in the process of musical communication was facilitated by the appearance of electronic and mechanical means of recording music. The emergence of new opportunities in the field of sound dynamics control, its timbre, influenced the development of musical thinking. A new industry of "production" has emerged with the involvement of professional musicians who own modern recording equipment and specialize in the production of "artificial" musical products. This process was accompanied by the formation of a new audience of listeners who preferred recording to live sound.

scholarly journals Brain–Computer Interfaces for Human Augmentation

2019 ◽  
Vol 9 (2) ◽  
pp. 22 ◽  
Author(s):  
Davide Valeriani ◽  
Caterina Cinel ◽  
Riccardo Poli
Keyword(s):  
Brain Activity ◽  
Severe Disabilities ◽  
Assistive Technologies ◽  
Brain Computer Interfaces ◽  
Computer Interfaces ◽  
Control Signals ◽  
Human Augmentation

The field of brain–computer interfaces (BCIs) has grown rapidly in the last few decades, allowing the development of ever faster and more reliable assistive technologies for converting brain activity into control signals for external devices for people with severe disabilities [...]

scholarly journals Brain-Computer Interfaces for Internet of Things

Proceedings ◽  
2018 ◽  
Vol 2 (18) ◽  
pp. 1179 ◽  
Author(s):  
Francisco Laport ◽  
Francisco J. Vazquez-Araujo ◽  
Paula M. Castro ◽  
Adriana Dapena
Keyword(s):  
Internet Of Things ◽  
Communication Protocol ◽  
Brain Activity ◽  
Brain Computer Interface ◽  
Computer Interface ◽  
Event Classification ◽  
Computer Interfaces ◽  
Controlling Elements ◽  
Artefact Reduction ◽  
The Brain

A brain-computer interface for controlling elements commonly used at home is presented in this paper. It includes the electroencephalography device needed to acquire signals associated to the brain activity, the algorithms for artefact reduction and event classification, and the communication protocol.

Sign in / Sign up

Export Citation Format

Share Document