scholarly journals Convolutional Neural Networks with 3D Input for P300 Identification in Auditory Brain-Computer Interfaces

2017 ◽  
Vol 2017 ◽  
pp. 1-9 ◽  
Author(s):  
Eduardo Carabez ◽  
Miho Sugi ◽  
Isao Nambu ◽  
Yasuhiro Wada

From allowing basic communication to move through an environment, several attempts are being made in the field of brain-computer interfaces (BCI) to assist people that somehow find it difficult or impossible to perform certain activities. Focusing on these people as potential users of BCI, we obtained electroencephalogram (EEG) readings from nine healthy subjects who were presented with auditory stimuli via earphones from six different virtual directions. We presented the stimuli following the oddball paradigm to elicit P300 waves within the subject’s brain activity for later identification and classification using convolutional neural networks (CNN). The CNN models are given a novel single trial three-dimensional (3D) representation of the EEG data as an input, maintaining temporal and spatial information as close to the experimental setup as possible, a relevant characteristic as eliciting P300 has been shown to cause stronger activity in certain brain regions. Here, we present the results of CNN models using the proposed 3D input for three different stimuli presentation time intervals (500, 400, and 300 ms) and compare them to previous studies and other common classifiers. Our results show >80% accuracy for all the CNN models using the proposed 3D input in single trial P300 classification.

Author(s):  
K. Jairam Naik ◽  
Annukriti Soni

Since video includes both temporal and spatial features, it has become a fascinating classification problem. Each frame within a video holds important information called spatial information, as does the context of that frame relative to the frames before it in time called temporal information. Several methods have been invented for video classification, but each one is suffering from its own drawback. One of such method is called convolutional neural networks (CNN) model. It is a category of deep learning neural network model that can turn directly on the underdone inputs. However, such models are recently limited to handling two-dimensional inputs only. This chapter implements a three-dimensional convolutional neural networks (CNN) model for video classification to analyse the classification accuracy gained using the 3D CNN model. The 3D convolutional networks are preferred for video classification since they inherently apply convolutions in the 3D space.


Author(s):  
V. A. Maksimenko ◽  
A. A. Harchenko ◽  
A. Lüttjohann

Introduction: Now the great interest in studying the brain activity based on detection of oscillatory patterns on the recorded data of electrical neuronal activity (electroencephalograms) is associated with the possibility of developing brain-computer interfaces. Braincomputer interfaces are based on the real-time detection of characteristic patterns on electroencephalograms and their transformation  into commands for controlling external devices. One of the important areas of the brain-computer interfaces application is the control of the pathological activity of the brain. This is in demand for epilepsy patients, who do not respond to drug treatment.Purpose: A technique for detecting the characteristic patterns of neural activity preceding the occurrence of epileptic seizures.Results:Using multi-channel electroencephalograms, we consider the dynamics of thalamo-cortical brain network, preceded the occurrence of an epileptic seizure. We have developed technique which allows to predict the occurrence of an epileptic seizure. The technique has been implemented in a brain-computer interface, which has been tested in-vivo on the animal model of absence epilepsy.Practical relevance:The results of our study demonstrate the possibility of epileptic seizures prediction based on multichannel electroencephalograms. The obtained results can be used in the development of neurointerfaces for the prediction and prevention of seizures of various types of epilepsy in humans. 


2021 ◽  
Vol 11 (13) ◽  
pp. 5931
Author(s):  
Ji’an You ◽  
Zhaozheng Hu ◽  
Chao Peng ◽  
Zhiqiang Wang

Large amounts of high-quality image data are the basis and premise of the high accuracy detection of objects in the field of convolutional neural networks (CNN). It is challenging to collect various high-quality ship image data based on the marine environment. A novel method based on CNN is proposed to generate a large number of high-quality ship images to address this. We obtained ship images with different perspectives and different sizes by adjusting the ships’ postures and sizes in three-dimensional (3D) simulation software, then 3D ship data were transformed into 2D ship image according to the principle of pinhole imaging. We selected specific experimental scenes as background images, and the target ships of the 2D ship images were superimposed onto the background images to generate “Simulation–Real” ship images (named SRS images hereafter). Additionally, an image annotation method based on SRS images was designed. Finally, the target detection algorithm based on CNN was used to train and test the generated SRS images. The proposed method is suitable for generating a large number of high-quality ship image samples and annotation data of corresponding ship images quickly to significantly improve the accuracy of ship detection. The annotation method proposed is superior to the annotation methods that label images with the image annotation software of Label-me and Label-img in terms of labeling the SRS images.


Materials ◽  
2021 ◽  
Vol 14 (11) ◽  
pp. 2801
Author(s):  
Bartosz Miller ◽  
Leonard Ziemiański

The aim of the following paper is to discuss a newly developed approach for the identification of vibration mode shapes of multilayer composite structures. To overcome the limitations of the approaches based on image analysis (two-dimensional structures, high spatial resolution of mode shapes description), convolutional neural networks (CNNs) are applied to create a three-dimensional mode shapes identification algorithm with a significantly reduced number of mode shape vector coordinates. The CNN-based procedure is accurate, effective, and robust to noisy input data. The appearance of local damage is not an obstacle. The change of the material and the occurrence of local material degradation do not affect the accuracy of the method. Moreover, the application of the proposed identification method allows identifying the material degradation occurrence.


2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Saugat Bhattacharyya ◽  
Davide Valeriani ◽  
Caterina Cinel ◽  
Luca Citi ◽  
Riccardo Poli

AbstractIn this paper we present, and test in two realistic environments, collaborative Brain-Computer Interfaces (cBCIs) that can significantly increase both the speed and the accuracy of perceptual group decision-making. The key distinguishing features of this work are: (1) our cBCIs combine behavioural, physiological and neural data in such a way as to be able to provide a group decision at any time after the quickest team member casts their vote, but the quality of a cBCI-assisted decision improves monotonically the longer the group decision can wait; (2) we apply our cBCIs to two realistic scenarios of military relevance (patrolling a dark corridor and manning an outpost at night where users need to identify any unidentified characters that appear) in which decisions are based on information conveyed through video feeds; and (3) our cBCIs exploit Event-Related Potentials (ERPs) elicited in brain activity by the appearance of potential threats but, uniquely, the appearance time is estimated automatically by the system (rather than being unrealistically provided to it). As a result of these elements, in the two test environments, groups assisted by our cBCIs make both more accurate and faster decisions than when individual decisions are integrated in more traditional manners.


Sign in / Sign up

Export Citation Format

Share Document