Integrating EEG and MEG Signals to Improve Motor Imagery Classification in Brain–Computer Interface

2019 ◽  
Vol 29 (01) ◽  
pp. 1850014 ◽  
Author(s):  
Marie-Constance Corsi ◽  
Mario Chavez ◽  
Denis Schwartz ◽  
Laurent Hugueville ◽  
Ankit N. Khambhati ◽  
...  
Keyword(s):  
Motor Imagery ◽  
Performance Enhancement ◽  
Brain Computer Interface ◽  
Classification Performance ◽  
Computer Interface ◽  
Computer Interfaces ◽  
The Impact ◽  
Electroencephalogram Eeg ◽  
Fusion Approach ◽  
Single Modality

We adopted a fusion approach that combines features from simultaneously recorded electroencephalogram (EEG) and magnetoencephalogram (MEG) signals to improve classification performances in motor imagery-based brain–computer interfaces (BCIs). We applied our approach to a group of 15 healthy subjects and found a significant classification performance enhancement as compared to standard single-modality approaches in the alpha and beta bands. Taken together, our findings demonstrate the advantage of considering multimodal approaches as complementary tools for improving the impact of noninvasive BCIs.

scholarly journals Improving multi-class EEG-motor imagery classification using two-stage detection on one-versus-one approach

2020 ◽  
Vol 5 (2) ◽  
pp. 85-92
Author(s):  
Adi Wijaya ◽  
Teguh Bharata Adji ◽  
Noor Akhmad Setiawan
Keyword(s):  
Motor Imagery ◽  
Brain Computer Interface ◽  
Classification Performance ◽  
Kappa Coefficient ◽  
Computer Interface ◽  
Eeg Signal ◽  
Statistical Measure ◽  
Eeg Signals ◽  
Two Stage ◽  
Electroencephalogram Eeg

The multi-class motor imagery based on Electroencephalogram (EEG) signals in Brain-Computer Interface (BCI) systems still face challenges, such as inconsistent accuracy and low classification performance due to inter-subject dependent. Therefore, this study aims to improve multi-class EEG-motor imagery using two-stage detection and voting scheme on one-versus-one approach. The EEG signal used to carry out this research was extracted through a statistical measure of narrow window sliding. Furthermore, inter and cross-subject schemes were investigated on BCI competition IV-Dataset 2a to evaluate the effectiveness of the proposed method. The experimental results showed that the proposed method produced enhanced inter and cross-subject kappa coefficient values of 0.78 and 0.68, respectively, with a low standard deviation of 0.1 for both schemes. These results further indicated that the proposed method has an ability to address inter-subject dependent for promising and reliable BCI systems.

scholarly journals Application of Continuous Wavelet Transform and Convolutional Neural Network in Decoding Motor Imagery Brain-Computer Interface

Entropy ◽  
2019 ◽  
Vol 21 (12) ◽  
pp. 1199 ◽  
Author(s):  
Hyeon Kyu Lee ◽  
Young-Seok Choi
Keyword(s):  
Neural Network ◽  
Wavelet Transform ◽  
Convolutional Neural Network ◽  
Motor Imagery ◽  
Continuous Wavelet Transform ◽  
Brain Computer Interface ◽  
Classification Performance ◽  
Computer Interface ◽  
Continuous Wavelet ◽  
Time Frequency

The motor imagery-based brain-computer interface (BCI) using electroencephalography (EEG) has been receiving attention from neural engineering researchers and is being applied to various rehabilitation applications. However, the performance degradation caused by motor imagery EEG with very low single-to-noise ratio faces several application issues with the use of a BCI system. In this paper, we propose a novel motor imagery classification scheme based on the continuous wavelet transform and the convolutional neural network. Continuous wavelet transform with three mother wavelets is used to capture a highly informative EEG image by combining time-frequency and electrode location. A convolutional neural network is then designed to both classify motor imagery tasks and reduce computation complexity. The proposed method was validated using two public BCI datasets, BCI competition IV dataset 2b and BCI competition II dataset III. The proposed methods were found to achieve improved classification performance compared with the existing methods, thus showcasing the feasibility of motor imagery BCI.

Motor Imagery Classification Using EEG Signals for Brain-Computer Interface Applications

2019 ◽  
pp. 241-251
Author(s):  
Subrota Mazumdar ◽  
Rohit Chaudhary ◽  
Suruchi Suruchi ◽  
Suman Mohanty ◽  
Divya Kumari ◽  
...  
Keyword(s):  
Motor Imagery ◽  
Nearest Neighbor ◽  
Brain Computer Interface ◽  
Computer Interface ◽  
Test Cases ◽  
Multiple Channels ◽  
Eeg Signals ◽  
Brain Computer Interfacing ◽  
Electroencephalogram Eeg

In this chapter, a nearest neighbor (k-NN)-based method for efficient classification of motor imagery using EEG for brain-computer interfacing (BCI) applications has been proposed. Electroencephalogram (EEG) signals are obtained from multiple channels from brain. These EEG signals are taken as input features and given to the k-NN-based classifier to classify motor imagery. More specifically, the chapter gives an outline of the Berlin brain-computer interface that can be operated with minimal subject change. All the design and simulation works are carried out with MATLAB software. k-NN-based classifier is trained with data from continuous signals of EEG channels. After the network is trained, it is tested with various test cases. Performance of the network is checked in terms of percentage accuracy, which is found to be 99.25%. The result suggested that the proposed method is accurate for BCI applications.

scholarly journals Reduce Calibration Time in Motor Imagery Using Spatially Regularized Symmetric Positives-Definite Matrices Based Classification

Sensors ◽  
2019 ◽  
Vol 19 (2) ◽  
pp. 379 ◽  
Author(s):  
Amardeep Singh ◽  
Sunil Lal ◽  
Hans Guesgen
Keyword(s):  
Motor Imagery ◽  
Brain Computer Interface ◽  
Spatial Filter ◽  
Covariance Matrices ◽  
Small Sample ◽  
Computer Interface ◽  
Limited Applicability ◽  
Calibration Time ◽  
Electroencephalogram Eeg ◽  
New Framework

Electroencephalogram (EEG) based motor imagery brain–computer interface (BCI) requires large number of subject specific training trials to calibrate the system for a new subject. This results in long calibration time that limits the BCI usage in practice. One major challenge in the development of a brain–computer interface is to reduce calibration time or completely eliminate it. To address this problem, existing approaches use covariance matrices of electroencephalography (EEG) trials as descriptors for decoding BCI but do not consider the geometry of the covariance matrices, which lies in the space of Symmetric Positive Definite (SPD) matrices. This inevitably limits their performance. We focus on reducing calibration time by introducing SPD based classification approach. However, SPD-based classification has limited applicability in small training sets because the dimensionality of covariance matrices is large in proportion to the number of trials. To overcome this drawback, our paper proposes a new framework that transforms SPD matrices in lower dimension through spatial filter regularized by prior information of EEG channels. The efficacy of the proposed approach was validated on the small sample scenario through Dataset IVa from BCI Competition III. The proposed approach achieved mean accuracy of 86.13 % and mean kappa of 0.72 on Dataset IVa. The proposed method outperformed other approaches in existing studies on Dataset IVa. Finally, to ensure the robustness of the proposed method, we evaluated it on Dataset IIIa from BCI Competition III and Dataset IIa from BCI Competition IV. The proposed method achieved mean accuracy 92.22 % and 81.21 % on Dataset IIIa and Dataset IIa, respectively.

scholarly journals A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface

Sensors ◽  
2021 ◽  
Vol 21 (6) ◽  
pp. 2173
Author(s):  
Amardeep Singh ◽  
Ali Abdul Hussain ◽  
Sunil Lal ◽  
Hans W. Guesgen
Keyword(s):  
Motor Imagery ◽  
Brain Computer Interface ◽  
Computer Interface ◽  
Comprehensive Review ◽  
Current State ◽  
Critical Issues ◽  
Recent Developments ◽  
Kinesthetic Imagination ◽  
Number Of Publications ◽  
Electroencephalogram Eeg

Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.

scholarly journals A Review on Signal Processing Approaches to Reduce Calibration Time in EEG-Based Brain–Computer Interface

2021 ◽  
Vol 15 ◽  
Author(s):  
Xin Huang ◽  
Yilu Xu ◽  
Jing Hua ◽  
Wenlong Yi ◽  
Hua Yin ◽  
...  
Keyword(s):  
Signal Processing ◽  
Electronic Device ◽  
Brain Computer Interface ◽  
Classification Performance ◽  
Computer Interface ◽  
Eeg Signals ◽  
Good Classification Performance ◽  
Calibration Time ◽  
Electroencephalogram Eeg ◽  
Target Subject

In an electroencephalogram- (EEG-) based brain–computer interface (BCI), a subject can directly communicate with an electronic device using his EEG signals in a safe and convenient way. However, the sensitivity to noise/artifact and the non-stationarity of EEG signals result in high inter-subject/session variability. Therefore, each subject usually spends long and tedious calibration time in building a subject-specific classifier. To solve this problem, we review existing signal processing approaches, including transfer learning (TL), semi-supervised learning (SSL), and a combination of TL and SSL. Cross-subject TL can transfer amounts of labeled samples from different source subjects for the target subject. Moreover, Cross-session/task/device TL can reduce the calibration time of the subject for the target session, task, or device by importing the labeled samples from the source sessions, tasks, or devices. SSL simultaneously utilizes the labeled and unlabeled samples from the target subject. The combination of TL and SSL can take advantage of each other. For each kind of signal processing approaches, we introduce their concepts and representative methods. The experimental results show that TL, SSL, and their combination can obtain good classification performance by effectively utilizing the samples available. In the end, we draw a conclusion and point to research directions in the future.

scholarly journals Using Brain-Computer Interface to Control a Virtual Drone Using Non-Invasive Motor Imagery and Machine Learning

2021 ◽  
Vol 11 (24) ◽  
pp. 11876
Author(s):  
Catalin Dumitrescu ◽  
Ilona-Madalina Costea ◽  
Augustin Semenescu
Keyword(s):  
Motor Imagery ◽  
Brain Activity ◽  
Brain Computer Interface ◽  
Rapid Change ◽  
Training Session ◽  
Extraction Methods ◽  
Computer Interface ◽  
Eeg Signals ◽  
Computer Interfaces ◽  
Sensorimotor Rhythms

In recent years, the control of devices “by the power of the mind” has become a very controversial topic but has also been very well researched in the field of state-of-the-art gadgets, such as smartphones, laptops, tablets and even smart TVs, and also in medicine, to be used by people with disabilities for whom these technologies may be the only way to communicate with the outside world. It is well known that BCI control is a skill and can be improved through practice and training. This paper aims to improve and diversify signal processing methods for the implementation of a brain-computer interface (BCI) based on neurological phenomena recorded during motor tasks using motor imagery (MI). The aim of the research is to extract, select and classify the characteristics of electroencephalogram (EEG) signals, which are based on sensorimotor rhythms, for the implementation of BCI systems. This article investigates systems based on brain-computer interfaces, especially those that use the electroencephalogram as a method of acquisition of MI tasks. The purpose of this article is to allow users to manipulate quadcopter virtual structures (external, robotic objects) simply through brain activity, correlated with certain mental tasks using undecimal transformation (UWT) to reduce noise, Independent Component Analysis (ICA) together with determination coefficient (r2) and, for classification, a hybrid neural network consisting of Radial Basis Functions (RBF) and a multilayer perceptron–recurrent network (MLP–RNN), obtaining a classification accuracy of 95.5%. Following the tests performed, it can be stated that the use of biopotentials in human–computer interfaces is a viable method for applications in the field of BCI. The results presented show that BCI training can produce a rapid change in behavioral performance and cognitive properties. If more than one training session is used, the results may be beneficial for increasing poor cognitive performance. To achieve this goal, three steps were taken: understanding the functioning of BCI systems and the neurological phenomena involved; acquiring EEG signals based on sensorimotor rhythms recorded during MI tasks; applying and optimizing extraction methods, selecting and classifying characteristics using neuronal networks.

scholarly journals Improving Motor Imagery-Based Brain-Computer Interface Performance Based on Sensory Stimulation Training: An Approach Focused on Poorly Performing Users

2021 ◽  
Vol 15 ◽  
Author(s):  
Sangin Park ◽  
Jihyeon Ha ◽  
Da-Hye Kim ◽  
Laehyun Kim
Keyword(s):  
Motor Imagery ◽  
Brain Activity ◽  
Brain Computer Interface ◽  
Poor Performance ◽  
Sensory Stimulation ◽  
Classification Performance ◽  
Computer Applications ◽  
Computer Interface ◽  
Target Point ◽  
Left Hand

The motor imagery (MI)-based brain-computer interface (BCI) is an intuitive interface that provides control over computer applications directly from brain activity. However, it has shown poor performance compared to other BCI systems such as P300 and SSVEP BCI. Thus, this study aimed to improve MI-BCI performance by training participants in MI with the help of sensory inputs from tangible objects (i.e., hard and rough balls), with a focus on poorly performing users. The proposed method is a hybrid of training and imagery, combining motor execution and somatosensory sensation from a ball-type stimulus. Fourteen healthy participants participated in the somatosensory-motor imagery (SMI) experiments (within-subject design) involving EEG data classification with a three-class system (signaling with left hand, right hand, or right foot). In the scenario of controlling a remote robot to move it to the target point, the participants performed MI when faced with a three-way intersection. The SMI condition had a better classification performance than did the MI condition, achieving a 68.88% classification performance averaged over all participants, which was 6.59% larger than that in the MI condition (p < 0.05). In poor performers, the classification performance in SMI was 10.73% larger than in the MI condition (62.18% vs. 51.45%). However, good performers showed a slight performance decrement (0.86%) in the SMI condition compared to the MI condition (80.93% vs. 81.79%). Combining the brain signals from the motor and somatosensory cortex, the proposed hybrid MI-BCI system demonstrated improved classification performance, this phenomenon was predominant in poor performers (eight out of nine subjects). Hybrid MI-BCI systems may significantly contribute to reducing the proportion of BCI-inefficiency users and closing the performance gap with other BCI systems.

Sign in / Sign up

Export Citation Format

Share Document