scholarly journals Robust Asynchronous Control of ERP-Based Brain-Computer Interfaces using Deep Learning

Author(s):  
Eduardo Santamaría-Vázquez ◽  
Víctor Martínez-Cagigal ◽  
Sergio Pérez-Velasco ◽  
Diego Marcos-Martínez ◽  
Roberto Hornero
2021 ◽  
Vol 15 ◽  
Author(s):  
Wonjun Ko ◽  
Eunjin Jeon ◽  
Seungwoo Jeong ◽  
Jaeun Phyo ◽  
Heung-Il Suk

Brain–computer interfaces (BCIs) utilizing machine learning techniques are an emerging technology that enables a communication pathway between a user and an external system, such as a computer. Owing to its practicality, electroencephalography (EEG) is one of the most widely used measurements for BCI. However, EEG has complex patterns and EEG-based BCIs mostly involve a cost/time-consuming calibration phase; thus, acquiring sufficient EEG data is rarely possible. Recently, deep learning (DL) has had a theoretical/practical impact on BCI research because of its use in learning representations of complex patterns inherent in EEG. Moreover, algorithmic advances in DL facilitate short/zero-calibration in BCI, thereby suppressing the data acquisition phase. Those advancements include data augmentation (DA), increasing the number of training samples without acquiring additional data, and transfer learning (TL), taking advantage of representative knowledge obtained from one dataset to address the so-called data insufficiency problem in other datasets. In this study, we review DL-based short/zero-calibration methods for BCI. Further, we elaborate methodological/algorithmic trends, highlight intriguing approaches in the literature, and discuss directions for further research. In particular, we search for generative model-based and geometric manipulation-based DA methods. Additionally, we categorize TL techniques in DL-based BCIs into explicit and implicit methods. Our systematization reveals advances in the DA and TL methods. Among the studies reviewed herein, ~45% of DA studies used generative model-based techniques, whereas ~45% of TL studies used explicit knowledge transferring strategy. Moreover, based on our literature review, we recommend an appropriate DA strategy for DL-based BCIs and discuss trends of TLs used in DL-based BCIs.


Entropy ◽  
2019 ◽  
Vol 21 (3) ◽  
pp. 230 ◽  
Author(s):  
Víctor Martínez-Cagigal ◽  
Eduardo Santamaría-Vázquez ◽  
Roberto Hornero

Brain–computer interfaces (BCI) have traditionally worked using synchronous paradigms. In recent years, much effort has been put into reaching asynchronous management, providing users with the ability to decide when a command should be selected. However, to the best of our knowledge, entropy metrics have not yet been explored. The present study has a twofold purpose: (i) to characterize both control and non-control states by examining the regularity of electroencephalography (EEG) signals; and (ii) to assess the efficacy of a scaled version of the sample entropy algorithm to provide asynchronous control for BCI systems. Ten healthy subjects participated in the study, who were asked to spell words through a visual oddball-based paradigm, attending (i.e., control) and ignoring (i.e., non-control) the stimuli. An optimization stage was performed for determining a common combination of hyperparameters for all subjects. Afterwards, these values were used to discern between both states using a linear classifier. Results show that control signals are more complex and irregular than non-control ones, reaching an average accuracy of 94.40 % in classification. In conclusion, the present study demonstrates that the proposed framework is useful in monitoring the attention of a user, and granting the asynchrony of the BCI system.


Entropy ◽  
2020 ◽  
Vol 22 (5) ◽  
pp. 505
Author(s):  
Víctor Martínez-Cagigal ◽  
Eduardo Santamaría-Vázquez ◽  
Roberto Hornero

Figure 5 of the original paper contains errors [...]


2021 ◽  
Vol 15 ◽  
Author(s):  
Sai Kalyan Ranga Singanamalla ◽  
Chin-Teng Lin

With the advent of advanced machine learning methods, the performance of brain–computer interfaces (BCIs) has improved unprecedentedly. However, electroencephalography (EEG), a commonly used brain imaging method for BCI, is characterized by a tedious experimental setup, frequent data loss due to artifacts, and is time consuming for bulk trial recordings to take advantage of the capabilities of deep learning classifiers. Some studies have tried to address this issue by generating artificial EEG signals. However, a few of these methods are limited in retaining the prominent features or biomarker of the signal. And, other deep learning-based generative methods require a huge number of samples for training, and a majority of these models can handle data augmentation of one category or class of data at any training session. Therefore, there exists a necessity for a generative model that can generate synthetic EEG samples with as few available trials as possible and generate multi-class while retaining the biomarker of the signal. Since EEG signal represents an accumulation of action potentials from neuronal populations beneath the scalp surface and as spiking neural network (SNN), a biologically closer artificial neural network, communicates via spiking behavior, we propose an SNN-based approach using surrogate-gradient descent learning to reconstruct and generate multi-class artificial EEG signals from just a few original samples. The network was employed for augmenting motor imagery (MI) and steady-state visually evoked potential (SSVEP) data. These artificial data are further validated through classification and correlation metrics to assess its resemblance with original data and in-turn enhanced the MI classification performance.


Sign in / Sign up

Export Citation Format

Share Document