scholarly journals BENDR: Using Transformers and a Contrastive Self-Supervised Learning Task to Learn From Massive Amounts of EEG Data

2021 ◽  
Vol 15 ◽  
Author(s):  
Demetres Kostas ◽  
Stéphane Aroca-Ouellette ◽  
Frank Rudzicz
Keyword(s):  
Deep Neural Networks ◽  
Sleep Stage ◽  
Learning Task ◽  
Language Modeling ◽  
Computer Interface ◽  
Eeg Data ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
Classification Tasks ◽  
Training Objective

Deep neural networks (DNNs) used for brain–computer interface (BCI) classification are commonly expected to learn general features when trained across a variety of contexts, such that these features could be fine-tuned to specific contexts. While some success is found in such an approach, we suggest that this interpretation is limited and an alternative would better leverage the newly (publicly) available massive electroencephalography (EEG) datasets. We consider how to adapt techniques and architectures used for language modeling (LM) that appear capable of ingesting awesome amounts of data toward the development of encephalography modeling with DNNs in the same vein. We specifically adapt an approach effectively used for automatic speech recognition, which similarly (to LMs) uses a self-supervised training objective to learn compressed representations of raw data signals. After adaptation to EEG, we find that a single pre-trained model is capable of modeling completely novel raw EEG sequences recorded with differing hardware, and different subjects performing different tasks. Furthermore, both the internal representations of this model and the entire architecture can be fine-tuned to a variety of downstream BCI and EEG classification tasks, outperforming prior work in more task-specific (sleep stage classification) self-supervision.

scholarly journals A Novel Local Explainability Approach for Spectral Insight into Raw EEG-Based Deep Learning Classifiers

2021 ◽  
Author(s):  
Charles A Ellis ◽  
Robyn L Miller ◽  
Vince Calhoun
Keyword(s):  
Deep Learning ◽  
Sleep Stage ◽  
Sleep Stages ◽  
Eeg Analysis ◽  
Frequency Bands ◽  
Learning Classifiers ◽  
Eeg Data ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
Insight Into

The frequency domain of electroencephalography (EEG) data has developed as a particularly important area of EEG analysis. EEG spectra have been analyzed with explainable machine learning and deep learning methods. However, as deep learning has developed, most studies use raw EEG data, which is not well-suited for traditional explainability methods. Several studies have introduced methods for spectral insight into classifiers trained on raw EEG data. These studies have provided global insight into the frequency bands that are generally important to a classifier but do not provide local insight into the frequency bands important for the classification of individual samples. This local explainability could be particularly helpful for EEG analysis domains like sleep stage classification that feature multiple evolving states. We present a novel local spectral explainability approach and use it to explain a convolutional neural network trained for automated sleep stage classification. We use our approach to show how the relative importance of different frequency bands varies over time and even within the same sleep stages. Furthermore, to better understand how our approach compares to existing methods, we compare a global estimate of spectral importance generated from our local results with an existing global spectral importance approach. We find that the δ band is most important for most sleep stages, though β is most important for the non-rapid eye movement 2 (NREM2) sleep stage. Additionally, θ is particularly important for identifying Awake and NREM1 samples. Our study represents the first approach developed for local spectral insight into deep learning classifiers trained on raw EEG time series.

scholarly journals Vector Phase Analysis Approach for Sleep Stage Classification: A Functional Near-Infrared Spectroscopy-Based Passive Brain–Computer Interface

2021 ◽  
Vol 15 ◽  
Author(s):  
Saad Arif ◽  
Muhammad Jawad Khan ◽  
Noman Naseer ◽  
Keum-Shik Hong ◽  
Hasan Sajid ◽  
...  
Keyword(s):  
Infrared Spectroscopy ◽  
Near Infrared ◽  
Sleep Stage ◽  
Brain Computer Interface ◽  
Computer Interface ◽  
Functional Near Infrared Spectroscopy ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
The Right ◽  
Threshold Criteria

A passive brain–computer interface (BCI) based upon functional near-infrared spectroscopy (fNIRS) brain signals is used for earlier detection of human drowsiness during driving tasks. This BCI modality acquired hemodynamic signals of 13 healthy subjects from the right dorsolateral prefrontal cortex (DPFC) of the brain. Drowsiness activity is recorded using a continuous-wave fNIRS system and eight channels over the right DPFC. During the experiment, sleep-deprived subjects drove a vehicle in a driving simulator while their cerebral oxygen regulation (CORE) state was continuously measured. Vector phase analysis (VPA) was used as a classifier to detect drowsiness state along with sleep stage-based threshold criteria. Extensive training and testing with various feature sets and classifiers are done to justify the adaptation of threshold criteria for any subject without requiring recalibration. Three statistical features (mean oxyhemoglobin, signal peak, and the sum of peaks) along with six VPA features (trajectory slopes of VPA indices) were used. The average accuracies for the five classifiers are 90.9% for discriminant analysis, 92.5% for support vector machines, 92.3% for nearest neighbors, 92.4% for both decision trees, and ensembles over all subjects’ data. Trajectory slopes of CORE vector magnitude and angle: m(|R|) and m(∠R) are the best-performing features, along with ensemble classifier with the highest accuracy of 95.3% and minimum computation time of 40 ms. The statistical significance of the results is validated with a p-value of less than 0.05. The proposed passive BCI scheme demonstrates a promising technique for online drowsiness detection using VPA along with sleep stage classification.

Deep Learning Analysis for Estimating Sleep Syndrome Detection Utilizing the Twin Convolutional Model FTC2

2021 ◽  
Vol 1 (1) ◽  
pp. 11-17
Author(s):  
Tim Cvetko ◽  
◽  
Tinkara Robek ◽  
Keyword(s):  
Sleep Stage ◽  
Daily Basis ◽  
Sleep Stages ◽  
Time Frequency ◽  
Novel Approach ◽  
Eeg Data ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
Novel Method ◽  
Eeg Recordings

Sleep specialists often conduct manual sleep stage scoring by visually inspecting the patient's neurophysiological signals collected at sleep labs. This is a difficult, tedious and a time-consuming task. The limitations of manual sleep stage scor- ing have escalated the demand for developing Automatic Sleep Stage Classification (ASSC) systems. Sleep stage classification refers to identifying the various stages of sleep and is a critical step in an effort to assist physicians in the diag- nosis and treatment of related sleep disorders. In this paper, we propose a novel method and a practical approach to predicting early onsets of sleep syndromes utilizing the Twin Convolutional Model FTC2, including restless leg syndrome, insomnia, based on an algorithm which is comprised of two modules. A Fast Fourier Transform is applied to 30 seconds long epochs of EEG recordings to provide localized time-frequency information, and a deep convolutional LSTM neural network is trained for sleep stage classification. Automating sleep stages detection from EEG data offers a great potential to tackling sleep irregularities on a daily basis. Thereby, a novel approach for sleep stage classification is pro- posed which combines the best of signal processing and statistics. In this study, we used the PhysioNet Sleep European Data Format (EDF) Database. The code evaluation showed impressive results, reaching accuracy of 90.43, precision of 77.76, recall of 93,32, F1-score of 89.12 with the final mean false error loss 0.09. All the source code is availlable at https://github.com/timothy102/eeg.

Causal Probabilistic Network and Power Spectral Estimation Used in Sleep Stage Classification

1997 ◽  
Vol 36 (04/05) ◽  
pp. 41-46
Author(s):  
A. Kjaer ◽  
W. Jensen ◽  
T. Dyrby ◽  
L. Andreasen ◽  
J. Andersen ◽  
...  
Keyword(s):  
Sleep Stage ◽  
Spectral Estimation ◽  
Interrater Agreement ◽  
Probabilistic Networks ◽  
Probabilistic Network ◽  
Spectral Bands ◽  
Power Spectral ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
The Brain

Abstract.A new method for sleep-stage classification using a causal probabilistic network as automatic classifier has been implemented and validated. The system uses features from the primary sleep signals from the brain (EEG) and the eyes (AOG) as input. From the EEG, features are derived containing spectral information which is used to classify power in the classical spectral bands, sleep spindles and K-complexes. From AOG, information on rapid eye movements is derived. Features are extracted every 2 seconds. The CPN-based sleep classifier was implemented using the HUGIN system, an application tool to handle causal probabilistic networks. The results obtained using different training approaches show agreements ranging from 68.7 to 70.7% between the system and the two experts when a pooled agreement is computed over the six subjects. As a comparison, the interrater agreement between the two experts was found to be 71.4%, measured also over the six subjects.

scholarly journals Classification of Brainwaves for Sleep Stages by High-Dimensional FFT Features from EEG Signals

2020 ◽  
Vol 10 (5) ◽  
pp. 1797 ◽  
Author(s):  
Mera Kartika Delimayanti ◽  
Bedy Purnama ◽  
Ngoc Giang Nguyen ◽  
Mohammad Reza Faisal ◽  
Kunti Robiatul Mahmudah ◽  
...  
Keyword(s):  
Machine Learning ◽  
Sleep Stage ◽  
Machine Learning Algorithms ◽  
High Dimensional ◽  
Sleep Stages ◽  
Eeg Signals ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
Low Dimensional

Manual classification of sleep stage is a time-consuming but necessary step in the diagnosis and treatment of sleep disorders, and its automation has been an area of active study. The previous works have shown that low dimensional fast Fourier transform (FFT) features and many machine learning algorithms have been applied. In this paper, we demonstrate utilization of features extracted from EEG signals via FFT to improve the performance of automated sleep stage classification through machine learning methods. Unlike previous works using FFT, we incorporated thousands of FFT features in order to classify the sleep stages into 2–6 classes. Using the expanded version of Sleep-EDF dataset with 61 recordings, our method outperformed other state-of-the art methods. This result indicates that high dimensional FFT features in combination with a simple feature selection is effective for the improvement of automated sleep stage classification.

Sign in / Sign up

Export Citation Format

Share Document