scholarly journals A Multi-Level Classification Approach for Sleep Stage Prediction With Processed Data Derived From Consumer Wearable Activity Trackers

2021 ◽  
Vol 3 ◽  
Author(s):  
Zilu Liang ◽  
Mario Alberto Chapa-Martell
Keyword(s):  
Support Vector Machine ◽  
Sleep Stage ◽  
Sleep Stages ◽  
Support Vector ◽  
Cohen’S Kappa ◽  
Cohen's Kappa ◽  
Activity Trackers ◽  
Level Ii ◽  
Wearable Activity Trackers ◽  
Level I

Consumer wearable activity trackers, such as Fitbit are widely used in ubiquitous and longitudinal sleep monitoring in free-living environments. However, these devices are known to be inaccurate for measuring sleep stages. In this study, we develop and validate a novel approach that leverages the processed data readily available from consumer activity trackers (i.e., steps, heart rate, and sleep metrics) to predict sleep stages. The proposed approach adopts a selective correction strategy and consists of two levels of classifiers. The level-I classifier judges whether a Fitbit labeled sleep epoch is misclassified, and the level-II classifier re-classifies misclassified epochs into one of the four sleep stages (i.e., light sleep, deep sleep, REM sleep, and wakefulness). Best epoch-wise performance was achieved when support vector machine and gradient boosting decision tree (XGBoost) with up sampling were used, respectively at the level-I and level-II classification. The model achieved an overall per-epoch accuracy of 0.731 ± 0.119, Cohen's Kappa of 0.433 ± 0.212, and multi-class Matthew's correlation coefficient (MMCC) of 0.451 ± 0.214. Regarding the total duration of individual sleep stage, the mean normalized absolute bias (MAB) of this model was 0.469, which is a 23.9% reduction against the proprietary Fitbit algorithm. The model that combines support vector machine and XGBoost with down sampling achieved sub-optimal per-epoch accuracy of 0.704 ± 0.097, Cohen's Kappa of 0.427 ± 0.178, and MMCC of 0.439 ± 0.180. The sub-optimal model obtained a MAB of 0.179, a significantly reduction of 71.0% compared to the proprietary Fitbit algorithm. We highlight the challenges in machine learning based sleep stage prediction with consumer wearables, and suggest directions for future research.

Sleep-stage scoring in the rat using a support vector machine

2008 ◽  
Vol 168 (2) ◽  
pp. 524-534 ◽  
Author(s):  
Shelly Crisler ◽  
Michael J. Morrissey ◽  
A. Michael Anch ◽  
David W. Barnett
Keyword(s):  
Support Vector Machine ◽  
Sleep Stage ◽  
Support Vector ◽  
Sleep Stage Scoring

scholarly journals Automatic Sleep Stage Classification Based on Two-channel EOG and One-channel EMG

2021 ◽  
Author(s):  
Yanjun LI ◽  
Xianglin Yang ◽  
Zhi Xu ◽  
Yu Zhang ◽  
Zhongping Cao
Keyword(s):  
Sleep Stage ◽  
Kappa Coefficient ◽  
Sleep Monitoring ◽  
Cohen’S Kappa ◽  
Cohen's Kappa ◽  
Stage Classification ◽  
Sleep Stage Classification ◽  
Feature Normalization ◽  
Leave One Out ◽  
Cohen’S Kappa Coefficient

Abstract The sleep monitoring with PSG severely degrades the sleep quality. In order to simplify the hygienic processing and reduce the load of sleep monitoring, an approach to automatic sleep stage classification without electroencephalogram (EEG) was explored. Totally 108 features from two-channel electrooculogram (EOG) and 6 features from one-channel electromyogram (EMG) were extracted. After feature normalization, the random forest (RF) was used to classify five stages, including wakefulness, REM sleep, N1 sleep, N2 sleep and N3 sleep. Using 114 normalized features from the combination of EOG (108 features) and EMG (6 features), the Cohen’s kappa coefficient was 0.749 and the accuracy was 80.8% by leave-one -out cross-validation (LOOCV) for 124 records from ISRUC-Sleep. As a reference for AASM standard, the Cohen’s kappa coefficient was 0.801 and the accuracy was 84.7% for the same dataset based on 438 normalized features from the combination of EEG (324 features), EOG (108 features) and EMG (6 features). In conclusion, the approach by EOG+EMG with the normalization can reduce the load of sleep monitoring, and achieves comparable performances with the "gold standard" EEG+EOG+EMG on sleep classification.

247 Automated sleep staging using wrist-worn device and deep neural networks

SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A100-A100
Author(s):  
Niranjan Sridhar ◽  
Atiyeh Ghoreyshi ◽  
Lance Myers ◽  
Zachary Owens
Keyword(s):  
Heart Rate ◽  
Low Cost ◽  
Population Level ◽  
Health Study ◽  
Sleep Stages ◽  
Sleep Staging ◽  
Free Living ◽  
Cohen’S Kappa ◽  
Class Prediction ◽  
Cohen's Kappa

Abstract Introduction Heart rate is well-known to be modulated by sleep stages. If clinically useful sleep scoring can be performed using only cardiac rhythms, then existing medical and consumer-grade devices that can measure heart rate can enable low-cost sleep evaluations. Methods We trained a neural network which uses dilated convolutional blocks to learn both local and long range features of heart rate extracted from ECG R-wave timing to predict for every non-overlapping 30s epoch of the input the probabilities of the epoch being in one of four classes—wake, light sleep, deep sleep or REM. The largest probability is chosen as the network’s class prediction and used to form the hypnogram. We used the Sleep Heart Health Study (SHHS) and Multi-Ethnic Study of Atherosclerosis Study (MESA) and Physionet Computing in Cardiology (CinC) dataset (over 10000 nights) for training and evaluation. Then we deployed the algorithm on PPG based heart rate measured by a wrist-worn device worn by subjects in a free-living setting. Results On the held out test SHHS dataset (800 nights, 561 subjects), the overall 4-class staging accuracy was 77% and Cohen’s kappa was 0.66. On the CinC dataset (993 nights, 993 subjects), the overall 4 class accuracy was 72% and Cohen’s kappa was 0.55. The study on free-living subjects is underway and these novel results will be collated and presented upon completion. Conclusion We hope these results build more trust in automated heart rate based sleep staging and encourage further research into its clinical application in screening and diagnosis of sleep disorders. Low cost, high efficacy devices which can be used in longitudinal studies can lead to breakthroughs in clinical applications of sleep staging for early diagnosis of chronic conditions and novel treatment endpoints. Support (if any) We recently published the training/testing of the algorithm as well a population level analysis showing differences in predicted sleep stages between disease cohorts. The article was published in NPJ Digital Medicine in Aug 2020. The study on free living subjects is currently underway and these new results will be presented at the sleep conference. Preliminary results indicate high concordance with our published results.

scholarly journals 1205 Activity Trackers As A Tool In Sleep Research: Determining Discrepancies In Trackers Vs. PSG

SLEEP ◽  
2020 ◽  
Vol 43 (Supplement_1) ◽  
pp. A460-A461
Author(s):  
E P Pollet ◽  
D P Pollet ◽  
B Long ◽  
A A Qutub
Keyword(s):  
Sleep Disorders ◽  
Sleep Stage ◽  
Sleep Onset ◽  
Sleep Efficiency ◽  
Sleep Stages ◽  
Sleep Staging ◽  
Sleep Study ◽  
Activity Tracker ◽  
Activity Trackers ◽  
Large Populations

Abstract Introduction Fitness-based wearables and other emerging sensor technologies have the potential to track sleep across large populations longitudinally in at-home environments. To understand how these devices can inform research studies, limitations of available trackers need to be compared to traditional polysomnography (PSG). Here we assessed discrepancies in sleep staging in activity trackers vs. PSG in subjects with various sleep disorders. Methods Twelve subjects (age 41-78, 7f, 5m) wore a Fitbit Charge 3 while undergoing a scheduled sleep study. Six subjects had been previously diagnosed with a sleep disorder (5 OSA, 1 CSA). 4 subjects used CPAP throughout the night, 2 had a split night (CPAP 2nd half of the night), and 6 had a PSG only. Activity tracker staging was compared to 2 RPSGTs staging. Results Of the 12 subjects, eight subjects’ sleep was detected in the activity tracker, and compared across sleep stages to the PSG (7 female, 1 male, ages 41-78, AHI 0.3-87, RDI 0.5-94.4, sleep efficiency 74%+/-18, 4 PSG, 1 split, 3 CPAP). The activity tracker matched either tech 52% (+/- 13). The average difference in score tech and activity tracker staging for sleep onset (SO) was 16 +/- 15 minutes and wake after sleep onset was 43.5 +/- 44 minutes. Sensitivity, specificity, and balanced accuracy were found for each sleep stage. Respectively, Wake: 0.45+/-0.27, 0.97+/-0.03, 0.71+/-0.12, REM: 0.41+/-0.30, 0.90+/-0.06, 0.60+/-0.28, Light: 0.71+/-0.09, 0.58+/-0.19, 0.65+/-0.10, Deep: 0.63+/-0.52, 0.88+/-0.05, 0.59+/-0.49. Conclusion From this study of 12 subjects seen at a sleep clinic for suspected sleep disorders, activity trackers performed best in wake, REM and deep sleep specificity (>=88%), while they lacked sensitivity to REM and wake (<=45%) stages. The tracker did not detect sleep in 4 subjects who had elevated AHI or low sleep efficiency. Further analysis can identify whether discrepancies between the Fitbit and PSG can be predicted by distinct patterns in sleep staging and/or identify subject exclusion criteria for activity tracking studies. Support This project in on-going with the support of Academy Diagnostics Sleep and EEG Center and staff.

scholarly journals Expert-level automated sleep staging of long-term scalp electroencephalography recordings using deep learning

SLEEP ◽  
2020 ◽  
Vol 43 (11) ◽  
Author(s):  
Maurice Abou Jaoude ◽  
Haoqi Sun ◽  
Kyle R Pellerin ◽  
Milena Pavlova ◽  
Rani A Sarkis ◽  
...  
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Learning Algorithm ◽  
Sleep Stages ◽  
Sleep Staging ◽  
Cohen’S Kappa ◽  
Scalp Eeg ◽  
Cohen's Kappa ◽  
Eeg Recordings

Abstract Study Objectives Develop a high-performing, automated sleep scoring algorithm that can be applied to long-term scalp electroencephalography (EEG) recordings. Methods Using a clinical dataset of polysomnograms from 6,431 patients (MGH–PSG dataset), we trained a deep neural network to classify sleep stages based on scalp EEG data. The algorithm consists of a convolutional neural network for feature extraction, followed by a recurrent neural network that extracts temporal dependencies of sleep stages. The algorithm’s inputs are four scalp EEG bipolar channels (F3-C3, C3-O1, F4-C4, and C4-O2), which can be derived from any standard PSG or scalp EEG recording. We initially trained the algorithm on the MGH–PSG dataset and used transfer learning to fine-tune it on a dataset of long-term (24–72 h) scalp EEG recordings from 112 patients (scalpEEG dataset). Results The algorithm achieved a Cohen’s kappa of 0.74 on the MGH–PSG holdout testing set and cross-validated Cohen’s kappa of 0.78 after optimization on the scalpEEG dataset. The algorithm also performed well on two publicly available PSG datasets, demonstrating high generalizability. Performance on all datasets was comparable to the inter-rater agreement of human sleep staging experts (Cohen’s kappa ~ 0.75 ± 0.11). The algorithm’s performance on long-term scalp EEGs was robust over a wide age range and across common EEG background abnormalities. Conclusion We developed a deep learning algorithm that achieves human expert level sleep staging performance on long-term scalp EEG recordings. This algorithm, which we have made publicly available, greatly facilitates the use of large long-term EEG clinical datasets for sleep-related research.

scholarly journals ANALYSIS OF PHOTOPLETHYSMOGRAPHIC MORPHOLOGY IN SLEEP APNEA SYNDROME PATIENTS USING CURVE FITTING AND SUPPORT VECTOR MACHINE

2021 ◽  
pp. 2140019
Author(s):  
XINGE JIANG ◽  
SHOUSHUI WEI ◽  
LINA ZHAO ◽  
FEIFEI LIU ◽  
CHENGYU LIU
Keyword(s):  
Support Vector Machine ◽  
Sleep Apnea ◽  
Sleep Apnea Syndrome ◽  
Classification Model ◽  
Sleep Stages ◽  
Support Vector ◽  
Time Saving ◽  
Model Based ◽  
Apnea Syndrome ◽  
Healthy Persons

This paper develops a time-saving, simple, and comfortable method for detecting Sleep Apnea Syndrome (SAS). Seventy SAS patients and 17 healthy persons were randomly selected in this study, and nine analytical parameters (i.e., [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], [Formula: see text], and [Formula: see text] of healthy persons and SAS patients during five sleep stages (i.e., W, R, N1, N2, and N3) were obtained to construct a SAS classification model based on logarithmic normal analytical parameters using the Support Vector Machine (SVM) method to fit Photoplethysmographic (PPG) signals. The results show that there were no statistical differences among the five sleep stages for either the healthy or SAS patients. However, there were significant differences in the measured logarithmic normal analytical parameters between the healthy persons and the SAS patients in each of the five sleep stages. The accuracies of the SAS classification model were 95.00%, 90.00%, 84.00%, 94.67%, and 90.77%, corresponding to the five sleep stages, respectively. The SAS classification model based on the SVM method of logarithmic normal analysis parameters can achieve higher classification accuracy for each of the five sleep stages. It can be considered to collect the patient’s pulse wave during the awake period, but not necessarily during the sleep period to classify and identify the SAS; it provides an idea for a convenient and comfortable SAS detection.

scholarly journals Deep Learning in Automatic Sleep Staging With a Single Channel Electroencephalography

2021 ◽  
Vol 12 ◽  
Author(s):  
Mingyu Fu ◽  
Yitian Wang ◽  
Zixin Chen ◽  
Jin Li ◽  
Fengguo Xu ◽  
...  
Keyword(s):  
Feature Extraction ◽  
Deep Learning ◽  
Single Channel ◽  
Parietal Lobe ◽  
Kappa Coefficient ◽  
Sleep Stages ◽  
Sleep Staging ◽  
Cohen’S Kappa ◽  
Cohen's Kappa ◽  
Cohen’S Kappa Coefficient

This study centers on automatic sleep staging with a single channel electroencephalography (EEG), with some significant findings for sleep staging. In this study, we proposed a deep learning-based network by integrating attention mechanism and bidirectional long short-term memory neural network (AT-BiLSTM) to classify wakefulness, rapid eye movement (REM) sleep and non-REM (NREM) sleep stages N1, N2 and N3. The AT-BiLSTM network outperformed five other networks and achieved an accuracy of 83.78%, a Cohen’s kappa coefficient of 0.766 and a macro F1-score of 82.14% on the PhysioNet Sleep-EDF Expanded dataset, and an accuracy of 81.72%, a Cohen’s kappa coefficient of 0.751 and a macro F1-score of 80.74% on the DREAMS Subjects dataset. The proposed AT-BiLSTM network even achieved a higher accuracy than the existing methods based on traditional feature extraction. Moreover, better performance was obtained by the AT-BiLSTM network with the frontal EEG derivations than with EEG channels located at the central, occipital or parietal lobe. As EEG signal can be easily acquired using dry electrodes on the forehead, our findings might provide a promising solution for automatic sleep scoring without feature extraction and may prove very useful for the screening of sleep disorders.

Sign in / Sign up

Export Citation Format

Share Document