414 Deep Neural Networks: A Survey Tool for Obstructive Sleep Apnea Prediction

SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A164-A164
Author(s):  
Pahnwat Taweesedt ◽  
JungYoon Kim ◽  
Jaehyun Park ◽  
Jangwoon Park ◽  
Munish Sharma ◽  
...  
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Obstructive Sleep Apnea ◽  
Sleep Apnea ◽  
Deep Neural Networks ◽  
Support Vector ◽  
Learning Models ◽  
Obstructive Sleep ◽  
Screening Questionnaires ◽  
Machine Learning Models

Abstract Introduction Obstructive sleep apnea (OSA) is a common sleep-related breathing disorder with an estimation of one billion people. Full-night polysomnography is considered the gold standard for OSA diagnosis. However, it is time-consuming, expensive and is not readily available in many parts of the world. Many screening questionnaires and scores have been proposed for OSA prediction with high sensitivity and low specificity. The present study is intended to develop models with various machine learning techniques to predict the severity of OSA by incorporating features from multiple questionnaires. Methods Subjects who underwent full-night polysomnography in Torr sleep center, Texas and completed 5 OSA screening questionnaires/scores were included. OSA was diagnosed by using Apnea-Hypopnea Index ≥ 5. We trained five different machine learning models including Deep Neural Networks with the scaled principal component analysis (DNN-PCA), Random Forest (RF), Adaptive Boosting classifier (ABC), and K-Nearest Neighbors classifier (KNC) and Support Vector Machine Classifier (SVMC). Training:Testing subject ratio of 65:35 was used. All features including demographic data, body measurement, snoring and sleepiness history were obtained from 5 OSA screening questionnaires/scores (STOP-BANG questionnaires, Berlin questionnaires, NoSAS score, NAMES score and No-Apnea score). Performance parametrics were used to compare between machine learning models. Results Of 180 subjects, 51.5 % of subjects were male with mean (SD) age of 53.6 (15.1). One hundred and nineteen subjects were diagnosed with OSA. Area Under the Receiver Operating Characteristic Curve (AUROC) of DNN-PCA, RF, ABC, KNC, SVMC, STOP-BANG questionnaire, Berlin questionnaire, NoSAS score, NAMES score, and No-Apnea score were 0.85, 0.68, 0.52, 0.74, 0.75, 0.61, 0.63, 0,61, 0.58 and 0,58 respectively. DNN-PCA showed the highest AUROC with sensitivity of 0.79, specificity of 0.67, positive-predictivity of 0.93, F1 score of 0.86, and accuracy of 0.77. Conclusion Our result showed that DNN-PCA outperforms OSA screening questionnaires, scores and other machine learning models. Support (if any):

Chapter 15. Human-Centered Concept Explanations for Neural Networks

2021 ◽  
Author(s):  
Chih-Kuan Yeh ◽  
Been Kim ◽  
Pradeep Ravikumar
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Case Studies ◽  
Real World ◽  
Deep Neural Networks ◽  
Learning Models ◽  
Real World Applications ◽  
The Right ◽  
Concept Activation ◽  
Machine Learning Models

Understanding complex machine learning models such as deep neural networks with explanations is crucial in various applications. Many explanations stem from the model perspective, and may not necessarily effectively communicate why the model is making its predictions at the right level of abstraction. For example, providing importance weights to individual pixels in an image can only express which parts of that particular image is important to the model, but humans may prefer an explanation which explains the prediction by concept-based thinking. In this work, we review the emerging area of concept based explanations. We start by introducing concept explanations including the class of Concept Activation Vectors (CAV) which characterize concepts using vectors in appropriate spaces of neural activations, and discuss different properties of useful concepts, and approaches to measure the usefulness of concept vectors. We then discuss approaches to automatically extract concepts, and approaches to address some of their caveats. Finally, we discuss some case studies that showcase the utility of such concept-based explanations in synthetic settings and real world applications.

scholarly journals Safety Analysis of Deep Neural Networks

2021 ◽  
Author(s):  
Dario Guidotti
Keyword(s):  
Machine Learning ◽  
Neural Networks ◽  
Computer Science ◽  
Deep Neural Networks ◽  
Safety Analysis ◽  
Learning Models ◽  
Safety Critical ◽  
Machine Learning Models

Deep Neural Networks (DNNs) are popular machine learning models which have found successful application in many different domains across computer science. Nevertheless, providing formal guarantees on the behaviour of neural networks is hard and therefore their reliability in safety-critical domains is still a concern. Verification and repair emerged as promising solutions to address this issue. In the following, I will present some of my recent efforts in this area.

scholarly journals Application of machine learning to predict obstructive sleep apnea syndrome severity

2019 ◽  
Vol 26 (1) ◽  
pp. 298-317 ◽  
Author(s):  
Corrado Mencar ◽  
Crescenzio Gallo ◽  
Marco Mantero ◽  
Paolo Tarsia ◽  
Giovanna E Carpagnano ◽  
...  
Keyword(s):  
Machine Learning ◽  
Obstructive Sleep Apnea ◽  
Sleep Apnea ◽  
Obstructive Sleep Apnea Syndrome ◽  
Sleep Apnea Syndrome ◽  
Support Vector ◽  
Apnea Hypopnea Index ◽  
Machine Learning Methods ◽  
Obstructive Sleep ◽  
Apnea Syndrome

Introduction: Obstructive sleep apnea syndrome has become an important public health concern. Polysomnography is traditionally considered an established and effective diagnostic tool providing information on the severity of obstructive sleep apnea syndrome and the degree of sleep fragmentation. However, the numerous steps in the polysomnography test to diagnose obstructive sleep apnea syndrome are costly and time consuming. This study aimed to test the efficacy and clinical applicability of different machine learning methods based on demographic information and questionnaire data to predict obstructive sleep apnea syndrome severity. Materials and methods: We collected data about demographic characteristics, spirometry values, gas exchange (PaO2, PaCO2) and symptoms (Epworth Sleepiness Scale, snoring, etc.) of 313 patients with previous diagnosis of obstructive sleep apnea syndrome. After principal component analysis, we selected 19 variables which were used for further preprocessing and to eventually train seven types of classification models and five types of regression models to evaluate the prediction ability of obstructive sleep apnea syndrome severity, represented either by class or by apnea–hypopnea index. All models are trained with an increasing number of features and the results are validated through stratified 10-fold cross validation. Results: Comparative results show the superiority of support vector machine and random forest models for classification, while support vector machine and linear regression are better suited to predict apnea–hypopnea index. Also, a limited number of features are enough to achieve the maximum predictive accuracy. The best average classification accuracy on test sets is 44.7 percent, with the same average sensitivity (recall). In only 5.7 percent of cases, a severe obstructive sleep apnea syndrome (class 4) is misclassified as mild (class 2). Regression results show a minimum achieved root mean squared error of 22.17. Conclusion: The problem of predicting apnea–hypopnea index or severity classes for obstructive sleep apnea syndrome is very difficult when using only data collected prior to polysomnography test. The results achieved with the available data suggest the use of machine learning methods as tools for providing patients with a priority level for polysomnography test, but they still cannot be used for automated diagnosis.

scholarly journals Prediction Models for Obstructive Sleep Apnea in Korean Adults Using Machine Learning Techniques

Diagnostics ◽  
2021 ◽  
Vol 11 (4) ◽  
pp. 612
Author(s):  
Young Jae Kim ◽  
Ji Soo Jeon ◽  
Seo-Eun Cho ◽  
Kwang Gi Kim ◽  
Seung-Gul Kang
Keyword(s):  
Machine Learning ◽  
Obstructive Sleep Apnea ◽  
Sleep Apnea ◽  
Test Data ◽  
Prediction Models ◽  
Prediction Performance ◽  
Support Vector ◽  
Obstructive Sleep ◽  
Clinical Indices ◽  
Sensitivity Specificity

This study aimed to investigate the applicability of machine learning to predict obstructive sleep apnea (OSA) among individuals with suspected OSA in South Korea. A total of 92 clinical variables for OSA were collected from 279 South Koreans (OSA, n = 213; no OSA, n = 66), from which seven major clinical indices were selected. The data were randomly divided into training data (OSA, n = 149; no OSA, n = 46) and test data (OSA, n = 64; no OSA, n = 20). Using the seven clinical indices, the OSA prediction models were trained using four types of machine learning models—logistic regression, support vector machine (SVM), random forest, and XGBoost (XGB)—and each model was validated using the test data. In the validation, the SVM showed the best OSA prediction result with a sensitivity, specificity, and area under curve (AUC) of 80.33%, 86.96%, and 0.87, respectively, while the XGB showed the lowest OSA prediction performance with a sensitivity, specificity, and AUC of 78.69%, 73.91%, and 0.80, respectively. The machine learning algorithms showed high OSA prediction performance using data from South Koreans with suspected OSA. Hence, machine learning will be helpful in clinical applications for OSA prediction in the Korean population.

scholarly journals Computational analysis of airflow dynamics for predicting collapsible sites in the upper airways: machine learning approach

2019 ◽  
Vol 127 (4) ◽  
pp. 959-973 ◽  
Author(s):  
Seung Ho Yeom ◽  
Ji Sung Na ◽  
Hwi-Dong Jung ◽  
Hyung-Ju Cho ◽  
Yoon Jeong Choi ◽  
...  
Keyword(s):  
Machine Learning ◽  
Fluid Dynamics ◽  
Computational Fluid Dynamics ◽  
Obstructive Sleep Apnea ◽  
Sleep Apnea ◽  
Gaussian Process ◽  
Gaussian Process Regression ◽  
Support Vector ◽  
Data Set ◽  
Obstructive Sleep

Obstructive sleep apnea (OSA) is a common sleep breathing disorder. With the use of computational fluid dynamics (CFD), this study provides a quantitative standard for accurate diagnosis and effective surgery based on the investigation of the relationship between airway geometry and aerodynamic characteristics. Based on computed tomography data from patients having normal geometry, 4 major geometric parameters were selected and a total of 160 idealized cases were modeled and simulated. We created a predictive model using Gaussian process regression (GPR) through a data set obtained through numerical method. The results demonstrated that the mean accuracy of the overall GPR model was ~72% with respect to the CFD results for the realistic upper airway model. A support vector machine model was also used to identify the degree of OSA symptoms in patients as normal-mild and moderate and severe. We achieved an accuracy of 82.5% with the training data set and an accuracy of 80% with the test data set. NEW & NOTEWORTHY There have been many studies on the analysis of obstructive sleep apnea (OSA) through computational fluid dynamics and finite element analysis. However, these methods are not useful for practical medical applications because they have limited information for OSA symptom. This study employs the machine learning algorithm to predict flow characteristics quickly and to determine the symptoms of the patient's OSA. The overall Gaussian process regression model's mean accuracy was ~72%, and the accuracy for the classification of OSA was >80%.

scholarly journals A Method to Extract Feature Variables Contributed in Nonlinear Machine Learning Prediction

2020 ◽  
Vol 59 (01) ◽  
pp. 001-008
Author(s):  
Mayumi Suzuki ◽  
Takuma Shibahara ◽  
Yoshihiro Muragaki
Keyword(s):  
Machine Learning ◽  
Prediction Accuracy ◽  
Deep Neural Networks ◽  
Extraction Technique ◽  
Support Vector ◽  
Learning Models ◽  
Analysis Technique ◽  
Vector Machines ◽  
Backward Analysis ◽  
Machine Learning Models

Abstract Background Although advances in prediction accuracy have been made with new machine learning methods, such as support vector machines and deep neural networks, these methods make nonlinear machine learning models and thus lack the ability to explain the basis of their predictions. Improving their explanatory capabilities would increase the reliability of their predictions. Objective Our objective was to develop a factor analysis technique that enables the presentation of the feature variables used in making predictions, even in nonlinear machine learning models. Methods A factor analysis technique was consisted of two techniques: backward analysis technique and factor extraction technique. We developed a factor extraction technique extracted feature variables that was obtained from the posterior probability distribution of a machine learning model which was calculated by backward analysis technique. Results In evaluation, using gene expression data from prostate tumor patients and healthy subjects, the prediction accuracy of a model of deep neural networks was approximately 5% better than that of a model of support vector machines. Then the rate of concordance between the feature variables extracted in an earlier report using Jensen–Shannon divergence and the ones extracted in this report using backward elimination using Hilbert–Schmidt independence criteria was 40% for the top five variables, 40% for the top 10, and 49% for the top 100. Conclusion The results showed that models can be evaluated from different viewpoints by using different factor extraction techniques. In the future, we hope to use this technique to verify the characteristics of features extracted by factor extraction technique, and to perform clinical studies using the genes, we extracted in this experiment.

scholarly journals Early Warning System for Online STEM Learning—A Slimmer Approach Using Recurrent Neural Networks

2021 ◽  
Vol 13 (22) ◽  
pp. 12461
Author(s):  
Chih-Chang Yu ◽  
Yufeng (Leon) Wu
Keyword(s):  
Neural Network ◽  
Machine Learning ◽  
Neural Networks ◽  
At Risk ◽  
At Risk Students ◽  
Training Data ◽  
Support Vector ◽  
Learning Models ◽  
Conventional Machine ◽  
Machine Learning Models

While the use of deep neural networks is popular for predicting students’ learning outcomes, convolutional neural network (CNN)-based methods are used more often. Such methods require numerous features, training data, or multiple models to achieve week-by-week predictions. However, many current learning management systems (LMSs) operated by colleges cannot provide adequate information. To make the system more feasible, this article proposes a recurrent neural network (RNN)-based framework to identify at-risk students who might fail the course using only a few common learning features. RNN-based methods can be more effective than CNN-based methods in identifying at-risk students due to their ability to memorize time-series features. The data used in this study were collected from an online course that teaches artificial intelligence (AI) at a university in northern Taiwan. Common features, such as the number of logins, number of posts and number of homework assignments submitted, are considered to train the model. This study compares the prediction results of the RNN model with the following conventional machine learning models: logistic regression, support vector machines, decision trees and random forests. This work also compares the performance of the RNN model with two neural network-based models: the multi-layer perceptron (MLP) and a CNN-based model. The experimental results demonstrate that the RNN model used in this study is better than conventional machine learning models and the MLP in terms of F-score, while achieving similar performance to the CNN-based model with fewer parameters. Our study shows that the designed RNN model can identify at-risk students once one-third of the semester has passed. Some future directions are also discussed.

Sign in / Sign up

Export Citation Format

Share Document