scholarly journals Contactless facial video recording with deep learning models for the detection of atrial fibrillation

2022 ◽  
Vol 12 (1) ◽  
Author(s):  
Yu Sun ◽  
Yin-Yin Yang ◽  
Bing-Jhang Wu ◽  
Po-Wei Huang ◽  
Shao-En Cheng ◽  
...  
Keyword(s):  
Atrial Fibrillation ◽  
Deep Learning ◽  
Large Scale ◽  
Normal Sinus Rhythm ◽  
Video Recording ◽  
Learning Model ◽  
Accuracy Rate ◽  
Normal Sinus ◽  
Deep Learning Model ◽  
Large Scale Screening

AbstractAtrial fibrillation (AF) is often asymptomatic and paroxysmal. Screening and monitoring are needed especially for people at high risk. This study sought to use camera-based remote photoplethysmography (rPPG) with a deep convolutional neural network (DCNN) learning model for AF detection. All participants were classified into groups of AF, normal sinus rhythm (NSR) and other abnormality based on 12-lead ECG. They then underwent facial video recording for 10 min with rPPG signals extracted and segmented into 30-s clips as inputs of the training of DCNN models. Using voting algorithm, the participant would be predicted as AF if > 50% of their rPPG segments were determined as AF rhythm by the model. Of the 453 participants (mean age, 69.3 ± 13.0 years, women, 46%), a total of 7320 segments (1969 AF, 1604 NSR & 3747others) were analyzed by DCNN models. The accuracy rate of rPPG with deep learning model for discriminating AF from NSR and other abnormalities was 90.0% and 97.1% in 30-s and 10-min recording, respectively. This contactless, camera-based rPPG technique with a deep-learning model achieved significantly high accuracy to discriminate AF from non-AF and may enable a feasible way for a large-scale screening or monitoring in the future.

5105A deep neural network predicts atrial fibrillation from normal ECGs recorded on a smartphone-enabled device

2019 ◽  
Vol 40 (Supplement_1) ◽  
Author(s):  
C Galloway ◽  
D Treiman ◽  
J Shreibati ◽  
M Schram ◽  
Z Karbaschi ◽  
...  
Keyword(s):  
Neural Network ◽  
Atrial Fibrillation ◽  
Deep Learning ◽  
Sinus Rhythm ◽  
Sensitivity And Specificity ◽  
Normal Sinus Rhythm ◽  
Learning Model ◽  
Normal Sinus ◽  
Normal Ecgs ◽  
Deep Learning Model

Abstract Background Electrocardiographic predictors of atrial fibrillation (AF) from a non-AF ECG–such as p wave abnormalities and supraventricular ectopy–have been extensively documented. However, risk prediction tools for AF utilize little if any of the wealth of information available from the ECG. Better AF prediction from the ECG may improve efficiency of screening and performance of AF risk tools. Deep learning methods have the potential to extract an unlimited number of features from the ECG to improve prediction of AF. Purpose We hypothesize that a deep learning model can identify patterns predictive of AF during normal sinus rhythm. To test the hypothesis, we trained and tested a neural network to predict AF from normal sinus rhythm ambulatory ECG data. Methods We trained a deep convolutional neural network to detect features of AF that are present in single-lead ECGs with normal sinus rhythm, recorded using a Food and Drug Administration (FDA)-cleared, smartphone-enabled device. A cohort of 27,526 patients with at least 50 ECGs recorded between January 7, 2013, and September, 19, 2018, and the FDA-cleared automated findings of Normal and Atrial Fibrillation associated with those ECGs, were used for model development. Specifically, we trained the deep learning model on 1,984,581 Normal ECGs from 19,267 patients with 1) only Normal ECG recordings, or 2) at least 30% ECGs with AF. Of the 27,526 patients, an internal set of 8,259 patients with 841,776 Normal ECGs was saved for testing (validation). Results Among 8,259 patients in the test set, 3,467 patients had at least 30% of their ECGs with an automated finding of AF. When the deep learning model was run on 841,776 Normal ECGs, it was able to predict whether the ECG was from a patient with no AF or with 30% or more AF, with an area under the curve (AUC) of 0.80. Using an operating point with equal sensitivity and specificity, the model's sensitivity and specificity were 73.1%. Using an operating point with high specificity (90.0%), the model's sensitivity was 48.0%. When the model was applied to a randomly-selected, broader cohort of 15,000 patients (at least 50 ECGs recorded, any amount of AF), a positive, non-linear relationship between neural network output and AF burden per patient was observed (Figure). Model Output vs AF Burden Per Patient Conclusions A deep learning model was able to predict AF from ECGs in normal sinus rhythm that were recorded on a smartphone-enabled device. The use of deep learning, if prospectively validated, may facilitate AF screening in patients with paroxysmal disease or warn patients who are at high risk for developing AF. Acknowledgement/Funding AliveCor

scholarly journals Microwave Dielectric Property Retrieval from Open-Ended Coaxial Probe Response with Deep Learning

2021 ◽  
Author(s):  
Cemanur Aydinalp ◽  
Sulayman Joof ◽  
Mehmet Nuri Akinci ◽  
Ibrahim Akduman ◽  
Tuba Yilmaz
Keyword(s):  
Deep Learning ◽  
Dielectric Property ◽  
Large Scale ◽  
Real Data ◽  
Learning Model ◽  
Data Generation ◽  
Retrieval Technique ◽  
Design Flexibility ◽  
A New Technique ◽  
Deep Learning Model

In the manuscript, we propose a new technique for determination of Debye parameters, representing the dielectric properties of materials, from the reflection coefficient response of open-ended coaxial probes. The method retrieves the Debye parameters using a deep learning model designed through utilization of numerically generated data. Unlike real data, using synthetically generated input and output data for training purposes provides representation of a wide variety of materials with rapid data generation. Furthermore, the proposed method provides design flexibility and can be applied to any desired probe with intended dimensions and material. Next, we experimentally verified the designed deep learning model using measured reflection coefficients when the probe was terminated with five different standard liquids, four mixtures,and a gel-like material.and compared the results with the literature. Obtained mean percent relative error was ranging from 1.21±0.06 to 10.89±0.08. Our work also presents a large-scale statistical verification of the proposed dielectric property retrieval technique.

scholarly journals A Physics-Infused Deep Learning Model for the Prediction of Refractive Indices and Its Use for the Large-Scale Screening of Organic Compound Space

2019 ◽  
Author(s):  
Mojtaba Haghighatlari ◽  
Gaurav Vishwakarma ◽  
Mohammad Atif Faiz Afzal ◽  
Johannes Hachmann
Keyword(s):  
Machine Learning ◽  
Deep Learning ◽  
Large Scale ◽  
Organic Molecules ◽  
Learning Model ◽  
Training Data ◽  
Refractive Indices ◽  
Learning Models ◽  
Deep Learning Model ◽  
Machine Learning Models

<div><div><div><p>We present a multitask, physics-infused deep learning model to accurately and efficiently predict refractive indices (RIs) of organic molecules, and we apply it to a library of 1.5 million compounds. We show that it outperforms earlier machine learning models by a significant margin, and that incorporating known physics into data-derived models provides valuable guardrails. Using a transfer learning approach, we augment the model to reproduce results consistent with higher-level computational chemistry training data, but with a considerably reduced number of corresponding calculations. Prediction errors of machine learning models are typically smallest for commonly observed target property values, consistent with the distribution of the training data. However, since our goal is to identify candidates with unusually large RI values, we propose a strategy to boost the performance of our model in the remoter areas of the RI distribution: We bias the model with respect to the under-represented classes of molecules that have values in the high-RI regime. By adopting a metric popular in web search engines, we evaluate our effectiveness in ranking top candidates. We confirm that the models developed in this study can reliably predict the RIs of the top 1,000 compounds, and are thus able to capture their ranking. We believe that this is the first study to develop a data-derived model that ensures the reliability of RI predictions by model augmentation in the extrapolation region on such a large scale. These results underscore the tremendous potential of machine learning in facilitating molecular (hyper)screening approaches on a massive scale and in accelerating the discovery of new compounds and materials, such as organic molecules with high-RI for applications in opto-electronics.</p></div></div></div>

scholarly journals Spatio-temporal deep learning model for distortion classification in laparoscopic video

F1000Research ◽  
2021 ◽  
Vol 10 ◽  
pp. 1010
Author(s):  
Nouar AlDahoul ◽  
Hezerul Abdul Karim ◽  
Abdulaziz Saleh Ba Wazir ◽  
Myles Joshua Toledo Tan ◽  
Mohammad Faizal Ahmad Fauzi
Keyword(s):  
Deep Learning ◽  
Large Scale ◽  
Spatial Information ◽  
Short Term Memory ◽  
Learning Model ◽  
Motion Blur ◽  
Video Frame ◽  
Video Enhancement ◽  
Deep Learning Model ◽  
Laparoscopic Videos

Background: Laparoscopy is a surgery performed in the abdomen without making large incisions in the skin and with the aid of a video camera, resulting in laparoscopic videos. The laparoscopic video is prone to various distortions such as noise, smoke, uneven illumination, defocus blur, and motion blur. One of the main components in the feedback loop of video enhancement systems is distortion identification, which automatically classifies the distortions affecting the videos and selects the video enhancement algorithm accordingly. This paper aims to address the laparoscopic video distortion identification problem by developing fast and accurate multi-label distortion classification using a deep learning model. Current deep learning solutions based on convolutional neural networks (CNNs) can address laparoscopic video distortion classification, but they learn only spatial information. Methods: In this paper, utilization of both spatial and temporal features in a CNN-long short-term memory (CNN-LSTM) model is proposed as a novel solution to enhance the classification. First, pre-trained ResNet50 CNN was used to extract spatial features from each video frame by transferring representation from large-scale natural images to laparoscopic images. Next, LSTM was utilized to consider the temporal relation between the features extracted from the laparoscopic video frames to produce multi-label categories. A novel laparoscopic video dataset proposed in the ICIP2020 challenge was used for training and evaluation of the proposed method. Results: The experiments conducted show that the proposed CNN-LSTM outperforms the existing solutions in terms of accuracy (85%), and F1-score (94.2%). Additionally, the proposed distortion identification model is able to run in real-time with low inference time (0.15 sec). Conclusions: The proposed CNN-LSTM model is a feasible solution to be utilized in laparoscopic videos for distortion identification.

scholarly journals A morphology based deep learning model for atrial fibrillation detection using single cycle electrocardiographic samples

2020 ◽  
Vol 316 ◽  
pp. 130-136 ◽  
Author(s):  
Sarah W.E. Baalman ◽  
Florian E. Schroevers ◽  
Abel J. Oakley ◽  
Tom F. Brouwer ◽  
Willeke van der Stuijt ◽  
...  
Keyword(s):  
Atrial Fibrillation ◽  
Deep Learning ◽  
Learning Model ◽  
Single Cycle ◽  
Deep Learning Model ◽  
Atrial Fibrillation Detection

scholarly journals Hierarchical Graph Transformer-Based Deep Learning Model for Large-Scale Multi-Label Text Classification

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 30885-30896 ◽  
Author(s):  
Jibing Gong ◽  
Hongyuan Ma ◽  
Zhiyong Teng ◽  
Qi Teng ◽  
Hekai Zhang ◽  
...  
Keyword(s):  
Deep Learning ◽  
Text Classification ◽  
Large Scale ◽  
Learning Model ◽  
Hierarchical Graph ◽  
Deep Learning Model

scholarly journals A Joint Deep Learning Model for Simultaneous Batch Effect Correction, Denoising and Clustering in Single-Cell Transcriptomics

2020 ◽  
Author(s):  
Justin Lakkis ◽  
David Wang ◽  
Yuanchao Zhang ◽  
Gang Hu ◽  
Kui Wang ◽  
...  
Keyword(s):  
Gene Expression ◽  
Deep Learning ◽  
Single Cell ◽  
Large Scale ◽  
Nearest Neighbor ◽  
Learning Model ◽  
Batch Effect ◽  
Marker Genes ◽  
Deep Learning Model ◽  
Variable Genes

AbstractRecent development of single-cell RNA-seq (scRNA-seq) technologies has led to enormous biological discoveries. As the scale of scRNA-seq studies increases, a major challenge in analysis is batch effect, which is inevitable in studies involving human tissues. Most existing methods remove batch effect in a low-dimensional embedding space. Although useful for clustering, batch effect is still present in the gene expression space, leaving downstream gene-level analysis susceptible to batch effect. Recent studies have shown that batch effect correction in the gene expression space is much harder than in the embedding space. Popular methods such as Seurat3.0 rely on the mutual nearest neighbor (MNN) approach to remove batch effect in the gene expression space, but MNN can only analyze two batches at a time and it becomes computationally infeasible when the number of batches is large. Here we present CarDEC, a joint deep learning model that simultaneously clusters and denoises scRNA-seq data, while correcting batch effect both in the embedding and the gene expression space. Comprehensive evaluations spanning different species and tissues showed that CarDEC consistently outperforms scVI, DCA, and MNN. With CarDEC denoising, those non-highly variable genes offer as much signal for clustering as the highly variable genes, suggesting that CarDEC substantially boosted information content in scRNA-seq. We also showed that trajectory analysis using CarDEC’s denoised and batch corrected expression as input revealed marker genes and transcription factors that are otherwise obscured in the presence of batch effect. CarDEC is computationally fast, making it a desirable tool for large-scale scRNA-seq studies.

scholarly journals Detection of Brief Episodes of Atrial Fibrillation Based on Electrocardiomatrix and Convolutional Neural Network

2021 ◽  
Vol 12 ◽  
Author(s):  
Ricardo Salinas-Martínez ◽  
Johannes de Bie ◽  
Nicoletta Marzocchi ◽  
Frida Sandberg
Keyword(s):  
Neural Network ◽  
Atrial Fibrillation ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Thrombus Formation ◽  
Normal Sinus Rhythm ◽  
Morphological Characteristics ◽  
P Wave ◽  
Learning Approaches ◽  
Normal Sinus

Background: Brief episodes of atrial fibrillation (AF) may evolve into longer AF episodes increasing the chances of thrombus formation, stroke, and death. Classical methods for AF detection investigate rhythm irregularity or P-wave absence in the ECG, while deep learning approaches profit from the availability of annotated ECG databases to learn discriminatory features linked to different diagnosis. However, some deep learning approaches do not provide analysis of the features used for classification. This paper introduces a convolutional neural network (CNN) approach for automatic detection of brief AF episodes based on electrocardiomatrix-images (ECM-images) aiming to link deep learning to features with clinical meaning.Materials and Methods: The CNN is trained using two databases: the Long-Term Atrial Fibrillation and the MIT-BIH Normal Sinus Rhythm, and tested on three databases: the MIT-BIH Atrial Fibrillation, the MIT-BIH Arrhythmia, and the Monzino-AF. Detection of AF is done using a sliding window of 10 beats plus 3 s. Performance is quantified using both standard classification metrics and the EC57 standard for arrhythmia detection. Layer-wise relevance propagation analysis was applied to link the decisions made by the CNN to clinical characteristics in the ECG.Results: For all three testing databases, episode sensitivity was greater than 80.22, 89.66, and 97.45% for AF episodes shorter than 15, 30 s, and for all episodes, respectively.Conclusions: Rhythm and morphological characteristics of the electrocardiogram can be learned by a CNN from ECM-images for the detection of brief episodes of AF.

scholarly journals DiPLIP: Distributed Parallel Processing Platform for Stream Image Processing Based on Deep Learning Model Inference

Electronics ◽  
2020 ◽  
Vol 9 (10) ◽  
pp. 1664
Author(s):  
Yoon-Ki Kim ◽  
Yongsung Kim
Keyword(s):  
Image Processing ◽  
Deep Learning ◽  
Parallel Processing ◽  
Real Time ◽  
Large Scale ◽  
Learning Model ◽  
Streaming Data ◽  
Model Inference ◽  
Processing Platform ◽  
Deep Learning Model

Recently, as the amount of real-time video streaming data has increased, distributed parallel processing systems have rapidly evolved to process large-scale data. In addition, with an increase in the scale of computing resources constituting the distributed parallel processing system, the orchestration of technology has become crucial for proper management of computing resources, in terms of allocating computing resources, setting up a programming environment, and deploying user applications. In this paper, we present a new distributed parallel processing platform for real-time large-scale image processing based on deep learning model inference, called DiPLIP. It provides a scheme for large-scale real-time image inference using buffer layer and a scalable parallel processing environment according to the size of the stream image. It allows users to easily process trained deep learning models for processing real-time images in a distributed parallel processing environment at high speeds, through the distribution of the virtual machine container.

Sign in / Sign up

Export Citation Format

Share Document