Video-Based Deep Learning to Detect Dyssynergic Defecation with 3D High-Definition Anorectal Manometry

BACKGROUND AND AIMS: Evaluation for dyssynergia is the most common reason that gastroenterologists refer patients for anorectal manometry, because dyssynergia is amenable to biofeedback by physical therapists. High-definition anorectal manometry (3D-HDAM) is a promising technology to evaluate anorectal physiology, but adoption remains limited by its sheer complexity. We developed a 3D-HDAM deep learning algorithm to evaluate for dyssynergia. METHODS: Spatial-temporal data were extracted from consecutive 3D-HDAM studies performed between 2018-2020 at a tertiary institution. The technical procedure and gold standard definition of dyssynergia were based on the London consensus, adapted to the needs of 3D-HDAM technology. Three machine learning models were generated: (1) traditional machine learning informed by conventional anorectal function metrics, (2) deep learning, and (3) a hybrid approach. Diagnostic accuracy was evaluated using bootstrap sampling to calculate area-under-the-curve (AUC). To evaluate overfitting, models were validated by adding 502 simulated defecation maneuvers with diagnostic ambiguity. RESULTS: 302 3D-HDAM studies representing 1,208 simulated defecation maneuvers were included (average age 55.2 years; 80.5% women). The deep learning model had comparable diagnostic accuracy (AUC=0.91 [95% confidence interval 0.89-0.93]) to traditional (AUC=0.93[0.92-0.95]) and hybrid (AUC=0.96[0.94-0.97]) predictive models in training cohorts. However, the deep learning model handled ambiguous tests more cautiously than other models; the deep learning model was more likely to designate an ambiguous test as inconclusive (odds ratio=4.21[2.78-6.38]) versus traditional/hybrid approaches. CONCLUSIONS: By considering complex spatial-temporal information beyond conventional anorectal function metrics, deep learning on 3D-HDAM technology may enable gastroenterologists to reliably identify and manage dyssynergia in broader practice.

Download Full-text

MON-535 Deep-Machine Learning for Objective Quantification of Nerves in Immunohistochemistry Specimens of Thyroid Cancer

Journal of the Endocrine Society ◽

10.1210/jendso/bvaa046.1335 ◽

2020 ◽

Vol 4 (Supplement_1) ◽

Author(s):

Indriani Astono ◽

Christopher W Rowe ◽

James Welsh ◽

Phillip Jobling

Keyword(s):

Machine Learning ◽

Thyroid Cancer ◽

Deep Learning ◽

Learning Algorithm ◽

Learning Model ◽

Colour Filter ◽

True Positive ◽

Thyroid Cancers ◽

Manual Counting ◽

Deep Learning Model

Abstract Introduction: Nerves in the cancer microenvironment have prognostic significance, and nerve-cancer crosstalk may contribute to tumour progression, but the role of nerves in thyroid cancer is not known (1). Reproducible techniques to quantify innervation are lacking, with reliance on manual counting or basic single-parameter digital quantification. Aims: To determine if a deep machine learning algorithm could objectively quantify nerves in a digital histological dataset of thyroid cancers immunostained for the specific pan-neuronal marker PGP9.5. Methods: A training dataset of 30 digitised papillary thyroid cancer immunohistochemistry slides were manually screened for PGP9.5 positive nerves, annotated using QuPath (2). 1500 true positive nerves were identified. This dataset was used to train the deep-learning algorithm. First, a colour filter identified pixels positive for PGP9.5 (Model 1). Then, a manually tuned colour filter and clustering method identified Regions of Interest (ROIs): clusters of PGP9.5 positive pixels that may represent nerves (Model 2). These ROIs were classified by the deep learning model (Model 3), based on a Convolutional Neural Network with approximately 2.7 million trainable parameters. The full model was run on a testing dataset of thyroid cancer slides (n=5), containing 7-35 manually identified nerves per slide. Model predictions were validated by human assessment of a random subset of 100 ROIs. The code was written in Python and the model was developed in Keras. Results: Model 2 (colour filter + clustering only) identified median 2247 ROIs per slide (range 349-4748), which included 94% of the manually identified nerves. However, most Model 2 ROIs were false positives (FP) (median 85% FP, range 68-95%), indicating that Model 2 was sensitive but poorly specific for nerve identification. Model 3 (deep learning) identified fewer ROIs per slide (median 1068, range 150-3091), but still correctly identified 94% of manually annotated nerves. Of the additionally detected ROIs in Model 3, median FP rate was 35%. However, in slides where higher non-specific immunostaining was present, then the number of FP ROIs was >90%. Conclusion: Simple image analysis based on colour filtration/cluster analysis does not accurately identify immunohistochemically labelled nerves in thyroid cancers. Addition of deep-learning improves sensitivity with acceptable specificity, and significantly increases the number of true positive nerves detected compared to manual counting. However, the current deep learning model lacks specificity in the setting of non-specific immunostaining, which is a basis for improving further iterations of this model to facilitate study of the significance of innervation of thyroid and other cancers. References: (1) Faulkner et al. Cancer Discovery (2019) doi: 10.1158/2159-8290.CD-18-1398. (2) Bankhead P et al. Sci Rep 2017;7(1):16878.

Download Full-text

Exploration of machine algorithms based on deep learning model and feature extraction

Mathematical Biosciences and Engineering ◽

10.3934/mbe.2021376 ◽

2021 ◽

Vol 18 (6) ◽

pp. 7602-7618

Author(s):

Yufeng Qian ◽

Keyword(s):

Machine Learning ◽

Feature Extraction ◽

Deep Learning ◽

Lifelong Learning ◽

Learning Algorithm ◽

Learning Model ◽

Learning System ◽

Classification Error ◽

Model Learning ◽

Deep Learning Model

<abstract> <p>The study expects to solve the problems of insufficient labeling, high input dimension, and inconsistent task input distribution in traditional lifelong machine learning. A new deep learning model is proposed by combining feature representation with a deep learning algorithm. First, based on the theoretical basis of the deep learning model and feature extraction. The study analyzes several representative machine learning algorithms, and compares the performance of the optimized deep learning model with other algorithms in a practical application. By explaining the machine learning system, the study introduces two typical algorithms in machine learning, namely ELLA (Efficient lifelong learning algorithm) and HLLA (Hierarchical lifelong learning algorithm). Second, the flow of the genetic algorithm is described, and combined with mutual information feature extraction in a machine algorithm, to form a composite algorithm HLLA (Hierarchical lifelong learning algorithm). Finally, the deep learning model is optimized and a deep learning model based on the HLLA algorithm is constructed. When K = 1200, the classification error rate reaches 0.63%, which reflects the excellent performance of the unsupervised database algorithm based on this model. Adding the feature model to the updating iteration process of lifelong learning deepens the knowledge base ability of lifelong machine learning, which is of great value to reduce the number of labels required for subsequent model learning and improve the efficiency of lifelong learning.</p> </abstract>

Download Full-text

Non-invasive cuff-less blood pressure estimation using a hybrid deep learning model

Optical and Quantum Electronics ◽

10.1007/s11082-020-02667-0 ◽

2021 ◽

Vol 53 (2) ◽

Author(s):

Sen Yang ◽

Yaping Zhang ◽

Siu-Yeung Cho ◽

Ricardo Correia ◽

Stephen P. Morgan

Keyword(s):

Machine Learning ◽

Blood Pressure ◽

Deep Learning ◽

Absolute Error ◽

Learning Model ◽

Physiological Measurement ◽

British Hypertension Society ◽

Non Invasive ◽

Blood Pressure Estimation ◽

Deep Learning Model

AbstractConventional blood pressure (BP) measurement methods have different drawbacks such as being invasive, cuff-based or requiring manual operations. There is significant interest in the development of non-invasive, cuff-less and continual BP measurement based on physiological measurement. However, in these methods, extracting features from signals is challenging in the presence of noise or signal distortion. When using machine learning, errors in feature extraction result in errors in BP estimation, therefore, this study explores the use of raw signals as a direct input to a deep learning model. To enable comparison with the traditional machine learning models which use features from the photoplethysmogram and electrocardiogram, a hybrid deep learning model that utilises both raw signals and physical characteristics (age, height, weight and gender) is developed. This hybrid model performs best in terms of both diastolic BP (DBP) and systolic BP (SBP) with the mean absolute error being 3.23 ± 4.75 mmHg and 4.43 ± 6.09 mmHg respectively. DBP and SBP meet the Grade A and Grade B performance requirements of the British Hypertension Society respectively.

Download Full-text

Semantic segmentation of PolSAR image data using advanced deep learning model

Scientific Reports ◽

10.1038/s41598-021-94422-y ◽

2021 ◽

Vol 11 (1) ◽

Author(s):

Rajat Garg ◽

Anil Kumar ◽

Nikunj Bansal ◽

Manish Prateek ◽

Shashi Kumar

Keyword(s):

Machine Learning ◽

Remote Sensing ◽

Deep Learning ◽

Urban Area ◽

Urban Areas ◽

Learning Algorithms ◽

Semantic Segmentation ◽

Learning Model ◽

Machine Learning Algorithms ◽

Deep Learning Model

AbstractUrban area mapping is an important application of remote sensing which aims at both estimation and change in land cover under the urban area. A major challenge being faced while analyzing Synthetic Aperture Radar (SAR) based remote sensing data is that there is a lot of similarity between highly vegetated urban areas and oriented urban targets with that of actual vegetation. This similarity between some urban areas and vegetation leads to misclassification of the urban area into forest cover. The present work is a precursor study for the dual-frequency L and S-band NASA-ISRO Synthetic Aperture Radar (NISAR) mission and aims at minimizing the misclassification of such highly vegetated and oriented urban targets into vegetation class with the help of deep learning. In this study, three machine learning algorithms Random Forest (RF), K-Nearest Neighbour (KNN), and Support Vector Machine (SVM) have been implemented along with a deep learning model DeepLabv3+ for semantic segmentation of Polarimetric SAR (PolSAR) data. It is a general perception that a large dataset is required for the successful implementation of any deep learning model but in the field of SAR based remote sensing, a major issue is the unavailability of a large benchmark labeled dataset for the implementation of deep learning algorithms from scratch. In current work, it has been shown that a pre-trained deep learning model DeepLabv3+ outperforms the machine learning algorithms for land use and land cover (LULC) classification task even with a small dataset using transfer learning. The highest pixel accuracy of 87.78% and overall pixel accuracy of 85.65% have been achieved with DeepLabv3+ and Random Forest performs best among the machine learning algorithms with overall pixel accuracy of 77.91% while SVM and KNN trail with an overall accuracy of 77.01% and 76.47% respectively. The highest precision of 0.9228 is recorded for the urban class for semantic segmentation task with DeepLabv3+ while machine learning algorithms SVM and RF gave comparable results with a precision of 0.8977 and 0.8958 respectively.

Download Full-text

A Hybrid Prognostics Deep Learning Model for Remaining Useful Life Prediction

Electronics ◽

10.3390/electronics10010039 ◽

2020 ◽

Vol 10 (1) ◽

pp. 39

Author(s):

Zhiyuan Xie ◽

Shichang Du ◽

Jun Lv ◽

Yafei Deng ◽

Shiyao Jia

Keyword(s):

Machine Learning ◽

Deep Learning ◽

Learning Model ◽

Recurrent Network ◽

Remaining Useful Life ◽

Support Vector ◽

Second Phase ◽

Learning Methods ◽

Useful Life ◽

Deep Learning Model

Remaining Useful Life (RUL) prediction is significant in indicating the health status of the sophisticated equipment, and it requires historical data because of its complexity. The number and complexity of such environmental parameters as vibration and temperature can cause non-linear states of data, making prediction tremendously difficult. Conventional machine learning models such as support vector machine (SVM), random forest, and back propagation neural network (BPNN), however, have limited capacity to predict accurately. In this paper, a two-phase deep-learning-model attention-convolutional forget-gate recurrent network (AM-ConvFGRNET) for RUL prediction is proposed. The first phase, forget-gate convolutional recurrent network (ConvFGRNET) is proposed based on a one-dimensional analog long short-term memory (LSTM), which removes all the gates except the forget gate and uses chrono-initialized biases. The second phase is the attention mechanism, which ensures the model to extract more specific features for generating an output, compensating the drawbacks of the FGRNET that it is a black box model and improving the interpretability. The performance and effectiveness of AM-ConvFGRNET for RUL prediction is validated by comparing it with other machine learning methods and deep learning methods on the Commercial Modular Aero-Propulsion System Simulation (C-MAPSS) dataset and a dataset of ball screw experiment.

Download Full-text

Deep Learning for the Automated Classification of Functional Brain Networks in fMRI (Preprint)

10.2196/preprints.33825 ◽

2021 ◽

Author(s):

Lukman Ismael ◽

Pejman Rasti ◽

Florian Bernard ◽

Philippe Menei ◽

Aram Ter Minassian ◽

...

Keyword(s):

Machine Learning ◽

Deep Learning ◽

Learning Algorithms ◽

Brain Networks ◽

Learning Model ◽

Machine Learning Algorithms ◽

Functional Networks ◽

Functional Brain ◽

Functional Brain Networks ◽

Deep Learning Model

BACKGROUND The functional MRI (fMRI) is an essential tool for the presurgical planning of brain tumor removal, allowing the identification of functional brain networks in order to preserve the patient’s neurological functions. One fMRI technique used to identify the functional brain network is the resting-state-fMRI (rsfMRI). However, this technique is not routinely used because of the necessity to have a expert reviewer to identify manually each functional networks. OBJECTIVE We aimed to automatize the detection of brain functional networks in rsfMRI data using deep learning and machine learning algorithms METHODS We used the rsfMRI data of 82 healthy patients to test the diagnostic performance of our proposed end-to-end deep learning model to the reference functional networks identified manually by 2 expert reviewers. RESULTS Experiment results show the best performance of 86% correct recognition rate obtained from the proposed deep learning architecture which shows its superiority over other machine learning algorithms that were equally tested for this classification task. CONCLUSIONS The proposed end-to-end deep learning model was the most performant machine learning algorithm. The use of this model to automatize the functional networks detection in rsfMRI may allow to broaden the use of the rsfMRI, allowing the presurgical identification of these networks and thus help to preserve the patient’s neurological status. CLINICALTRIAL Comité de protection des personnes Ouest II, decision reference CPP 2012-25)

Download Full-text

A Physics-Infused Deep Learning Model for the Prediction of Refractive Indices and Its Use for the Large-Scale Screening of Organic Compound Space

10.26434/chemrxiv.8796950 ◽

2019 ◽

Author(s):

Mojtaba Haghighatlari ◽

Gaurav Vishwakarma ◽

Mohammad Atif Faiz Afzal ◽

Johannes Hachmann

Keyword(s):

Machine Learning ◽

Deep Learning ◽

Large Scale ◽

Organic Molecules ◽

Learning Model ◽

Training Data ◽

Refractive Indices ◽

Learning Models ◽

Deep Learning Model ◽

Machine Learning Models

<div><div><div><p>We present a multitask, physics-infused deep learning model to accurately and efficiently predict refractive indices (RIs) of organic molecules, and we apply it to a library of 1.5 million compounds. We show that it outperforms earlier machine learning models by a significant margin, and that incorporating known physics into data-derived models provides valuable guardrails. Using a transfer learning approach, we augment the model to reproduce results consistent with higher-level computational chemistry training data, but with a considerably reduced number of corresponding calculations. Prediction errors of machine learning models are typically smallest for commonly observed target property values, consistent with the distribution of the training data. However, since our goal is to identify candidates with unusually large RI values, we propose a strategy to boost the performance of our model in the remoter areas of the RI distribution: We bias the model with respect to the under-represented classes of molecules that have values in the high-RI regime. By adopting a metric popular in web search engines, we evaluate our effectiveness in ranking top candidates. We confirm that the models developed in this study can reliably predict the RIs of the top 1,000 compounds, and are thus able to capture their ranking. We believe that this is the first study to develop a data-derived model that ensures the reliability of RI predictions by model augmentation in the extrapolation region on such a large scale. These results underscore the tremendous potential of machine learning in facilitating molecular (hyper)screening approaches on a massive scale and in accelerating the discovery of new compounds and materials, such as organic molecules with high-RI for applications in opto-electronics.</p></div></div></div>

Download Full-text

Case Study of Deep Learning Model of Temperature-Induced Deflection of a Cable-Stayed Bridge Driven by Data Knowledge

Symmetry ◽

10.3390/sym13122293 ◽

2021 ◽

Vol 13 (12) ◽

pp. 2293

Author(s):

Zixiang Yue ◽

Youliang Ding ◽

Hanwei Zhao ◽

Zhiwen Wang

Keyword(s):

Neural Network ◽

Machine Learning ◽

Deep Learning ◽

Prior Knowledge ◽

Learning Model ◽

Bridge Management ◽

Learning Network ◽

Cable Stayed Bridge ◽

Main Girder ◽

Deep Learning Model

A cable-stayed bridge is a typical symmetrical structure, and symmetry affects the deformation characteristics of such bridges. The main girder of a cable-stayed bridge will produce obvious deflection under the inducement of temperature. The regression model of temperature-induced deflection is hoped to provide a comparison value for bridge evaluation. Based on the temperature and deflection data obtained by the health monitoring system of a bridge, establishing the correlation model between temperature and temperature-induced deflection is meaningful. It is difficult to complete a high-quality model only by the girder temperature. The temperature features based on prior knowledge from the mechanical mechanism are used as the input information in this paper. At the same time, to strengthen the nonlinear ability of the model, this paper selects an independent recurrent neural network (IndRNN) for modeling. The deep learning neural network is compared with machine learning neural networks to prove the advancement of deep learning. When only the average temperature of the main girder is input, the calculation accuracy is not high regardless of whether the deep learning network or the machine learning network is used. When the temperature information extracted by the prior knowledge is input, the average error of IndRNN model is only 2.53%, less than those of BPNN model and traditional RNN. Combining knowledge with deep learning is undoubtedly the best modeling scheme. The deep learning model can provide a comparison value of bridge deformation for bridge management.

Download Full-text

Comparison between Deep Learning and Tree-Based Machine Learning Approaches for Landslide Susceptibility Mapping

Water ◽

10.3390/w13192664 ◽

2021 ◽

Vol 13 (19) ◽

pp. 2664

Author(s):

Sunil Saha ◽

Jagabandhu Roy ◽

Tusar Kanti Hembram ◽

Biswajeet Pradhan ◽

Abhirup Dikshit ◽

...

Keyword(s):

Neural Network ◽

Machine Learning ◽

Deep Learning ◽

Landslide Susceptibility ◽

Learning Model ◽

Susceptibility Mapping ◽

Landslide Susceptibility Mapping ◽

Learning Approaches ◽

Statistical Measures ◽

Deep Learning Model

The efficiency of deep learning and tree-based machine learning approaches has gained immense popularity in various fields. One deep learning model viz. convolution neural network (CNN), artificial neural network (ANN) and four tree-based machine learning models, namely, alternative decision tree (ADTree), classification and regression tree (CART), functional tree and logistic model tree (LMT), were used for landslide susceptibility mapping in the East Sikkim Himalaya region of India, and the results were compared. Landslide areas were delimited and mapped as landslide inventory (LIM) after gathering information from historical records and periodic field investigations. In LIM, 91 landslides were plotted and classified into training (64 landslides) and testing (27 landslides) subsets randomly to train and validate the models. A total of 21 landslide conditioning factors (LCFs) were considered as model inputs, and the results of each model were categorised under five susceptibility classes. The receiver operating characteristics curve and 21 statistical measures were used to evaluate and prioritise the models. The CNN deep learning model achieved the priority rank 1 with area under the curve of 0.918 and 0.933 by using the training and testing data, quantifying 23.02% and 14.40% area as very high and highly susceptible followed by ANN, ADtree, CART, FTree and LMT models. This research might be useful in landslide studies, especially in locations with comparable geophysical and climatological characteristics, to aid in decision making for land use planning.

Download Full-text

Advanced Deep Learning Model

10.5121/csit.2021.111707 ◽

2021 ◽

Author(s):

Yew Kee Wong

Keyword(s):

Artificial Intelligence ◽

Machine Learning ◽

Decision Making ◽

Deep Learning ◽

Learning Algorithms ◽

Learning Model ◽

Intelligence Analysis ◽

Basic Parameters ◽

Deep Learning Model ◽

Learning Sets

Deep learning is a type of machine learning that trains a computer to perform human-like tasks, such as recognizing speech, identifying images or making predictions. Instead of organizing data to run through predefined equations, deep learning sets up basic parameters about the data and trains the computer to learn on its own by recognizing patterns using many layers of processing. This paper aims to illustrate some of the different deep learning algorithms and methods which can be applied to artificial intelligence analysis, as well as the opportunities provided by the application in various decision making domains.

Download Full-text