scholarly journals Deep learning application using neural network classification for cyberspace dataset with backpropagation algorithm and log-linear models

2018 ◽  
Vol 12 (1) ◽  
pp. 1
Author(s):  
Baiq Siska Febriani Astuti ◽  
Tuti Purwaningsih
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Linear Models ◽  
Backpropagation Algorithm ◽  
Neural Network Classification ◽  
Log Linear

scholarly journals Rectal Cancer Treatment Management: Deep-Learning Neural Network Based on Photoacoustic Microscopy Image Outperforms Histogram-Feature-Based Classification

2021 ◽  
Vol 11 ◽  
Author(s):  
Xiandong Leng ◽  
Eghbal Amidi ◽  
Sitai Kou ◽  
Hassam Cheema ◽  
Ebunoluwa Otegbeye ◽  
...  
Keyword(s):  
Neural Network ◽  
Rectal Cancer ◽  
Deep Learning ◽  
Linear Models ◽  
Ex Vivo ◽  
Residual Tumor ◽  
Photoacoustic Microscopy ◽  
Feature Based ◽  
Histogram Feature

We have developed a novel photoacoustic microscopy/ultrasound (PAM/US) endoscope to image post-treatment rectal cancer for surgical management of residual tumor after radiation and chemotherapy. Paired with a deep-learning convolutional neural network (CNN), the PAM images accurately differentiated pathological complete responders (pCR) from incomplete responders. However, the role of CNNs compared with traditional histogram-feature based classifiers needs further exploration. In this work, we compare the performance of the CNN models to generalized linear models (GLM) across 24 ex vivo specimens and 10 in vivo patient examinations. First order statistical features were extracted from histograms of PAM and US images to train, validate and test GLM models, while PAM and US images were directly used to train, validate, and test CNN models. The PAM-CNN model performed superiorly with an AUC of 0.96 (95% CI: 0.95-0.98) compared to the best PAM-GLM model using kurtosis with an AUC of 0.82 (95% CI: 0.82-0.83). We also found that both CNN and GLMs derived from photoacoustic data outperformed those utilizing ultrasound alone. We conclude that deep-learning neural networks paired with photoacoustic images is the optimal analysis framework for determining presence of residual cancer in the treated human rectum.

scholarly journals Using local convolutional neural networks for genomic prediction

2020 ◽  
Author(s):  
Torsten Pook ◽  
Jan Freudenthal ◽  
Arthur Korte ◽  
Henner Simianer
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Convolutional Neural Networks ◽  
Genomic Prediction ◽  
Linear Models ◽  
Predictive Ability ◽  
High Heritability ◽  
Fully Connected

ABSTRACTThe prediction of breeding values and phenotypes is of central importance for both livestock and crop breeding. With increasing computational power and more and more data to potentially utilize, Machine Learning and especially Deep Learning have risen in popularity over the last few years. In this study, we are proposing the use of local convolutional neural networks for genomic prediction, as a region specific filter corresponds much better with our prior genetic knowledge of traits than traditional convolutional neural networks. Model performances are evaluated on a simulated maize data panel (n = 10,000) and real Arabidopsis data (n = 2,039) for a variety of traits with the local convolutional neural network outperforming both multi layer perceptrons and convolutional neural networks for basically all considered traits. Linear models like the genomic best linear unbiased prediction that are often used for genomic prediction are outperformed by up to 24%. Highest gains in predictive ability was obtained in cases of medium trait complexity with high heritability and large training populations. However, for small dataset with 100 or 250 individuals for the training of the models, the local convolutional neural network is performing slightly worse than the linear models. Nonetheless, this is still 15% better than a traditional convolutional neural network, indicating a better performance and robustness of our proposed model architecture for small training populations. In addition to the baseline model, various other architectures with different windows size and stride in the local convolutional layer, as well as different number of nodes in subsequent fully connected layers are compared against each other. Finally, the usefulness of Deep Learning and in particular local convolutional neural networks in practice is critically discussed, in regard to multi dimensional inputs and outputs, computing times and other potential hazards.

scholarly journals FORECASTING AIRCRAFT MILES FLOWN TIME SERIES USING A DEEP LEARNING-BASED HYBRID APPROACH

Aviation ◽  
2018 ◽  
Vol 22 (1) ◽  
pp. 6-12 ◽  
Author(s):  
Victor SINEGLAZOV ◽  
Olena CHUMACHENKO ◽  
Vladyslav GORBATIUK
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Deep Learning ◽  
Deep Neural Networks ◽  
Hybrid Approach ◽  
Practical Application ◽  
Backpropagation Algorithm ◽  
Anfis Model ◽  
Wide Range ◽  
Domestic Airlines

Neural network-based methods such as deep neural networks show great efficiency for a wide range of applications. In this paper, a deep learning-based hybrid approach to forecast the yearly revenue passenger kilometers time series of Australia’s major domestic airlines is proposed. The essence of the approach is to use a resilient error backpropagation algorithm with dropout for “tuning” the polynomial neural network, obtained as a result of a multi-layered GMDH algorithm. The article compares the performance of the suggested algorithm on the time series with other popular forecasting methods: deep belief network, multi-layered GMDH algorithm, Box-Jenkins method and the ANFIS model. The minimum reached MAE of the proposed algorithm was approximately 25% lower than the minimum MAE of the next best method – GMDH, thus indicating that the practical application of the algorithm can give good results compared with other well-known methods.

scholarly journals Exploring generative deep learning for omics data using log-linear models

2020 ◽  
Vol 36 (20) ◽  
pp. 5045-5053
Author(s):  
Moritz Hess ◽  
Maren Hackenberg ◽  
Harald Binder
Keyword(s):  
Deep Learning ◽  
Linear Models ◽  
Synthetic Data ◽  
Simulated Data ◽  
Image Data ◽  
Supplementary Information ◽  
Underlying Structure ◽  
Omics Data ◽  
Latent Representations ◽  
Log Linear

Abstract Motivation Following many successful applications to image data, deep learning is now also increasingly considered for omics data. In particular, generative deep learning not only provides competitive prediction performance, but also allows for uncovering structure by generating synthetic samples. However, exploration and visualization is not as straightforward as with image applications. Results We demonstrate how log-linear models, fitted to the generated, synthetic data can be used to extract patterns from omics data, learned by deep generative techniques. Specifically, interactions between latent representations learned by the approaches and generated synthetic data are used to determine sets of joint patterns. Distances of patterns with respect to the distribution of latent representations are then visualized in low-dimensional coordinate systems, e.g. for monitoring training progress. This is illustrated with simulated data and subsequently with cortical single-cell gene expression data. Using different kinds of deep generative techniques, specifically variational autoencoders and deep Boltzmann machines, the proposed approach highlights how the techniques uncover underlying structure. It facilitates the real-world use of such generative deep learning techniques to gain biological insights from omics data. Availability and implementation The code for the approach as well as an accompanying Jupyter notebook, which illustrates the application of our approach, is available via the GitHub repository: https://github.com/ssehztirom/Exploring-generative-deep-learning-for-omics-data-by-using-log-linear-models. Supplementary information Supplementary data are available at Bioinformatics online.

HYBRID CLASSIFICATION SCHEMES FOR HEART MURMUR DETECTION TO ASSIST PHONOCARDIOGRAM BASED SIGNAL ACQUISITION

2017 ◽  
Vol 13 (9) ◽  
pp. 6480-6488 ◽  
Author(s):  
A.D. Jeyarani ◽  
Reena Daphne ◽  
Solomon Roach
Keyword(s):  
Neural Network ◽  
Signal Acquisition ◽  
Heart Murmur ◽  
Classification Techniques ◽  
Classification Schemes ◽  
Neural Network Classification ◽  
Nonlinear Classification ◽  
Processing Step ◽  
System Characterization ◽  
Hybrid Classification

The main contribution of this paper has been to introduce nonlinear classification techniques to extract more information from the PCG signal. Especially, Artificial Neural Network classification techniques have been used to reconstruct the underlying system’s state space based on the measured PCG signal. This processing step provides a geometrical interpretation of the dynamics of the signal, whose structure can be utilized for both system characterization and classification as well as for signal processing tasks such as detection and prediction.

Developing an Artificial Intelligence Project in your Radiology Department

2020 ◽  
Vol 2 ◽  
pp. 58-61 ◽  
Author(s):  
Syed Junaid ◽  
Asad Saeed ◽  
Zeili Yang ◽  
Thomas Micic ◽  
Rajesh Botchu
Keyword(s):  
Neural Network ◽  
Artificial Intelligence ◽  
Health Care ◽  
Deep Learning ◽  
Learning Algorithms ◽  
Radiology Department ◽  
Short Article ◽  
Computing Power ◽  
Road Map ◽  
Key Concepts

The advances in deep learning algorithms, exponential computing power, and availability of digital patient data like never before have led to the wave of interest and investment in artificial intelligence in health care. No radiology conference is complete without a substantial dedication to AI. Many radiology departments are keen to get involved but are unsure of where and how to begin. This short article provides a simple road map to aid departments to get involved with the technology, demystify key concepts, and pique an interest in the field. We have broken down the journey into seven steps; problem, team, data, kit, neural network, validation, and governance.

Sign in / Sign up

Export Citation Format

Share Document