A Journey From Neural Networks to Deep Networks

2022 ◽  
pp. 85-110
Author(s):  
Priyanka P. Patel ◽  
Amit R. Thakkar

The chapter is about deep learning fundaments and its recent trends. The chapter mentions many advanced applications and deep learning models and networks to easily solve those applications in a very smart way. Discussion of some techniques for computer vision problem and how to solve with deep learning approach are included. After taking fundamental knowledge of the background theory, one can create or solve applications. The current state-of-the-art of deep learning for education, healthcare, agriculture, industrial, organizations, and research and development applications are very fast growing. The chapter is about types of learning in a deep learning approach, what kind of data set one can be required, and what kind of hardware facility is required for the particular complex problem. For unsupervised learning problems, Deep learning algorithms have been designed, but in the same way Deep learning is also solving the supervised learning problems for a wide variety of tasks.

Author(s):  
Priyanka P. Patel ◽  
Amit R. Thakkar

The chapter is about deep learning fundaments and its recent trends. The chapter mentions many advanced applications and deep learning models and networks to easily solve those applications in a very smart way. Discussion of some techniques for computer vision problem and how to solve with deep learning approach are included. After taking fundamental knowledge of the background theory, one can create or solve applications. The current state-of-the-art of deep learning for education, healthcare, agriculture, industrial, organizations, and research and development applications are very fast growing. The chapter is about types of learning in a deep learning approach, what kind of data set one can be required, and what kind of hardware facility is required for the particular complex problem. For unsupervised learning problems, Deep learning algorithms have been designed, but in the same way Deep learning is also solving the supervised learning problems for a wide variety of tasks.


2020 ◽  
Vol 17 (3) ◽  
pp. 299-305 ◽  
Author(s):  
Riaz Ahmad ◽  
Saeeda Naz ◽  
Muhammad Afzal ◽  
Sheikh Rashid ◽  
Marcus Liwicki ◽  
...  

This paper presents a deep learning benchmark on a complex dataset known as KFUPM Handwritten Arabic TexT (KHATT). The KHATT data-set consists of complex patterns of handwritten Arabic text-lines. This paper contributes mainly in three aspects i.e., (1) pre-processing, (2) deep learning based approach, and (3) data-augmentation. The pre-processing step includes pruning of white extra spaces plus de-skewing the skewed text-lines. We deploy a deep learning approach based on Multi-Dimensional Long Short-Term Memory (MDLSTM) networks and Connectionist Temporal Classification (CTC). The MDLSTM has the advantage of scanning the Arabic text-lines in all directions (horizontal and vertical) to cover dots, diacritics, strokes and fine inflammation. The data-augmentation with a deep learning approach proves to achieve better and promising improvement in results by gaining 80.02% Character Recognition (CR) over 75.08% as baseline.


2021 ◽  
Author(s):  
Alireza Karbalayghareh ◽  
Merve Sahin ◽  
Christina S Leslie

Linking distal enhancers to genes and modeling their impact on target gene expression are longstanding unresolved problems in regulatory genomics and critical for interpreting non-coding genetic variation. Here we present a new deep learning approach called GraphReg that exploits 3D interactions from chromosome conformation capture assays in order to predict gene expression from 1D epigenomic data or genomic DNA sequence. By using graph attention networks to exploit the connectivity of distal elements and promoters, GraphReg more faithfully models gene regulation and more accurately predicts gene expression levels than dilated convolutional neural networks (CNNs), the current state-of-the-art deep learning approach for this task. Feature attribution used with GraphReg accurately identifies functional enhancers of genes, as validated by CRISPRi-FlowFISH and TAP-seq assays, outperforming both CNNs and the recently proposed Activity-by-Contact model. GraphReg therefore represents an important advance in modeling the regulatory impact of epigenomic and sequence elements.


2019 ◽  
Vol 40 (Supplement_1) ◽  
Author(s):  
E Nyman ◽  
M Karlsson ◽  
U Naslund ◽  
C Gronlund

Abstract Background Carotid ultrasound measurements of subclinical atherosclerosis is extensively used in the research field of cardiovascular disease. Increased intima media thickness (IMT) and plaque detection have predictive value for cardiovascular events when added to traditional risk factors. However, among studies different protocols for measuring IMT (projections, mean or max values and sites) are used and methodological difficulties of plaque detection, together result in conflicting results. Recently, Deep Learning image driven classification methods, has been successfully applied in several medical imaging applications. Here we hypothesize that ultrasound image texture of the intima media complex accurately reflects the disease burden without the need to measure IMT values or detect plaques. Purpose To evaluate classification accuracy of ultrasound based deep learning approach of the intima media complex image compared to traditional risk factors for participants with no vs pronounced subclinical atherosclerosis. Methods Subjects from the VIPVIZA study (Visualization of asymptomatic atherosclerotic disease for optimum cardiovascular prevention, n: 3532, 40, 50 and 60 year old, 53% women) were selected for analysis. Bilateral carotid ultrasound examinations were performed according to a standardized protocol. Subjects were categorized in two groups as 1) pronounced subclinical atherosclerosis (n: 401) – bilateral plaques and estimated vascular age 10 years older, or 2) No subclinical atherosclerosis (n: 592) – no plaques and estimated ordinary vascular age. Traditional risk factors for the participants were estimated by the SCORE risk chart. A 1-cm wide region of the distal common carotid artery intima media complex was automatically segmented from the original B-mode images. The images were fed to a Deep Learning model, convolution neural network (CNN), trained using transfer learning model with 60% training data set and 40% evaluation data set. Classification performance was quantified using accuracy of ROC analysis. Results The mean age was 58 and 56 years in groups 1 and 2, respectively (with 43% and 56% women, respectively). The mean SCORE was 1.74 in group 1 and 1.09 in group 2. Classification based on SCORE had an area under the curve of 0.69 with an accuracy of 38%. The Deep learning approach had an area under the curve of 0.89 with an accuracy of 78%. Intima media image based classification Conclusion The results shows that ultrasound image texture of the intima media with Deep Learning approach can be used to detect pronounced disease without explicit measurement of IMT values or detection of plaques. With hard end-points, the approach could be used for risk stratification of subclinical atherosclerosis. Acknowledgement/Funding Västerbotten County Council, Swedish Research Council, Heart and Lung Foundation, Carl Bennet Ltd, Sweden.


2021 ◽  
Vol 13 (22) ◽  
pp. 4599
Author(s):  
Félix Quinton ◽  
Loic Landrieu

While annual crop rotations play a crucial role for agricultural optimization, they have been largely ignored for automated crop type mapping. In this paper, we take advantage of the increasing quantity of annotated satellite data to propose to model simultaneously the inter- and intra-annual agricultural dynamics of yearly parcel classification with a deep learning approach. Along with simple training adjustments, our model provides an improvement of over 6.3% mIoU over the current state-of-the-art of crop classification, and a reduction of over 21% of the error rate. Furthermore, we release the first large-scale multi-year agricultural dataset with over 300,000 annotated parcels.


Author(s):  
Hai Yang ◽  
Rui Chen ◽  
Dongdong Li ◽  
Zhe Wang

Abstract Motivation The discovery of cancer subtyping can help explore cancer pathogenesis, determine clinical actionability in treatment, and improve patients' survival rates. However, due to the diversity and complexity of multi-omics data, it is still challenging to develop integrated clustering algorithms for tumor molecular subtyping. Results We propose Subtype-GAN, a deep adversarial learning approach based on the multiple-input multiple-output neural network to model the complex omics data accurately. With the latent variables extracted from the neural network, Subtype-GAN uses consensus clustering and the Gaussian Mixture model to identify tumor samples' molecular subtypes. Compared with other state-of-the-art subtyping approaches, Subtype-GAN achieved outstanding performance on the benchmark data sets consisting of ∼4,000 TCGA tumors from 10 types of cancer. We found that on the comparison data set, the clustering scheme of Subtype-GAN is not always similar to that of the deep learning method AE but is identical to that of NEMO, MCCA, VAE, and other excellent approaches. Finally, we applied Subtype-GAN to the BRCA data set and automatically obtained the number of subtypes and the subtype labels of 1031 BRCA tumors. Through the detailed analysis, we found that the identified subtypes are clinically meaningful and show distinct patterns in the feature space, demonstrating the practicality of Subtype-GAN. Availability The source codes, the clustering results of Subtype-GAN across the benchmark data sets are available at https://github.com/haiyang1986/Subtype-GAN. Supplementary information Supplementary data are available at Bioinformatics online.


IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 19097-19110
Author(s):  
Rosario Catelli ◽  
Francesco Gargiulo ◽  
Valentina Casola ◽  
Giuseppe De Pietro ◽  
Hamido Fujita ◽  
...  

2019 ◽  
Vol 8 (2S11) ◽  
pp. 3740-3744

Word Sense Disambiguation (WSD) is a complex problem as it entirely depends on the language convolutions. Gujarati language is a multifaceted language which has so many variations. In this paper, the debate has advanced two methodologies for WSD: knowledge-based and deep learning approach. Accordingly, the Deep learning approach is found to perform even better one of its shortcoming is the essential of colossal data sources without which getting ready is near incomprehensible. On the other hand, uses data sources to pick the implications of words in a particular setting. Provided with that, deep learning approaches appear to be more suitable to manage word sense disambiguation; however, the process will always be challenging given the ambiguity of natural languages


Sign in / Sign up

Export Citation Format

Share Document