DeepPPPred: Deep Ensemble Learning with Transformers, Recurrent and Convolutional Neural Networks for Human Protein-Phenotype Co-mention Classification

Author(s):  
Morteza Pourreza Shahri ◽  
Katrina Lyon ◽  
Julia Schearer ◽  
Indika Kahanda
Author(s):  
Shuqin Gu ◽  
Yuexian Hou ◽  
Lipeng Zhang ◽  
Yazhou Zhang

Although Deep Neural Networks (DNNs) have achieved excellent performance in many tasks, improving the generalization capacity of DNNs still remains a challenge. In this work, we propose a novel regularizer named Ensemble-based Decorrelation Method (EDM), which is motivated by the idea of the ensemble learning to improve generalization capacity of DNNs. EDM can be applied to hidden layers in fully connected neural networks or convolutional neural networks. We treat each hidden layer as an ensemble of several base learners through dividing all the hidden units into several non-overlap groups, and each group will be viewed as a base learner. EDM encourages DNNs to learn more diverse representations by minimizing the covariance between all base learners during the training step. Experimental results on MNIST and CIFAR datasets demonstrate that EDM can effectively reduce the overfitting and improve the generalization capacity of DNNs  


NeuroImage ◽  
2019 ◽  
Vol 199 ◽  
pp. 651-662 ◽  
Author(s):  
Meenakshi Khosla ◽  
Keith Jamison ◽  
Amy Kuceyeski ◽  
Mert R. Sabuncu

2021 ◽  
Vol 13 ◽  
Author(s):  
Robert Logan ◽  
Brian G. Williams ◽  
Maria Ferreira da Silva ◽  
Akash Indani ◽  
Nicolas Schcolnicov ◽  
...  

Recent advancements in deep learning (DL) have made possible new methodologies for analyzing massive datasets with intriguing implications in healthcare. Convolutional neural networks (CNN), which have proven to be successful supervised algorithms for classifying imaging data, are of particular interest in the neuroscience community for their utility in the classification of Alzheimer’s disease (AD). AD is the leading cause of dementia in the aging population. There remains a critical unmet need for early detection of AD pathogenesis based on non-invasive neuroimaging techniques, such as magnetic resonance imaging (MRI) and positron emission tomography (PET). In this comprehensive review, we explore potential interdisciplinary approaches for early detection and provide insight into recent advances on AD classification using 3D CNN architectures for multi-modal PET/MRI data. We also consider the application of generative adversarial networks (GANs) to overcome pitfalls associated with limited data. Finally, we discuss increasing the robustness of CNNs by combining them with ensemble learning (EL).


2019 ◽  
Vol 46 (12) ◽  
pp. 5666-5676 ◽  
Author(s):  
Xudong Guo ◽  
Na Zhang ◽  
Jiefang Guo ◽  
Huihe Zhang ◽  
Youguo Hao ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document