A Fused Heterogeneous Deep Neural Network and Robust Feature Selection Framework for Human Actions Recognition

Author(s):  
Muhammad Attique Khan ◽  
Yu-Dong Zhang ◽  
Majed Alhusseni ◽  
Seifedine Kadry ◽  
Shui-Hua Wang ◽  
...  
2021 ◽  
Vol 11 (1) ◽  
Author(s):  
Li-Hsin Cheng ◽  
Te-Cheng Hsu ◽  
Che Lin

AbstractBreast cancer is a heterogeneous disease. To guide proper treatment decisions for each patient, robust prognostic biomarkers, which allow reliable prognosis prediction, are necessary. Gene feature selection based on microarray data is an approach to discover potential biomarkers systematically. However, standard pure-statistical feature selection approaches often fail to incorporate prior biological knowledge and select genes that lack biological insights. Besides, due to the high dimensionality and low sample size properties of microarray data, selecting robust gene features is an intrinsically challenging problem. We hence combined systems biology feature selection with ensemble learning in this study, aiming to select genes with biological insights and robust prognostic predictive power. Moreover, to capture breast cancer's complex molecular processes, we adopted a multi-gene approach to predict the prognosis status using deep learning classifiers. We found that all ensemble approaches could improve feature selection robustness, wherein the hybrid ensemble approach led to the most robust result. Among all prognosis prediction models, the bimodal deep neural network (DNN) achieved the highest test performance, further verified by survival analysis. In summary, this study demonstrated the potential of combining ensemble learning and bimodal DNN in guiding precision medicine.


Author(s):  
Yu Zhang ◽  
Cangzhi Jia ◽  
Melissa Jane Fullwood ◽  
Chee Keong Kwoh

Abstract The development of deep sequencing technologies has led to the discovery of novel transcripts. Many in silico methods have been developed to assess the coding potential of these transcripts to further investigate their functions. Existing methods perform well on distinguishing majority long noncoding RNAs (lncRNAs) and coding RNAs (mRNAs) but poorly on RNAs with small open reading frames (sORFs). Here, we present DeepCPP (deep neural network for coding potential prediction), a deep learning method for RNA coding potential prediction. Extensive evaluations on four previous datasets and six new datasets constructed in different species show that DeepCPP outperforms other state-of-the-art methods, especially on sORF type data, which overcomes the bottleneck of sORF mRNA identification by improving more than 4.31, 37.24 and 5.89% on its accuracy for newly discovered human, vertebrate and insect data, respectively. Additionally, we also revealed that discontinuous k-mer, and our newly proposed nucleotide bias and minimal distribution similarity feature selection method play crucial roles in this classification problem. Taken together, DeepCPP is an effective method for RNA coding potential prediction.


Author(s):  
Zheng Chen ◽  
Meng Pang ◽  
Zixin Zhao ◽  
Shuainan Li ◽  
Rui Miao ◽  
...  

Abstract Motivation Deep neural network (DNN) algorithms were utilized in predicting various biomedical phenotypes recently, and demonstrated very good prediction performances without selecting features. This study proposed a hypothesis that the DNN models may be further improved by feature selection algorithms. Results A comprehensive comparative study was carried out by evaluating 11 feature selection algorithms on three conventional DNN algorithms, i.e. convolution neural network (CNN), deep belief network (DBN) and recurrent neural network (RNN), and three recent DNNs, i.e. MobilenetV2, ShufflenetV2 and Squeezenet. Five binary classification methylomic datasets were chosen to calculate the prediction performances of CNN/DBN/RNN models using feature selected by the 11 feature selection algorithms. Seventeen binary classification transcriptome and two multi-class transcriptome datasets were also utilized to evaluate how the hypothesis may generalize to different data types. The experimental data supported our hypothesis that feature selection algorithms may improve DNN models, and the DBN models using features selected by SVM-RFE usually achieved the best prediction accuracies on the five methylomic datasets. Availability and implementation All the algorithms were implemented and tested under the programming environment Python version 3.6.6. Supplementary information Supplementary data are available at Bioinformatics online.


2021 ◽  
Vol 2021 ◽  
pp. 1-9
Author(s):  
Dengqing Zhang ◽  
Yunyi Chen ◽  
Yuxuan Chen ◽  
Shengyi Ye ◽  
Wenyu Cai ◽  
...  

In recent decades, heart disease threatens people’s health seriously because of its prevalence and high risk of death. Therefore, predicting heart disease through some simple physical indicators obtained from the regular physical examination at an early stage has become a valuable subject. Clinically, it is essential to be sensitive to these indicators related to heart disease to make predictions and provide a reliable basis for further diagnosis. However, the large amount of data makes manual analysis and prediction taxing and arduous. Our research aims to predict heart disease both accurately and quickly through various indicators of the body. In this paper, a novel heart disease prediction model is given. We propose a heart disease prediction algorithm that combines the embedded feature selection method and deep neural networks. This embedded feature selection method is based on the LinearSVC algorithm, using the L1 norm as a penalty item to choose a subset of features significantly associated with heart disease. These features are fed into the deep neural network we built. The weight of the network is initialized with the He initializer to prevent gradient varnishing or explosion so that the predictor can have a better performance. Our model is tested on the heart disease dataset obtained from Kaggle. Some indicators including accuracy, recall, precision, and F1-score are calculated to evaluate the predictor, and the results show that our model achieves 98.56%, 99.35%, 97.84%, and 0.983, respectively, and the average AUC score of the model reaches 0.983, confirming that the method we proposed is efficient and reliable for predicting heart disease.


2019 ◽  
Vol 39 (4) ◽  
pp. 939-953 ◽  
Author(s):  
Dongying Han ◽  
Kai Liang ◽  
Peiming Shi

In the absence of a priori knowledge, manual feature selection is too blind to find the sensitive features which can effectively classify the different fault features. And it is difficult to obtain a large number of typical fault samples in practice to train the intelligent classifier. A novel intelligent fault diagnosis method based on feature selection and deep learning is proposed for rotating machine mechanical in the paper. In this method, the deep neural network is not only used for feature extraction but also for fault diagnosis. First, the deep neural network 1 is used to extract feature from the spectral signal of the original signal. In addition, the original vibration signal is decomposed to a series of intrinsic mode function components by empirical mode decomposition, and the statistical features of each intrinsic mode function component are extracted by the deep neural network 2 in time domain and frequency domain. Second, the extraction features of the original signal spectrum and the extraction features of each intrinsic mode function component are evaluated, respectively. After features evaluation, the selected sensitive features are combined together to construct a joint feature. Finally, the joint feature is put into the deep neural network 3 to realize the automatic recognition of different fault states of rotating machinery. The experimental results show that the method proposed in this paper which integrated time-domain, frequency-domain statistical characteristics, empirical mode decomposition, feature selection, and deep learning methods can obtain the fault information in detail and can select sensitive features from a large number of fault features. The method can reduce the network size, improve the mechanical fault diagnosis classification accuracy, and has strong robustness.


Sign in / Sign up

Export Citation Format

Share Document