scholarly journals STRUCTURE OPTIMIZATION OF DEEP BELIEF NETS IN THE APPLICATIONS OF IMAGE RECOGNITION.

2020 ◽  
Vol 9 (7) ◽  
pp. 179-189
Keyword(s):  
Deep Learning ◽  
Image Recognition ◽  
Structure Optimization ◽  
Reconstruction Error ◽  
Deep Belief Network ◽  
Training Method ◽  
Belief Network ◽  
Supervised Training ◽  
Training Resources ◽  
Hidden Layer

Deep belief network (DBN) has become one of the most important models in deep learning, however, the un-optimized structure leads to wasting too much training resources. To solve this problem and to investigate the connection of depth and accuracy of DBN, an optimization training method that consists of two steps is proposed. Firstly, by using mathematical and biological tools, the significance of supervised training is analyzed, and a theorem, that is on reconstruction error and network energy, is proved. Secondly, based on conclusions of step one, this paper proposes to optimize the structure of DBN (especially hidden layer numbers). Thirdly, this method is applied in two image recognition experiments, and results show increased computing efficiency and accuracies in both tasks.

Deep learning-based axial capacity prediction for cold-formed steel channel sections using Deep Belief Network

Structures ◽  
2021 ◽  
Vol 33 ◽  
pp. 2792-2802
Author(s):  
Zhiyuan Fang ◽  
Krishanu Roy ◽  
Jiri Mares ◽  
Chiu-Wing Sham ◽  
Boshan Chen ◽  
...  
Keyword(s):  
Deep Learning ◽  
Deep Belief Network ◽  
Belief Network ◽  
Axial Capacity ◽  
Cold Formed Steel ◽  
Capacity Prediction

Deep Learning-based Framework for Smart Sustainable Cities

2019 ◽  
Vol 15 (4) ◽  
pp. 76-107
Author(s):  
Nagarathna Ravi ◽  
Vimala Rani P ◽  
Rajesh Alias Harinarayan R ◽  
Mercy Shalinie S ◽  
Karthick Seshadri ◽  
...  
Keyword(s):  
Neural Network ◽  
Air Pollution ◽  
Deep Learning ◽  
Air Pollutants ◽  
Human Life ◽  
Deep Belief Network ◽  
Motor Vehicles ◽  
Human Beings ◽  
Long Term Effects ◽  
Belief Network

Pure air is vital for sustaining human life. Air pollution causes long-term effects on people. There is an urgent need for protecting people from its profound effects. In general, people are unaware of the levels to which they are exposed to air pollutants. Vehicles, burning various kinds of waste, and industrial gases are the top three onset agents of air pollution. Of these three top agents, human beings are exposed frequently to the pollutants due to motor vehicles. To aid in protecting people from vehicular air pollutants, this article proposes a framework that utilizes deep learning models. The framework utilizes a deep belief network to predict the levels of air pollutants along the paths people travel and also a comparison with the predictions made by a feed forward neural network and an extreme learning machine. When evaluating the deep belief neural network for the case study undertaken, a deep belief network was able to achieve a higher index of agreement and lower RMSE values.

scholarly journals A Novel Deep Belief Network Model Constructed by Improved Conditional RBMs and its Application in RUL Prediction for Hydraulic Pumps

2020 ◽  
Vol 25 (3) ◽  
pp. 373-382
Author(s):  
He Yu ◽  
Zaike Tian ◽  
Hongru Li ◽  
Baohua Xu ◽  
Guoqing An
Keyword(s):  
Deep Learning ◽  
Graph Model ◽  
Parameter Tuning ◽  
Deep Belief Network ◽  
Support Vector ◽  
Belief Network ◽  
Deep Feature ◽  
Proposed Model ◽  
Vector Machines ◽  
Deep Feature Extraction

Residual Useful Life (RUL) prediction is a key step of Condition-Based Maintenance (CBM). Deep learning-based techniques have shown wonderful prospects on RUL prediction, although their performances depend on heavy structures and parameter tuning strategies of these deep-learning models. In this paper, we propose a novel Deep Belief Network (DBN) model constructed by improved conditional Restrict Boltzmann Machines (RBMs) and apply it in RUL prediction for hydraulic pumps. DBN is a deep probabilistic digraph neural network that consists of multiple layers of RBMs. Since RBM is an undirected graph model and there is no communication among the nodes of the same layer, the deep feature extraction capability of the original DBN model can hardly ensure the accuracy of modeling continuous data. To address this issue, the DBN model is improved by replacing RBM with the Improved Conditional RBM (ICRBM) that adds timing linkage factors and constraint variables among the nodes of the same layers on the basis of RBM. The proposed model is applied to RUL prediction of hydraulic pumps, and the results show that the prediction model proposed in this paper has higher prediction accuracy compared with traditional DBNs, BP networks, support vector machines and modified DBNs such as DEBN and GC-DBN.

scholarly journals Mining and Reuse on Design Knowledge of Non-standard Special Tool Based on Deep Learning

2020 ◽  
Author(s):  
Mingwei Wang ◽  
Jingtao Zhou ◽  
Xiaoying Chen ◽  
Zeyu Li
Keyword(s):  
Deep Learning ◽  
Association Rule ◽  
Deep Belief Network ◽  
Design Knowledge ◽  
Machining Features ◽  
Belief Network ◽  
Dual Channel ◽  
Engineering Drawings ◽  
Low Efficiency

Abstract Aiming at the problems of design difficulty, low efficiency and unstable quality of non-standard special tools, facing the strong correlation between part machining features and tools, this article takes the two-dimensional engineering drawings of tools and parts as research objects, proposes the research on mining and reuse on design knowledge of non-standard special tool based on deep learning. Firstly, a dual-channel deep belief network is established to complete the feature modeling of machining features and tool features; secondly, the deep belief network is used to realize the association relationship mining between the machining features and tool features; thirdly, both the key local features of the tool and the overall similar design case of the tool are reused through association rule reasoning; finally, the non-standard special turning tool is used as an example to verify the effectiveness of the proposed method.

scholarly journals Segmentação de Vértebras e Diagnóstico de Fraturas em Imagens de Ressonância Magnética Utilizando U-Net 3D e Deep Belief Network

2019 ◽  
Author(s):  
Anderson Matheus Passos Paiva ◽  
João Otávio Bandeira Diniz ◽  
Aristófanes Corrêa Silva ◽  
Anselmo Cardoso Paiva
Keyword(s):  
Deep Learning ◽  
Deep Belief Network ◽  
Belief Network

A dor lombar é uma razão comum para visitas clı́nicas e o exame de ressonância magnética é frequentemente utilizado em sistemas de apoio a di- agnóstico de patologias na coluna. Visando aprimorar e automatizar esse pro- cesso, este estudo propõe o uso de técnicas computacionais para a segmentação de vértebras em imagens de ressonância magnética, com o objetivo de realizar posteriores análises acerca de patologias na coluna. Para este fim, são utili- zadas duas arquiteturas de Deep Learning: a U-Net para a segmentação em 3D e a Deep Belief Network para a classificação de vértebras que apresen- tam ruptura ou não. Os resultados obtidos mostram que a U-Net é promissora em localizar a região da vértebra, obtendo um valor de Coeficiente de Dice médio de 89,51%, superando assim vários trabalhos importantes focados no problema. A classificação também se mostrou eficiente, com valores de 94,38% para acurácia e 88,8% de sensibilidade.

scholarly journals Corn Diseases Recognition Method Based on Multi-feature Fusion and Improved Deep Belief Network

2021 ◽  
Author(s):  
Xiangpeng Fan ◽  
Jianping Zhou ◽  
Yan Xu ◽  
Jingjing Yang
Keyword(s):  
Feature Fusion ◽  
Deep Belief Network ◽  
Combination Method ◽  
Real Field ◽  
Data Set ◽  
Node Number ◽  
Recognition Model ◽  
Belief Network ◽  
Disease Identification ◽  
Hidden Layer

Abstract The automatic monitoring timely and accurately of crop diseases has become an important research field in precision agriculture. Aiming at the low application rate of crop disease identification models in real field environment, a disease identification method based on multi-feature fusion and improved deep belief network was proposed. We Obtained representative samples in field conditions, then we augmented the data set. K-means clustering segmentation and morphological corrosion processing were utilized to obtain segmentation maps with clear boundaries and low noises. Then color features, shape features and textures of disease images were extracted respectively and they were fused to normalize as input data. A corn disease recognition model based on deep belief network was designed, using labeled and unlabeled dual hidden layer network structure to investigate the DBN hidden layer node combination mode. We obtained the optimal hidden layer node number combination method for disease classification: [26,85,29,4]. The accuracy of optimal DBN was 92.79%. On this basis, the deep belief network recognition model was optimized by particle swarm optimization algorithm for further performance enhancement. The experiment indicated that recognition effect using multi-feature fusion as input vectors was better than a single feature. The updated PSO-DBN reached the accuracy of 96.65%, which had a faster convergence speed and higher recognition accuracy of 3.86% than the standard DBN. Compared with state-of-the-art methods including SVM, ANN and CNN models, the proposed method can effectively dig deep digital features of disease areas or lesions and has the best performance, which could meet the needs of intelligent identification of field diseases.

Optimal weighted feature vector and deep belief network for medical data classification

2019 ◽  
Vol 18 (02) ◽  
pp. 2050006 ◽  
Author(s):  
Vinod Jagannath Kadam ◽  
Shivajirao Manikrao Jadhav
Keyword(s):  
Deep Learning ◽  
Data Classification ◽  
Medical Data ◽  
Deep Belief Network ◽  
Breast Cancer Dataset ◽  
Cancer Dataset ◽  
Belief Network ◽  
Medical Diagnoses ◽  
Whale Optimization ◽  
Medical Data Classification

Medical data classification is the process of transforming descriptions of medical diagnoses and procedures into universal medical code numbers. The diagnoses and procedures are usually taken from a variety of sources within the healthcare record, such as the transcription of the physician’s notes, laboratory results, radiologic results and other sources. However, there exist many frequency distribution problems in these domains. Hence, this paper intends to develop an advanced and precise medical data classification approach for diabetes and breast cancer dataset. With the knowledge of the features and challenges persisting with the state-of-the-art classification methods, deep learning-based medical data classification methodology is proposed here. It is well known that deep learning networks learn directly from the data. In this paper, the medical data is dimensionally reduced using Principle Component Analysis (PCA). The dimensionally reduced data are transformed by multiplying by a weighting factor, which is optimized using Whale Optimization Algorithm (WOA), to obtain the maximum distance between the features. As a result, the data are transformed into a label-distinguishable plane under which the Deep Belief Network (DBN) is adopted to perform the deep learning process, and the data classification is performed. Further, the proposed WOA-based DBN (WOADBN) method is compared with the Neural Network (NN), DBN, Generic Algorithm-based NN (GANN), GADBN, Particle Swarm Optimization (PSONN), PSO-based DBN (PSODBN), WOA-based NN (WOANN) techniques and the results are obtained, which shows the superiority of proposed algorithm over conventional methods.

Sign in / Sign up

Export Citation Format

Share Document