scholarly journals Simplified Neural Network Model Design with Sensitivity Analysis and Electricity Consumption Prediction in a Commercial Building

Energies ◽  
2019 ◽  
Vol 12 (7) ◽  
pp. 1201 ◽  
Author(s):  
Moon Kim ◽  
Jaehoon Cha ◽  
Eunmi Lee ◽  
Van Pham ◽  
Sanghyuk Lee ◽  
...  
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Electricity Consumption ◽  
Shopping Mall ◽  
Commercial Building ◽  
Rapid Urbanization ◽  
Data Set ◽  
Training Time ◽  
Building Model

With growing urbanization, it has become necessary to manage this growth smartly. Specifically, increased electrical energy consumption has become a rapid urbanization trend in China. A building model based on a neural network was proposed to overcome the difficulties of analytical modelling. However, increased amounts of data, repetitive computation, and training time become a limitation of this approach. A simplified model can be used instead of the full order model if the performance is acceptable. In order to select effective data, Mean Impact Value (MIV) has been applied to select meaningful data. To verify this neural network method, we used real electricity consumption data of a shopping mall in China as a case study. In this paper, a Bayesian Regularization Neural Network (BRNN) is utilized to avoid overfitting due to the small amount of data. With the simplified data set, the building model showed reasonable performance. The mean of Root Mean Square Error achieved is around 10% with respect to the actual consumption and the standard deviation is low, which reflects the model’s reliability. We also compare the results with our previous approach using the Levenberg–Marquardt back propagation (LM-BP) method. The main difference is the output reliability of the two methods. LM-BP shows higher error than BRNN due to overfitting. BRNN shows reliable prediction results when the simplified neural network model is applied.

scholarly journals RISC-V Virtual Platform-Based Convolutional Neural Network Accelerator Implemented in SystemC

Electronics ◽  
2021 ◽  
Vol 10 (13) ◽  
pp. 1514
Author(s):  
Seung-Ho Lim ◽  
WoonSik William Suh ◽  
Jin-Young Kim ◽  
Sang-Young Cho
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Network Model ◽  
Neural Network Model ◽  
Deep Neural Network ◽  
System Level ◽  
Neural Network Models ◽  
Data Set ◽  
Embedded Device ◽  
Virtual Platform

The optimization for hardware processor and system for performing deep learning operations such as Convolutional Neural Networks (CNN) in resource limited embedded devices are recent active research area. In order to perform an optimized deep neural network model using the limited computational unit and memory of an embedded device, it is necessary to quickly apply various configurations of hardware modules to various deep neural network models and find the optimal combination. The Electronic System Level (ESL) Simulator based on SystemC is very useful for rapid hardware modeling and verification. In this paper, we designed and implemented a Deep Learning Accelerator (DLA) that performs Deep Neural Network (DNN) operation based on the RISC-V Virtual Platform implemented in SystemC in order to enable rapid and diverse analysis of deep learning operations in an embedded device based on the RISC-V processor, which is a recently emerging embedded processor. The developed RISC-V based DLA prototype can analyze the hardware requirements according to the CNN data set through the configuration of the CNN DLA architecture, and it is possible to run RISC-V compiled software on the platform, can perform a real neural network model like Darknet. We performed the Darknet CNN model on the developed DLA prototype, and confirmed that computational overhead and inference errors can be analyzed with the DLA prototype developed by analyzing the DLA architecture for various data sets.

scholarly journals Exploiting the Relationship between Pruning Ratio and Compression Effect for Neural Network Model Based on TensorFlow

2020 ◽  
Vol 2020 ◽  
pp. 1-8
Author(s):  
Bo Liu ◽  
Qilin Wu ◽  
Yiwen Zhang ◽  
Qian Cao
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Prediction Accuracy ◽  
Computing Time ◽  
Experimental Results ◽  
Data Set ◽  
Compression Effect ◽  
Model Based ◽  
The Relationship

Pruning is a method of compressing the size of a neural network model, which affects the accuracy and computing time when the model makes a prediction. In this paper, the hypothesis that the pruning proportion is positively correlated with the compression scale of the model but not with the prediction accuracy and calculation time is put forward. For testing the hypothesis, a group of experiments are designed, and MNIST is used as the data set to train a neural network model based on TensorFlow. Based on this model, pruning experiments are carried out to investigate the relationship between pruning proportion and compression effect. For comparison, six different pruning proportions are set, and the experimental results confirm the above hypothesis.

An explicit methodology for manufacturing cost–tolerance modeling and optimization using the neural network integrated with the genetic algorithm

2020 ◽  
Vol 34 (3) ◽  
pp. 430-443
Author(s):  
A. Saravanan ◽  
J. Jerald ◽  
A. Delphin Carolina Rani
Keyword(s):  
Neural Network ◽  
Genetic Algorithm ◽  
Network Model ◽  
Neural Network Model ◽  
Network Models ◽  
Manufacturing Cost ◽  
Genetic Operators ◽  
Neural Network Models ◽  
Data Set ◽  
The Neural Network

AbstractThe objective of the paper is to develop a new method to model the manufacturing cost–tolerance and to optimize the tolerance values along with its manufacturing cost. A cost–tolerance relation has a complex nonlinear correlation among them. The property of a neural network makes it possible to model the complex correlation, and the genetic algorithm (GA) is integrated with the best neural network model to optimize the tolerance values. The proposed method used three types of neural network models (multilayer perceptron, backpropagation network, and radial basis function). These network models were developed separately for prismatic and rotational parts. For the construction of network models, part size and tolerance values were used as input neurons. The reference manufacturing cost was assigned as the output neuron. The qualitative production data set was gathered in a workshop and partitioned into three files for training, testing, and validation, respectively. The architecture of the network model was identified based on the best regression coefficient and the root-mean-square-error value. The best network model was integrated into the GA, and the role of genetic operators was also studied. Finally, two case studies from the literature were demonstrated in order to validate the proposed method. A new methodology based on the neural network model enables the design and process planning engineers to propose an intelligent decision irrespective of their experience.

scholarly journals Prediction Model of Hot Metal Silicon Content Based on Improved GA-BPNN

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Zeqian Cui ◽  
Yang Han ◽  
Chaomeng Lu ◽  
Yafeng Wu ◽  
Mansheng Chu
Keyword(s):  
Neural Network ◽  
Blast Furnace ◽  
Time Delay ◽  
Network Model ◽  
Neural Network Model ◽  
Silicon Content ◽  
Large Time ◽  
Hot Metal ◽  
Multiple Control ◽  
Data Set

The inconsistency of the detection period of blast furnace data and the large time delay of key parameters make the prediction of the hot metal silicon content face huge challenges. Aiming at the problem that the hot metal silicon content is not consistent with the detection period of time series of multiple control parameters, the cubic spline interpolation fitting model was used to realize the data integration of multiple detection periods. The large time delay of the blast furnace iron making process was analyzed. Moreover, Spearman analysis was combined with the weighted moving average method to optimize the data set of silicon content prediction. Aiming at the problem of low prediction accuracy of the ordinary neural network model, genetic algorithm was used to optimize parameters on the BP neural network model to improve the convergence speed of the model to achieve global optimization. Combined with the autocorrelation analysis of the hot metal silicon content, a modified model for the prediction of hot metal silicon content based on error analysis was proposed to further improve the accuracy of the prediction. The model comprehensively considers problems such as data detection inconsistency, large time delay, and inaccuracy of prediction results. Its average absolute error is 0.05009, which can be used in actual production.

scholarly journals Identification of a Typical CSTR Using Optimal Focused Time Lagged Recurrent Neural Network Model with Gamma Memory Filter

2009 ◽  
Vol 2009 ◽  
pp. 1-7
Author(s):  
S. N. Naikwad ◽  
S. V. Dudul
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Recurrent Neural Network ◽  
Neural Network Model ◽  
Learning Rule ◽  
Continuous Stirred Tank Reactor ◽  
Back Propagation Algorithm ◽  
Data Set ◽  
Highly Nonlinear ◽  
Time Lagged

A focused time lagged recurrent neural network (FTLR NN) with gamma memory filter is designed to learn the subtle complex dynamics of a typical CSTR process. Continuous stirred tank reactor exhibits complex nonlinear operations where reaction is exothermic. It is noticed from literature review that process control of CSTR using neuro-fuzzy systems was attempted by many, but optimal neural network model for identification of CSTR process is not yet available. As CSTR process includes temporal relationship in the input-output mappings, time lagged recurrent neural network is particularly used for identification purpose. The standard back propagation algorithm with momentum term has been proposed in this model. The various parameters like number of processing elements, number of hidden layers, training and testing percentage, learning rule and transfer function in hidden and output layer are investigated on the basis of performance measures like MSE, NMSE, and correlation coefficient on testing data set. Finally effects of different norms are tested along with variation in gamma memory filter. It is demonstrated that dynamic NN model has a remarkable system identification capability for the problems considered in this paper. Thus FTLR NN with gamma memory filter can be used to learn underlying highly nonlinear dynamics of the system, which is a major contribution of this paper.

Phát hiện mã độc IoT botnet dựa trên đồ thị PSI với mô hình Skip-gram

2020 ◽  
Vol 7 (1) ◽  
pp. 29-36
Author(s):  
Ngô Quốc Dũng ◽  
Lê Văn Hoàng ◽  
Nguyễn Huy Trung
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Experimental Results ◽  
Data Set ◽  
Iot Devices

 Tóm tắt— Trong bài báo này, nhóm tác giả đề xuất một phương pháp phát hiện mã độc IoT botnet dựa trên đồ thị PSI (Printable String Information)  sử dụng mạng nơ-ron tích chập (Convolutional Neural Network - CNN). Thông qua việc phân tích đặc tính của Botnet trên các thiết bị IoT, phương pháp đề xuất xây dựng đồ thị để thể hiện các mối liên kết giữa các PSI, làm đầu vào cho mô hình mạng nơ-ron CNN phân lớp. Kết quả thực nghiệm trên bộ dữ liệu 10033 tập tin ELF gồm 4002 mẫu mã độc IoT botnet và 6031 tập tin lành tính cho thấy phương pháp đề xuất đạt độ chính xác (accuracy) và độ đo F1 lên tới 98,1%. Abstract— In this paper, the authors propose a method for detecting IoT botnet malware based on PSI graphs using Convolutional Neural Network (CNN). Through analyzing the characteristics of Botnet on IoT devices, the proposed method construct the graph to show the relations between PSIs, as input for the CNN neural network model. Experimental results on the 10033 data set of ELF files including 4002 IoT botnet malware samples and 6031 benign files show Accuracy and F1-score up to 98.1%. 

scholarly journals A Cross Entropy Based Deep Neural Network Model for Road Extraction from Satellite Images

Entropy ◽  
2020 ◽  
Vol 22 (5) ◽  
pp. 535 ◽  
Author(s):  
Bowei Shan ◽  
Yong Fang
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Satellite Images ◽  
Cross Entropy ◽  
Road Extraction ◽  
Training Time ◽  
Deep Model ◽  
Spatial Pyramid Pooling ◽  
Asynchronous Training

This paper proposes a deep convolutional neural network model with encoder-decoder architecture to extract road network from satellite images. We employ ResNet-18 and Atrous Spatial Pyramid Pooling technique to trade off between the extraction precision and running time. A modified cross entropy loss function is proposed to train our deep model. A PointRend algorithm is used to recover a smooth, clear and sharp road boundary. The augmentated DeepGlobe dataset is used to train our deep model and the asynchronous training method is applied to accelerate the training process. Five salellite images covering Xiaomu village are taken as input to evaluate our model. The proposed E-Road model has fewer number of parameters and shorter training time. The experiments show E-Road outperforms other state-of-the-art deep models with 5.84% to 59.09% improvement, and can give the accurate predictions for the images with complex environment.

Learning Chinese Word Segmentation Based on Bidirectional GRU-CRF and CNN Network Model

2019 ◽  
Vol 15 (3) ◽  
pp. 47-62 ◽  
Author(s):  
Chenghai Yu ◽  
Shupei Wang ◽  
Jiajun Guo
Keyword(s):  
Neural Network ◽  
Network Model ◽  
Neural Network Model ◽  
Network Models ◽  
Word Segmentation ◽  
Chinese Word ◽  
Chinese Word Segmentation ◽  
Neural Network Models ◽  
Long Distance ◽  
Training Time

Chinese word segmentation is the basis of the Chinese natural language processing (NLP). With the development of the deep learning, various neural network models are applied to the Chinese word segmentation. However, current neural network models have the characteristics of artificial feature extraction, nonstandard word-weight, inability to effectively use long-distance information and long training time of models in Chinese word segmentation. To solve a series of problems, this article presents a CNN-Bidirectional GRU-CRF neural network model (CNN Bidirectional GRU CRF Network, CBiGCN), which breaks through the limit of conventional method window, truly realizes end-to-end processing and applies to the neural network model by the five-Tag set method, bias-variable-weight greedy strategy and supplements by Goldstein-Armijo guidelines. Besides, this model, with simple structure, is easy to be operated. And it can automatically learn features, reduces large amounts of tasks on specific knowledge in the form of handcrafted features and data pre-processing, makes use of context information effectively. The authors set an experiment with two data corpuses for Chinese word segmentation to evaluate their system. The experiment verified their new model can obtain better Chinese word segmentation results and greatly reduce training time.

Sign in / Sign up

Export Citation Format

Share Document