A Deep Neural Network Model with Multihop Self-attention Mechanism for Topic Segmentation of Texts

Mechanical damage is recognized as a problem that reduces the performance of oil and gas pipelines and has been the subject of continuous research. The artificial neural network in the spotlight recently is expected to be another solution to solve the problems relating to the pipelines. The deep neural network, which is on the basis of artificial neural network algorithm and is a method amongst various machine learning methods, is applied in this study. The applicability of machine learning techniques such as deep neural network for the prediction of burst pressure has been investigated for dented API 5L X-grade pipelines. To this end, supervised learning is employed, and the deep neural network model has four layers with three hidden layers, and the neural network uses the fully connected layer. The burst pressure computed by deep neural network model has been compared with the results of finite element analysis based parametric study, and the burst pressure calculated by the experimental results. According to the comparison results, it showed good agreement. Therefore, it is concluded that deep neural networks can be another solution for predicting the burst pressure of API 5L X-grade dented pipelines.

Download Full-text

Estimating Traffic Volume on Minor Roads at Rural Stop-Controlled Intersections using Deep Learning

Transportation Research Record Journal of the Transportation Research Board ◽

10.1177/0361198119837236 ◽

2019 ◽

Vol 2673 (4) ◽

pp. 108-116 ◽

Cited By ~ 1

Author(s):

Mostafa H. Tawfeek ◽

Karim El-Basyouny

Keyword(s):

Neural Network ◽

Linear Regression ◽

Network Model ◽

Neural Network Model ◽

Deep Neural Network ◽

Safety Management ◽

Estimation Method ◽

Estimation Model ◽

The Neural Network ◽

Annual Average Daily Traffic

Safety Performance Functions (SPFs) are regression models used to predict the expected number of collisions as a function of various traffic and geometric characteristics. One of the integral components in developing SPFs is the availability of accurate exposure factors, that is, annual average daily traffic (AADT). However, AADTs are not often available for minor roads at rural intersections. This study aims to develop a robust AADT estimation model using a deep neural network. A total of 1,350 rural four-legged, stop-controlled intersections from the Province of Alberta, Canada, were used to train the neural network. The results of the deep neural network model were compared with the traditional estimation method, which uses linear regression. The results indicated that the deep neural network model improved the estimation of minor roads’ AADT by 35% when compared with the traditional method. Furthermore, SPFs developed using linear regression resulted in models with statistically insignificant AADTs on minor roads. Conversely, the SPF developed using the neural network provided a better fit to the data with both AADTs on minor and major roads being statistically significant variables. The findings indicated that the proposed model could enhance the predictive power of the SPF and therefore improve the decision-making process since SPFs are used in all parts of the safety management process.

Download Full-text

Detection of DDoS attacks with feed forward based deep neural network model

Expert Systems with Applications ◽

10.1016/j.eswa.2020.114520 ◽

2021 ◽

Vol 169 ◽

pp. 114520

Author(s):

Abdullah Emir Cil ◽

Kazim Yildiz ◽

Ali Buldu

Keyword(s):

Neural Network ◽

Network Model ◽

Neural Network Model ◽

Deep Neural Network ◽

Ddos Attacks ◽

Feed Forward

Download Full-text

Correlations between deep neural network model coverage criteria and model quality

Proceedings of the 28th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering ◽

10.1145/3368089.3409671 ◽

2020 ◽

Author(s):

Shenao Yan ◽

Guanhong Tao ◽

Xuwei Liu ◽

Juan Zhai ◽

Shiqing Ma ◽

...

Keyword(s):

Neural Network ◽

Network Model ◽

Neural Network Model ◽

Deep Neural Network ◽

Model Quality ◽

Coverage Criteria

Download Full-text

RISC-V Virtual Platform-Based Convolutional Neural Network Accelerator Implemented in SystemC

Electronics ◽

10.3390/electronics10131514 ◽

2021 ◽

Vol 10 (13) ◽

pp. 1514

Author(s):

Seung-Ho Lim ◽

WoonSik William Suh ◽

Jin-Young Kim ◽

Sang-Young Cho

Keyword(s):

Neural Network ◽

Deep Learning ◽

Network Model ◽

Neural Network Model ◽

Deep Neural Network ◽

System Level ◽

Neural Network Models ◽

Data Set ◽

Embedded Device ◽

Virtual Platform

The optimization for hardware processor and system for performing deep learning operations such as Convolutional Neural Networks (CNN) in resource limited embedded devices are recent active research area. In order to perform an optimized deep neural network model using the limited computational unit and memory of an embedded device, it is necessary to quickly apply various configurations of hardware modules to various deep neural network models and find the optimal combination. The Electronic System Level (ESL) Simulator based on SystemC is very useful for rapid hardware modeling and verification. In this paper, we designed and implemented a Deep Learning Accelerator (DLA) that performs Deep Neural Network (DNN) operation based on the RISC-V Virtual Platform implemented in SystemC in order to enable rapid and diverse analysis of deep learning operations in an embedded device based on the RISC-V processor, which is a recently emerging embedded processor. The developed RISC-V based DLA prototype can analyze the hardware requirements according to the CNN data set through the configuration of the CNN DLA architecture, and it is possible to run RISC-V compiled software on the platform, can perform a real neural network model like Darknet. We performed the Darknet CNN model on the developed DLA prototype, and confirmed that computational overhead and inference errors can be analyzed with the DLA prototype developed by analyzing the DLA architecture for various data sets.

Download Full-text