Adaptive Attention-Aware Gated Recurrent Unit for Sequential Recommendation

2019 ◽  
pp. 317-332 ◽  
Author(s):  
Anjing Luo ◽  
Pengpeng Zhao ◽  
Yanchi Liu ◽  
Jiajie Xu ◽  
Zhixu Li ◽  
...  
Keyword(s):  
Gated Recurrent Unit

scholarly journals Combination of Convolutional Neural Network and Gated Recurrent Unit for Aspect-Based Sentiment Analysis

IEEE Access ◽  
2021 ◽  
Vol 9 ◽  
pp. 15561-15569
Author(s):  
Narisa Zhao ◽  
Huan Gao ◽  
Xin Wen ◽  
Hui Li
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Sentiment Analysis ◽  
Gated Recurrent Unit

scholarly journals Multi-Scale Convolutional Gated Recurrent Unit Networks for Tool Wear Prediction in Smart Manufacturing

2021 ◽  
Vol 34 (1) ◽  
Author(s):  
Weixin Xu ◽  
Huihui Miao ◽  
Zhibin Zhao ◽  
Jinxin Liu ◽  
Chuang Sun ◽  
...  
Keyword(s):  
Tool Wear ◽  
Information Technologies ◽  
Manufacturing Systems ◽  
Smart Manufacturing ◽  
Wear Prediction ◽  
Multi Scale ◽  
Tool Wear Prediction ◽  
Machine Health Monitoring ◽  
Gated Recurrent Unit ◽  
Unit Network

AbstractAs an integrated application of modern information technologies and artificial intelligence, Prognostic and Health Management (PHM) is important for machine health monitoring. Prediction of tool wear is one of the symbolic applications of PHM technology in modern manufacturing systems and industry. In this paper, a multi-scale Convolutional Gated Recurrent Unit network (MCGRU) is proposed to address raw sensory data for tool wear prediction. At the bottom of MCGRU, six parallel and independent branches with different kernel sizes are designed to form a multi-scale convolutional neural network, which augments the adaptability to features of different time scales. These features of different scales extracted from raw data are then fed into a Deep Gated Recurrent Unit network to capture long-term dependencies and learn significant representations. At the top of the MCGRU, a fully connected layer and a regression layer are built for cutting tool wear prediction. Two case studies are performed to verify the capability and effectiveness of the proposed MCGRU network and results show that MCGRU outperforms several state-of-the-art baseline models.

scholarly journals Highway Speed Prediction Using Gated Recurrent Unit Neural Networks

2021 ◽  
Vol 11 (7) ◽  
pp. 3059
Author(s):  
Myeong-Hun Jeong ◽  
Tae-Young Lee ◽  
Seung-Bae Jeon ◽  
Minkyo Youm
Keyword(s):  
Neural Network ◽  
Intelligent Transportation Systems ◽  
Moving Average ◽  
Computational Cost ◽  
Nonlinear Problems ◽  
Transportation Systems ◽  
Mobility Data ◽  
Challenges And Opportunities ◽  
Moving Average Model ◽  
Gated Recurrent Unit

Movement analytics and mobility insights play a crucial role in urban planning and transportation management. The plethora of mobility data sources, such as GPS trajectories, poses new challenges and opportunities for understanding and predicting movement patterns. In this study, we predict highway speed using a gated recurrent unit (GRU) neural network. Based on statistical models, previous approaches suffer from the inherited features of traffic data, such as nonlinear problems. The proposed method predicts highway speed based on the GRU method after training on digital tachograph data (DTG). The DTG data were recorded in one month, giving approximately 300 million records. These data included the velocity and locations of vehicles on the highway. Experimental results demonstrate that the GRU-based deep learning approach outperformed the state-of-the-art alternatives, the autoregressive integrated moving average model, and the long short-term neural network (LSTM) model, in terms of prediction accuracy. Further, the computational cost of the GRU model was lower than that of the LSTM. The proposed method can be applied to traffic prediction and intelligent transportation systems.

IoT-based Epidemic Monitoring via Improved Gated Recurrent Unit Model

2021 ◽  
pp. 1-1
Author(s):  
Fang Hu ◽  
Jia Liu ◽  
Liuhuan Li ◽  
Mingfang Huang ◽  
Changguo Yang
Keyword(s):  
Epidemic Monitoring ◽  
Unit Model ◽  
Gated Recurrent Unit

scholarly journals A Spatiotemporal Convolutional Gated Recurrent Unit Network for Mean Wave Period Field Forecasting

2021 ◽  
Vol 9 (4) ◽  
pp. 383
Author(s):  
Ting Yu ◽  
Jichao Wang
Keyword(s):  
Lead Time ◽  
Wave Period ◽  
Data Driven ◽  
Lead Times ◽  
Proposed Model ◽  
Data Driven Approach ◽  
Mean Wave Period ◽  
Scattering Index ◽  
Gated Recurrent Unit ◽  
Methods Numerical

Mean wave period (MWP) is one of the key parameters affecting the design of marine facilities. Currently, there are two main methods, numerical and data-driven methods, for forecasting wave parameters, of which the latter are widely used. However, few studies have focused on MWP forecasting, and even fewer have investigated it with spatial and temporal information. In this study, correlations between ocean dynamic parameters are explored to obtain appropriate input features, significant wave height (SWH) and MWP. Subsequently, a data-driven approach, the convolution gated recurrent unit (Conv-GRU) model with spatiotemporal characteristics, is utilized to field forecast MWP with 1, 3, 6, 12, and 24-h lead times in the South China Sea. Six points at different locations and six consecutive moments at every 12-h intervals are selected to study the forecasting ability of the proposed model. The Conv-GRU model has a better performance than the single gated recurrent unit (GRU) model in terms of root mean square error (RMSE), the scattering index (SI), Bias, and the Pearson’s correlation coefficient (R). With the lead time increasing, the forecast effect shows a decreasing trend, specifically, the experiment displays a relatively smooth forecast curve and presents a great advantage in the short-term forecast of the MWP field in the Conv-GRU model, where the RMSE is 0.121 m for 1-h lead time.

scholarly journals Deep Learning Forecasts of Soil Moisture: Convolutional Neural Network and Gated Recurrent Unit Models Coupled with Satellite-Derived MODIS, Observations and Synoptic-Scale Climate Index Data

2021 ◽  
Vol 13 (4) ◽  
pp. 554
Author(s):  
A. A. Masrur Ahmed ◽  
Ravinesh C Deo ◽  
Nawin Raj ◽  
Afshin Ghahramani ◽  
Qi Feng ◽  
...  
Keyword(s):  
Neural Network ◽  
Soil Moisture ◽  
Deep Learning ◽  
Convolutional Neural Network ◽  
Climate Index ◽  
Climate Indices ◽  
High Temporal Resolution ◽  
Synoptic Scale ◽  
Time Step ◽  
Gated Recurrent Unit

Remotely sensed soil moisture forecasting through satellite-based sensors to estimate the future state of the underlying soils plays a critical role in planning and managing water resources and sustainable agricultural practices. In this paper, Deep Learning (DL) hybrid models (i.e., CEEMDAN-CNN-GRU) are designed for daily time-step surface soil moisture (SSM) forecasts, employing the gated recurrent unit (GRU), complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN), and convolutional neural network (CNN). To establish the objective model’s viability for SSM forecasting at multi-step daily horizons, the hybrid CEEMDAN-CNN-GRU model is tested at 1st, 5th, 7th, 14th, 21st, and 30th day ahead period by assimilating a comprehensive pool of 52 predictor dataset obtained from three distinct data sources. Data comprise satellite-derived Global Land Data Assimilation System (GLDAS) repository a global, high-temporal resolution, unique terrestrial modelling system, and ground-based variables from Scientific Information Landowners (SILO) and synoptic-scale climate indices. The results demonstrate the forecasting capability of the hybrid CEEMDAN-CNN-GRU model with respect to the counterpart comparative models. This is supported by a relatively lower value of the mean absolute percentage and root mean square error. In terms of the statistical score metrics and infographics employed to test the final model’s utility, the proposed CEEMDAN-CNN-GRU models are considerably superior compared to a standalone and other hybrid method tested on independent SSM data developed through feature selection approaches. Thus, the proposed approach can be successfully implemented in hydrology and agriculture management.

Sign in / Sign up

Export Citation Format

Share Document