scholarly journals A Novel LSTM Model with Interaction Dual Attention for Radar Echo Extrapolation

2021 ◽  
Vol 13 (2) ◽  
pp. 164
Author(s):  
Chuyao Luo ◽  
Xutao Li ◽  
Yongliang Wen ◽  
Yunming Ye ◽  
Xiaofeng Zhang
Keyword(s):  
Short Term Memory ◽  
Weather Forecast ◽  
Vital Role ◽  
Data Sets ◽  
Short Term ◽  
Learning Techniques ◽  
Radar Echo ◽  
Hidden States ◽  
Better Than

The task of precipitation nowcasting is significant in the operational weather forecast. The radar echo map extrapolation plays a vital role in this task. Recently, deep learning techniques such as Convolutional Recurrent Neural Network (ConvRNN) models have been designed to solve the task. These models, albeit performing much better than conventional optical flow based approaches, suffer from a common problem of underestimating the high echo value parts. The drawback is fatal to precipitation nowcasting, as the parts often lead to heavy rains that may cause natural disasters. In this paper, we propose a novel interaction dual attention long short-term memory (IDA-LSTM) model to address the drawback. In the method, an interaction framework is developed for the ConvRNN unit to fully exploit the short-term context information by constructing a serial of coupled convolutions on the input and hidden states. Moreover, a dual attention mechanism on channels and positions is developed to recall the forgotten information in the long term. Comprehensive experiments have been conducted on CIKM AnalytiCup 2017 data sets, and the results show the effectiveness of the IDA-LSTM in addressing the underestimation drawback. The extrapolation performance of IDA-LSTM is superior to that of the state-of-the-art methods.

scholarly journals Electrical load forecasting through long short term memory

2022 ◽  
Vol 25 (1) ◽  
pp. 42
Author(s):  
Debani Prasad Mishra ◽  
Sanhita Mishra ◽  
Rakesh Kumar Yadav ◽  
Rishabh Vishnoi ◽  
Surender Reddy Salkuti
Keyword(s):  
Short Term Memory ◽  
Electrical Energy ◽  
Data Sets ◽  
Short Term ◽  
Adequate Model ◽  
Term Memory ◽  
Large Sets ◽  
Electrical Load Forecasting ◽  
Long Short Term Memory

For a power supplier, meeting demand-supply equilibrium is of utmost importance. Electrical energy must be generated according to demand, as a large amount of electrical energy cannot be stored. For the proper functioning of a power supply system, an adequate model for predicting load is a necessity. In the present world, in almost every industry, whether it be healthcare, agriculture, and consulting, growing digitization and automation is a prominent feature. As a result, large sets of data related to these industries are being generated, which when subjected to rigorous analysis, yield out-of-the-box methods to optimize the business and services offered. This paper aims to ascertain the viability of long short term memory (LSTM) neural networks, a recurrent neural network capable of handling both long-term and short-term dependencies of data sets, for predicting load that is to be met by a Dispatch Center located in a major city. The result shows appreciable accuracy in forecasting future demand.

scholarly journals An Attention-Based Recommender System to Predict Contextual Intent Based on Choice Histories across and within Sessions

2018 ◽  
Vol 8 (12) ◽  
pp. 2426 ◽  
Author(s):  
Ruo Huang ◽  
Shelby McIntyre ◽  
Meina Song ◽  
Haihong E ◽  
Zhonghong Ou
Keyword(s):  
Recommender Systems ◽  
State Of The Art ◽  
User Profile ◽  
Vital Role ◽  
Short Term ◽  
Novel Approach ◽  
Learning Techniques ◽  
Real World Datasets ◽  
Near Future

Recent years have witnessed the growth of recommender systems, with the help of deep learning techniques. Recurrent Neural Networks (RNNs) play an increasingly vital role in various session-based recommender systems, since they use the user’s sequential history to build a comprehensive user profile, which helps improve the recommendation. However, a problem arises regarding how to be aware of the variation in the user’s contextual preference, especially the short-term intent in the near future, and make the best use of it to produce a precise recommendation at the start of a session. We propose a novel approach named Attention-based Short-term and Long-term Model (ASLM), to improve the next-item recommendation, by using an attention-based RNNs integrating both the user’s short-term intent and the long-term preference at the same time with a two-layer network. The experimental study on three real-world datasets and two sub-datasets demonstrates that, compared with other state-of-the-art methods, the proposed approach can significantly improve the next-item recommendation, especially at the start of sessions. As a result, our proposed approach is capable of coping with the cold-start problem at the beginning of each session.

Conceptual short-term memory (CSTM) supports core claims of Christiansen and Chater

2016 ◽  
Vol 39 ◽  
Author(s):  
Mary C. Potter
Keyword(s):  
Working Memory ◽  
Rapid Serial Visual Presentation ◽  
Language Comprehension ◽  
Short Term Memory ◽  
Visual Presentation ◽  
Long Term Memory ◽  
Short Term ◽  
Term Memory ◽  
Use Of Knowledge

AbstractRapid serial visual presentation (RSVP) of words or pictured scenes provides evidence for a large-capacity conceptual short-term memory (CSTM) that momentarily provides rich associated material from long-term memory, permitting rapid chunking (Potter 1993; 2009; 2012). In perception of scenes as well as language comprehension, we make use of knowledge that briefly exceeds the supposed limits of working memory.

Comparison of Auditory, Language, Memory, and Attention Abilities in Children With and Without Listening Difficulties

2020 ◽  
Vol 29 (4) ◽  
pp. 710-727
Author(s):  
Beula M. Magimairaj ◽  
Naveen K. Nagaraj ◽  
Alexander V. Sergeev ◽  
Natalie J. Benafield
Keyword(s):  
Auditory Processing ◽  
Short Term Memory ◽  
Group Differences ◽  
Long Term Memory ◽  
Short Term ◽  
Significant Group ◽  
Term Memory ◽  
Memory And Attention ◽  
Speed And Accuracy

Objectives School-age children with and without parent-reported listening difficulties (LiD) were compared on auditory processing, language, memory, and attention abilities. The objective was to extend what is known so far in the literature about children with LiD by using multiple measures and selective novel measures across the above areas. Design Twenty-six children who were reported by their parents as having LiD and 26 age-matched typically developing children completed clinical tests of auditory processing and multiple measures of language, attention, and memory. All children had normal-range pure-tone hearing thresholds bilaterally. Group differences were examined. Results In addition to significantly poorer speech-perception-in-noise scores, children with LiD had reduced speed and accuracy of word retrieval from long-term memory, poorer short-term memory, sentence recall, and inferencing ability. Statistically significant group differences were of moderate effect size; however, standard test scores of children with LiD were not clinically poor. No statistically significant group differences were observed in attention, working memory capacity, vocabulary, and nonverbal IQ. Conclusions Mild signal-to-noise ratio loss, as reflected by the group mean of children with LiD, supported the children's functional listening problems. In addition, children's relative weakness in select areas of language performance, short-term memory, and long-term memory lexical retrieval speed and accuracy added to previous research on evidence-based areas that need to be evaluated in children with LiD who almost always have heterogenous profiles. Importantly, the functional difficulties faced by children with LiD in relation to their test results indicated, to some extent, that commonly used assessments may not be adequately capturing the children's listening challenges. Supplemental Material https://doi.org/10.23641/asha.12808607

Using Machine Learning Algorithms on Prediction of Stock Price

2020 ◽  
Vol 12 (2) ◽  
pp. 84-99
Author(s):  
Li-Pang Chen
Keyword(s):  
Machine Learning ◽  
Stock Price ◽  
Short Term Memory ◽  
Machine Learning Algorithms ◽  
Machine Learning Techniques ◽  
Support Vector ◽  
Short Term ◽  
Learning Techniques ◽  
Historical Database ◽  
Long Short Term Memory

In this paper, we investigate analysis and prediction of the time-dependent data. We focus our attention on four different stocks are selected from Yahoo Finance historical database. To build up models and predict the future stock price, we consider three different machine learning techniques including Long Short-Term Memory (LSTM), Convolutional Neural Networks (CNN) and Support Vector Regression (SVR). By treating close price, open price, daily low, daily high, adjusted close price, and volume of trades as predictors in machine learning methods, it can be shown that the prediction accuracy is improved.

scholarly journals Two Stage Continuous Gesture Recognition Based on Deep Learning

Electronics ◽  
2021 ◽  
Vol 10 (5) ◽  
pp. 534
Author(s):  
Huogen Wang
Keyword(s):  
Gesture Recognition ◽  
Large Scale ◽  
Short Term Memory ◽  
Short Term ◽  
Hand Motion ◽  
Spatiotemporal Features ◽  
Spatiotemporal Information ◽  
Video Frames ◽  
Depth Sequences

The paper proposes an effective continuous gesture recognition method, which includes two modules: segmentation and recognition. In the segmentation module, the video frames are divided into gesture frames and transitional frames by using the information of hand motion and appearance, and continuous gesture sequences are segmented into isolated sequences. In the recognition module, our method exploits the spatiotemporal information embedded in RGB and depth sequences. For the RGB modality, our method adopts Convolutional Long Short-Term Memory Networks to learn long-term spatiotemporal features from short-term spatiotemporal features obtained from a 3D convolutional neural network. For the depth modality, our method converts a sequence into Dynamic Images and Motion Dynamic Images through weighted rank pooling and feed them into Convolutional Neural Networks, respectively. Our method has been evaluated on both ChaLearn LAP Large-scale Continuous Gesture Dataset and Montalbano Gesture Dataset and achieved state-of-the-art performance.

scholarly journals An Approach toward the Development of a Functional Encoding Model of Short Term Memory during Reading

1978 ◽  
Vol 10 (2) ◽  
pp. 141-148
Author(s):  
Mary Anne Herndon
Keyword(s):  
Cluster Analysis ◽  
Storage Capacity ◽  
Short Term Memory ◽  
Long Term Memory ◽  
Short Term ◽  
Processing Efficiency ◽  
Term Memory ◽  
Information Unit ◽  
Subsequent Storage

In a model of the functioning of short term memory, the encoding of information for subsequent storage in long term memory is simulated. In the encoding process, semantically equivalent paragraphs are detected for recombination into a macro information unit. This recombination process can be used to relieve the limited storage capacity constraint of short term memory and subsequently increase processing efficiency. The results of the simulation give a favorable indication of the success for the use of cluster analysis as a tool to simulate the encoding function in the detection of semantically similar paragraphs.

Sign in / Sign up

Export Citation Format

Share Document