scholarly journals Outpatient Text Classification Using Attention-Based Bidirectional LSTM for Robot-Assisted Servicing in Hospital

Information ◽  
2020 ◽  
Vol 11 (2) ◽  
pp. 106 ◽  
Author(s):  
Che-Wen Chen ◽  
Shih-Pang Tseng ◽  
Ta-Wen Kuan ◽  
Jhing-Fa Wang
Keyword(s):  
Text Classification ◽  
Short Term Memory ◽  
Family Doctor ◽  
Training Data ◽  
Service Robots ◽  
Service Robot ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Long Short Term Memory

In general, patients who are unwell do not know with which outpatient department they should register, and can only get advice after they are diagnosed by a family doctor. This may cause a waste of time and medical resources. In this paper, we propose an attention-based bidirectional long short-term memory (Att-BiLSTM) model for service robots, which has the ability to classify outpatient categories according to textual content. With the outpatient text classification system, users can talk about their situation to a service robot and the robot can tell them which clinic they should register with. In the implementation of the proposed method, dialog text of users in the Taiwan E Hospital were collected as the training data set. Through natural language processing (NLP), the information in the dialog text was extracted, sorted, and converted to train the long-short term memory (LSTM) deep learning model. Experimental results verify the ability of the robot to respond to questions autonomously through acquired casual knowledge.

scholarly journals Airfoil buffet aerodynamics at plunge and pitch excitation based on long short-term memory neural network prediction

2021 ◽  
Author(s):  
R. Zahn ◽  
C. Breitsamter
Keyword(s):  
Neural Network ◽  
Short Term Memory ◽  
Training Data ◽  
Good Prediction ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Identification Approach ◽  
Long Short Term Memory ◽  
Transonic Buffet

AbstractIn the present study, a nonlinear system identification approach based on a long short-term memory (LSTM) neural network is applied for the prediction of transonic buffet aerodynamics. The identification approach is applied as a reduced-order modeling (ROM) technique for an efficient computation of time-varying integral quantities such as aerodynamic force and moment coefficients. Therefore, the nonlinear identification procedure as well as the generalization of the ROM are presented. The training data set for the LSTM–ROM is provided by performing forced-motion unsteady Reynolds-averaged Navier–Stokes simulations. Subsequent to the training process, the ROM is applied for the computation of the aerodynamic integral quantities associated with transonic buffet. The performance of the trained ROM is demonstrated by computing the aerodynamic loads of the NACA0012 airfoil investigated at transonic freestream conditions. In contrast to previous studies considering only a pitching excitation, both the pitch and plunge degrees of freedom of the airfoil are individually and simultaneously excited by means of an user-defined training signal. Therefore, strong nonlinear effects are considered for the training of the ROM. By comparing the results with a full-order computational fluid dynamics solution, a good prediction capability of the presented ROM method is indicated. However, compared to the results of previous studies including only the airfoil pitching excitation, a slightly reduced prediction performance is shown.

scholarly journals A Dense Long Short-Term Memory Model for Enhancing the Imagery-Based Brain-Computer Interface

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Xiaofei Zhang ◽  
Tao Wang ◽  
Qi Xiong ◽  
Yina Guo
Keyword(s):  
Short Term Memory ◽  
Recognition Algorithm ◽  
Training Process ◽  
Short Term ◽  
Data Set ◽  
Static State ◽  
Term Memory ◽  
Long Short Term Memory ◽  
Model Training ◽  
The One

Imagery-based brain-computer interfaces (BCIs) aim to decode different neural activities into control signals by identifying and classifying various natural commands from electroencephalogram (EEG) patterns and then control corresponding equipment. However, several traditional BCI recognition algorithms have the “one person, one model” issue, where the convergence of the recognition model’s training process is complicated. In this study, a new BCI model with a Dense long short-term memory (Dense-LSTM) algorithm is proposed, which combines the event-related desynchronization (ERD) and the event-related synchronization (ERS) of the imagery-based BCI; model training and testing were conducted with its own data set. Furthermore, a new experimental platform was built to decode the neural activity of different subjects in a static state. Experimental evaluation of the proposed recognition algorithm presents an accuracy of 91.56%, which resolves the “one person one model” issue along with the difficulty of convergence in the training process.

scholarly journals An Indirect Approach Based on Long Short-Term Memory Networks to Estimate Groundwater Table Depth Anomalies Across Europe With an Application for Drought Analysis

2021 ◽  
Vol 3 ◽  
Author(s):  
Yueling Ma ◽  
Carsten Montzka ◽  
Bagher Bayat ◽  
Stefan Kollet
Keyword(s):  
Soil Moisture ◽  
Indirect Method ◽  
Short Term Memory ◽  
Groundwater Table ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Continental Scale ◽  
Groundwater Table Depth ◽  
Long Short Term Memory

The lack of high-quality continental-scale groundwater table depth observations necessitates developing an indirect method to produce reliable estimation for water table depth anomalies (wtda) over Europe to facilitate European groundwater management under drought conditions. Long Short-Term Memory (LSTM) networks are a deep learning technology to exploit long-short-term dependencies in the input-output relationship, which have been observed in the response of groundwater dynamics to atmospheric and land surface processes. Here, we introduced different input variables including precipitation anomalies (pra), which is the most common proxy of wtda, for the networks to arrive at improved wtda estimates at individual pixels over Europe in various experiments. All input and target data involved in this study were obtained from the simulated TSMP-G2A data set. We performed wavelet coherence analysis to gain a comprehensive understanding of the contributions of different input variable combinations to wtda estimates. Based on the different experiments, we derived an indirect method utilizing LSTM networks with pra and soil moisture anomaly (θa) as input, which achieved the optimal network performance. The regional medians of test R2 scores and RMSEs obtained by the method in the areas with wtd ≤ 3.0 m were 76–95% and 0.17–0.30, respectively, constituting a 20–66% increase in median R2 and a 0.19–0.30 decrease in median RMSEs compared to the LSTM networks only with pra as input. Our results show that introducing θa significantly improved the performance of the trained networks to predict wtda, indicating the substantial contribution of θa to explain groundwater anomalies. Also, the European wtda map reproduced by the method had good agreement with that derived from the TSMP-G2A data set with respect to drought severity, successfully detecting ~41% of strong drought events (wtda ≥ 1.5) and ~29% of extreme drought events (wtda ≥ 2) in August 2015. The study emphasizes the importance to combine soil moisture information with precipitation information in quantifying or predicting groundwater anomalies. In the future, the indirect method derived in this study can be transferred to real-time monitoring of groundwater drought at the continental scale using remotely sensed soil moisture and precipitation observations or respective information from weather prediction models.

PrivItem2Vec: A privacy-preserving algorithm for top-N recommendation

2021 ◽  
Vol 17 (12) ◽  
pp. 155014772110612
Author(s):  
Zhengqiang Ge ◽  
Xinyu Liu ◽  
Qiang Li ◽  
Yu Li ◽  
Dong Guo
Keyword(s):  
Time Series ◽  
Internet Of Things ◽  
Privacy Protection ◽  
Short Term Memory ◽  
Short Term ◽  
Recommendation Algorithm ◽  
Data Set ◽  
Term Memory ◽  
Protection Mechanism ◽  
Long Short Term Memory

To significantly protect the user’s privacy and prevent the user’s preference disclosure from leading to malicious entrapment, we present a combination of the recommendation algorithm and the privacy protection mechanism. In this article, we present a privacy recommendation algorithm, PrivItem2Vec, and the concept of the recommended-internet of things, which is a privacy recommendation algorithm, consisting of user’s information, devices, and items. Recommended-internet of things uses bidirectional long short-term memory, based on item2vec, which improves algorithm time series and the recommended accuracy. In addition, we reconstructed the data set in conjunction with the Paillier algorithm. The data on the server are encrypted and embedded, which reduces the readability of the data and ensures the data’s security to a certain extent. Experiments show that our algorithm is superior to other works in terms of recommended accuracy and efficiency.

scholarly journals Chinese Text Classification Model Based on Deep Learning

2018 ◽  
Vol 10 (11) ◽  
pp. 113 ◽  
Author(s):  
Yue Li ◽  
Xutao Wang ◽  
Pengjian Xu
Keyword(s):  
Neural Network ◽  
Deep Learning ◽  
Language Processing ◽  
Chinese Text ◽  
Text Classification ◽  
Short Term Memory ◽  
Classification Model ◽  
Short Term ◽  
Term Memory ◽  
Long Short Term Memory

Text classification is of importance in natural language processing, as the massive text information containing huge amounts of value needs to be classified into different categories for further use. In order to better classify text, our paper tries to build a deep learning model which achieves better classification results in Chinese text than those of other researchers’ models. After comparing different methods, long short-term memory (LSTM) and convolutional neural network (CNN) methods were selected as deep learning methods to classify Chinese text. LSTM is a special kind of recurrent neural network (RNN), which is capable of processing serialized information through its recurrent structure. By contrast, CNN has shown its ability to extract features from visual imagery. Therefore, two layers of LSTM and one layer of CNN were integrated to our new model: the BLSTM-C model (BLSTM stands for bi-directional long short-term memory while C stands for CNN.) LSTM was responsible for obtaining a sequence output based on past and future contexts, which was then input to the convolutional layer for extracting features. In our experiments, the proposed BLSTM-C model was evaluated in several ways. In the results, the model exhibited remarkable performance in text classification, especially in Chinese texts.

scholarly journals Long Short-Term Memory with Dynamic Skip Connections

2019 ◽  
Vol 33 ◽  
pp. 6481-6488 ◽  
Author(s):  
Tao Gui ◽  
Qi Zhang ◽  
Lujun Zhao ◽  
Yaosong Lin ◽  
Minlong Peng ◽  
...  
Keyword(s):  
Language Processing ◽  
Short Term Memory ◽  
Training Data ◽  
Sequential Data ◽  
Short Term ◽  
Term Memory ◽  
Transition Functions ◽  
Proposed Model ◽  
Long Short Term Memory

In recent years, long short-term memory (LSTM) has been successfully used to model sequential data of variable length. However, LSTM can still experience difficulty in capturing long-term dependencies. In this work, we tried to alleviate this problem by introducing a dynamic skip connection, which can learn to directly connect two dependent words. Since there is no dependency information in the training data, we propose a novel reinforcement learning-based method to model the dependency relationship and connect dependent words. The proposed model computes the recurrent transition functions based on the skip connections, which provides a dynamic skipping advantage over RNNs that always tackle entire sentences sequentially. Our experimental results on three natural language processing tasks demonstrate that the proposed method can achieve better performance than existing methods. In the number prediction experiment, the proposed model outperformed LSTM with respect to accuracy by nearly 20%.

scholarly journals A Long Short-Term Memory Model for Global Rapid Intensification Prediction

2020 ◽  
Vol 35 (4) ◽  
pp. 1203-1220 ◽  
Author(s):  
Qidong Yang ◽  
Chia-Ying Lee ◽  
Michael K. Tippett
Keyword(s):  
Short Term Memory ◽  
Surface Wind ◽  
Surface Wind Speed ◽  
Training Data ◽  
Vertical Shear ◽  
Rapid Intensification ◽  
Short Term ◽  
Term Memory ◽  
Skill Scores ◽  
Long Short Term Memory

ABSTRACTRapid intensification (RI) is an outstanding source of error in tropical cyclone (TC) intensity predictions. RI is generally defined as a 24-h increase in TC maximum sustained surface wind speed greater than some threshold, typically 25, 30, or 35 kt (1 kt ≈ 0.51 m s−1). Here, a long short-term memory (LSTM) model for probabilistic RI predictions is developed and evaluated. The variables (features) of the model include storm characteristics (e.g., storm intensity) and environmental variables (e.g., vertical shear) over the previous 48 h. A basin-aware RI prediction model is trained (1981–2009), validated (2010–13), and tested (2014–17) on global data. Models are trained on overlapping 48-h data, which allows multiple training examples for each storm. A challenge is that the data are highly unbalanced in the sense that there are many more non-RI cases than RI cases. To cope with this data imbalance, the synthetic minority-oversampling technique (SMOTE) is used to balance the training data by generating artificial RI cases. Model ensembling is also applied to improve prediction skill further. The model’s Brier skill scores in the Atlantic and eastern North Pacific are higher than those of operational predictions for RI thresholds of 25 and 30 kt and comparable for 35 kt on the independent test data. Composites of the features associated with RI and non-RI situations provide physical insights for how the model discriminates between RI and non-RI cases. Prediction case studies are presented for some recent storms.

Electric Load Forecasting with Deep Machine Learning

2019 ◽  
Vol 16 (8) ◽  
pp. 3404-3409
Author(s):  
Ala Adin Baha Eldin Mustafa Abdelaziz ◽  
Ka Fei Thang ◽  
Jacqueline Lukose
Keyword(s):  
Mobile Application ◽  
Energy Demand ◽  
Short Term Memory ◽  
Historical Data ◽  
Electrical Energy ◽  
Training Data ◽  
Short Term ◽  
Feed Forward Neural Network ◽  
Term Memory ◽  
Long Short Term Memory

The most commonly used form of energy in houses, factories, buildings and agriculture is the electrical energy, however, in recent years, there has been an increase in electrical energy demand due to technology advancements and rise in population, therefore an appropriated forecasting system must be developed to predict these demands as accurately as possible. For this purpose, five models were selected, they are Bidirectional-Long Short Term Memory (Bi-LSTM), Feed Forward Neural Network (FFNN), Long Short Term Memory (LSTM), Nonlinear Auto Regressive network with eXogenous inputs (NARX) and Multiple Linear Regression (MLR). This paper will demonstrate the development of these selected models using MATLAB and an android mobile application, which is used to visualize and interact with the data. The performance of the selected models was evaluated by performing the Mean Absolute Percent Error (MAPE), the selected historical data used to perform the MAPE was obtained from Toronto, Canada and Tasmania, Australia, where the year 2006 until 2016 was used as training data and the year 2017 was used to test the MAPE of the historical data with the models’ data. It is observed that the NARX model had the least MAPE for both the regions resulting in 1.9% for Toronto, Canada and 2.9% for Tasmania, Australia. Google cloud is used as the IoT (Internet of Things) platform for NARX data model, the 2017 datasets is converted to JavaScript Object Notation (JSON) file using JavaScript programming language, for data visualization and analysis for the android mobile application.

scholarly journals HST-LSTM: A Hierarchical Spatial-Temporal Long-Short Term Memory Network for Location Prediction

2018 ◽  
Author(s):  
Dejiang Kong ◽  
Fei Wu
Keyword(s):  
Real Time ◽  
Short Term Memory ◽  
Location Based Services ◽  
Location Prediction ◽  
Trajectory Data ◽  
Short Term ◽  
Data Set ◽  
Term Memory ◽  
Long Time ◽  
Long Short Term Memory

The widely use of positioning technology has made mining the movements of people feasible and plenty of trajectory data have been accumulated. How to efficiently leverage these data for location prediction has become an increasingly popular research topic as it is fundamental to location-based services (LBS). The existing methods often focus either on long time (days or months) visit prediction (i.e., the recommendation of point of interest) or on real time location prediction (i.e., trajectory prediction). In this paper, we are interested in the location prediction problem in a weak real time condition and aim to predict users' movement in next minutes or hours. We propose a Spatial-Temporal Long-Short Term Memory (ST-LSTM) model which naturally combines spatial-temporal influence into LSTM to mitigate the problem of data sparsity. Further, we employ a hierarchical extension of the proposed ST-LSTM (HST-LSTM) in an encoder-decoder manner which models the contextual historic visit information in order to boost the prediction performance. The proposed HST-LSTM is evaluated on a real world trajectory data set and the experimental results demonstrate the effectiveness of the proposed model.

Sign in / Sign up

Export Citation Format

Share Document