scholarly journals Incoming Work-In-Progress Prediction in Semiconductor Fabrication Foundry Using Long Short-Term Memory

2019 ◽  
Vol 2019 ◽  
pp. 1-16
Author(s):  
Tze Chiang Tin ◽  
Kang Leng Chiew ◽  
Siew Chee Phang ◽  
San Nah Sze ◽  
Pei San Tan
Keyword(s):  
Preventive Maintenance ◽  
Short Term Memory ◽  
Operational Reliability ◽  
Statistical Forecasting ◽  
Work In Progress ◽  
Dependent Behavior ◽  
Proposed Model ◽  
Forecasting Method ◽  
Semiconductor Fabrication ◽  
Maintenance Activities

Preventive maintenance activities require a tool to be offline for long hour in order to perform the prescribed maintenance activities. Although preventive maintenance is crucial to ensure operational reliability and efficiency of the tool, long hour of preventive maintenance activities increases the cycle time of the semiconductor fabrication foundry (Fab). Therefore, this activity is usually performed when the incoming Work-in-Progress to the equipment is forecasted to be low. The current statistical forecasting approach has low accuracy because it lacks the ability to capture the time-dependent behavior of the Work-in-Progress. In this paper, we present a forecasting model that utilizes machine learning method to forecast the incoming Work-In-Progress. Specifically, our proposed model uses LSTM to forecast multistep ahead incoming Work-in-Progress prediction to an equipment group. The proposed model's prediction results were compared with the results of the current statistical forecasting method of the Fab. The experimental results demonstrated that the proposed model performed better than the statistical forecasting method in both hit rate and Pearson’s correlation coefficient, r.

scholarly journals Direct Multistep Wind Speed Forecasting Using LSTM Neural Network Combining EEMD and Fuzzy Entropy

2019 ◽  
Vol 9 (1) ◽  
pp. 126 ◽  
Author(s):  
Qiong Qin ◽  
Xu Lai ◽  
Jin Zou
Keyword(s):  
Neural Network ◽  
Wind Speed ◽  
Generation System ◽  
Forecasting Accuracy ◽  
Statistical Forecasting ◽  
Wind Speed Forecasting ◽  
Proposed Model ◽  
Forecasting Method ◽  
Svm Model ◽  
Power Generation System

Accurate wind speed forecasting is of great significance for a reliable and secure power generation system. In order to improve forecasting accuracy, this paper introduces the LSTM neural network and proposes a wind speed statistical forecasting method based on the EEMD-FuzzyEn-LSTMNN model. Moreover, the MIC is used to analyze the autocorrelation of wind speed series, and the predictable time of wind speed statistical forecasting method for direct multistep forecasting is taken as four hours. In the EEMD-FuzzyEn-LSTMNN model, the original wind speed series is firstly decomposed into a series of components by using EEMD. Then, the FuzzyEn is used to calculate the complexity of each component, and the components with similar FuzzyEn values are classified into one group. Finally, the LSTMNN model is used to forecast each subsequence after classification. The forecasting result of the original wind speed series is obtained by aggregating the forecasting result of each subsequence. Three forecasting cases under different terrain conditions were selected to validate the proposed model, and the BPNN model, the SVM model and the LSTMNN model were used for comparison. The experimental results show that the forecasting accuracy of the EEMD-FuzzyEn-LSTMNN model is much higher than that of the other three models.

Human Activity Recognition using Fourier Transform Inspired Deep Learning Combination Model

2019 ◽  
Vol 9 (1) ◽  
pp. 16-31
Author(s):  
Kyungkoo Jun
Keyword(s):  
Fourier Transform ◽  
Deep Learning ◽  
Short Term Memory ◽  
Window Size ◽  
Sensor Data ◽  
Data Sets ◽  
Data Set ◽  
Proposed Model ◽  
Testing Data ◽  
Labeling Scheme

Background & Objective: This paper proposes a Fourier transform inspired method to classify human activities from time series sensor data. Methods: Our method begins by decomposing 1D input signal into 2D patterns, which is motivated by the Fourier conversion. The decomposition is helped by Long Short-Term Memory (LSTM) which captures the temporal dependency from the signal and then produces encoded sequences. The sequences, once arranged into the 2D array, can represent the fingerprints of the signals. The benefit of such transformation is that we can exploit the recent advances of the deep learning models for the image classification such as Convolutional Neural Network (CNN). Results: The proposed model, as a result, is the combination of LSTM and CNN. We evaluate the model over two data sets. For the first data set, which is more standardized than the other, our model outperforms previous works or at least equal. In the case of the second data set, we devise the schemes to generate training and testing data by changing the parameters of the window size, the sliding size, and the labeling scheme. Conclusion: The evaluation results show that the accuracy is over 95% for some cases. We also analyze the effect of the parameters on the performance.

Adaptive particle swarm optimization algorithm based long short-term memory networks for sentiment analysis

2021 ◽  
pp. 1-17
Author(s):  
J. Shobana ◽  
M. Murali
Keyword(s):  
Particle Swarm Optimization ◽  
Sentiment Analysis ◽  
Language Processing ◽  
Short Term Memory ◽  
Contextual Information ◽  
Particle Swarm ◽  
Pso Algorithm ◽  
Swarm Optimization ◽  
Adaptive Particle Swarm Optimization ◽  
Proposed Model

Text Sentiment analysis is the process of predicting whether a segment of text has opinionated or objective content and analyzing the polarity of the text’s sentiment. Understanding the needs and behavior of the target customer plays a vital role in the success of the business so the sentiment analysis process would help the marketer to improve the quality of the product as well as a shopper to buy the correct product. Due to its automatic learning capability, deep learning is the current research interest in Natural language processing. Skip-gram architecture is used in the proposed model for better extraction of the semantic relationships as well as contextual information of words. However, the main contribution of this work is Adaptive Particle Swarm Optimization (APSO) algorithm based LSTM for sentiment analysis. LSTM is used in the proposed model for understanding complex patterns in textual data. To improve the performance of the LSTM, weight parameters are enhanced by presenting the Adaptive PSO algorithm. Opposition based learning (OBL) method combined with PSO algorithm becomes the Adaptive Particle Swarm Optimization (APSO) classifier which assists LSTM in selecting optimal weight for the environment in less number of iterations. So APSO - LSTM ‘s ability in adjusting the attributes such as optimal weights and learning rates combined with the good hyper parameter choices leads to improved accuracy and reduces losses. Extensive experiments were conducted on four datasets proved that our proposed APSO-LSTM model secured higher accuracy over the classical methods such as traditional LSTM, ANN, and SVM. According to simulation results, the proposed model is outperforming other existing models.

scholarly journals Load Forecasting Based on LSTM Neural Network and Applicable to Loads of “Replacement of Coal with Electricity”

2021 ◽  
Author(s):  
Zexi Chen ◽  
Delong Zhang ◽  
Haoran Jiang ◽  
Longze Wang ◽  
Yongcong Chen ◽  
...  
Keyword(s):  
Power Systems ◽  
Short Term Memory ◽  
Load Capacity ◽  
Load Forecasting ◽  
Forecasting Method ◽  
Adequate Accuracy ◽  
Model Time Series ◽  
Power System Faults ◽  
Long Short Term Memory ◽  
Electric Loads

AbstractWith the complete implementation of the “Replacement of Coal with Electricity” policy, electric loads borne by urban power systems have achieved explosive growth. The traditional load forecasting method based on “similar days” only applies to the power systems with stable load levels and fails to show adequate accuracy. Therefore, a novel load forecasting approach based on long short-term memory (LSTM) was proposed in this paper. The structure of LSTM and the procedure are introduced firstly. The following factors have been fully considered in this model: time-series characteristics of electric loads; weather, temperature, and wind force. In addition, an experimental verification was performed for “Replacement of Coal with Electricity” data. The accuracy of load forecasting was elevated from 83.2 to 95%. The results indicate that the model promptly and accurately reveals the load capacity of grid power systems in the real application, which has proved instrumental to early warning and emergency management of power system faults.

scholarly journals Air pollution forecasting application based on deep learning model and optimization algorithm

2021 ◽  
Author(s):  
Azim Heydari ◽  
Meysam Majidi Nezhad ◽  
Davide Astiaso Garcia ◽  
Farshid Keynia ◽  
Livio De Santoli
Keyword(s):  
Air Pollution ◽  
Wind Speed ◽  
Power Plant ◽  
Air Temperature ◽  
Short Term Memory ◽  
Combined Cycle ◽  
Short Term ◽  
Term Memory ◽  
Proposed Model ◽  
Long Short Term Memory

AbstractAir pollution monitoring is constantly increasing, giving more and more attention to its consequences on human health. Since Nitrogen dioxide (NO2) and sulfur dioxide (SO2) are the major pollutants, various models have been developed on predicting their potential damages. Nevertheless, providing precise predictions is almost impossible. In this study, a new hybrid intelligent model based on long short-term memory (LSTM) and multi-verse optimization algorithm (MVO) has been developed to predict and analysis the air pollution obtained from Combined Cycle Power Plants. In the proposed model, long short-term memory model is a forecaster engine to predict the amount of produced NO2 and SO2 by the Combined Cycle Power Plant, where the MVO algorithm is used to optimize the LSTM parameters in order to achieve a lower forecasting error. In addition, in order to evaluate the proposed model performance, the model has been applied using real data from a Combined Cycle Power Plant in Kerman, Iran. The datasets include wind speed, air temperature, NO2, and SO2 for five months (May–September 2019) with a time step of 3-h. In addition, the model has been tested based on two different types of input parameters: type (1) includes wind speed, air temperature, and different lagged values of the output variables (NO2 and SO2); type (2) includes just lagged values of the output variables (NO2 and SO2). The obtained results show that the proposed model has higher accuracy than other combined forecasting benchmark models (ENN-PSO, ENN-MVO, and LSTM-PSO) considering different network input variables. Graphic abstract

Sentence similarity evaluation using Sent2Vec and siamese neural network with parallel structure

2021 ◽  
pp. 1-10
Author(s):  
Hye-Jeong Song ◽  
Tak-Sung Heo ◽  
Jong-Dae Kim ◽  
Chan-Young Park ◽  
Yu-Seop Kim
Keyword(s):  
Neural Network ◽  
Language Processing ◽  
Short Term Memory ◽  
Parallel Structure ◽  
Short Term ◽  
Similarity Estimation ◽  
Accurate Judgment ◽  
Proposed Model ◽  
Sentence Similarity ◽  
Long Short Term Memory

Sentence similarity evaluation is a significant task used in machine translation, classification, and information extraction in the field of natural language processing. When two sentences are given, an accurate judgment should be made whether the meaning of the sentences is equivalent even if the words and contexts of the sentences are different. To this end, existing studies have measured the similarity of sentences by focusing on the analysis of words, morphemes, and letters. To measure sentence similarity, this study uses Sent2Vec, a sentence embedding, as well as morpheme word embedding. Vectors representing words are input to the 1-dimension convolutional neural network (1D-CNN) with various sizes of kernels and bidirectional long short-term memory (Bi-LSTM). Self-attention is applied to the features transformed through Bi-LSTM. Subsequently, vectors undergoing 1D-CNN and self-attention are converted through global max pooling and global average pooling to extract specific values, respectively. The vectors generated through the above process are concatenated to the vector generated through Sent2Vec and are represented as a single vector. The vector is input to softmax layer, and finally, the similarity between the two sentences is determined. The proposed model can improve the accuracy by up to 5.42% point compared with the conventional sentence similarity estimation models.

An Intelligent Approach to Detect Fake News Using Artificial Intelligence Technique

2021 ◽  
Vol 13 (2) ◽  
pp. 1-12
Author(s):  
Sumit Das ◽  
Manas Kumar Sanyal ◽  
Sarbajyoti Mallik
Keyword(s):  
Artificial Intelligence ◽  
Web Application ◽  
Short Term Memory ◽  
Real Data ◽  
Fake News ◽  
Artificial Intelligence Technique ◽  
News Reports ◽  
Proposed Model ◽  
Long Short Term Memory ◽  
Intelligent Approach

There is a lot of fake news roaming around various mediums, which misleads people. It is a big issue in this advanced intelligent era, and there is a need to find some solution to this kind of situation. This article proposes an approach that analyzes fake and real news. This analysis is focused on sentiment, significance, and novelty, which are a few characteristics of this news. The ability to manipulate daily information mathematically and statistically is allowed by expressing news reports as numbers and metadata. The objective of this article is to analyze and filter out the fake news that makes trouble. The proposed model is amalgamated with the web application; users can get real data and fake data by using this application. The authors have used the AI (artificial intelligence) algorithms, specifically logistic regression and LSTM (long short-term memory), so that the application works well. The results of the proposed model are compared with existing models.

Preventive maintenance optimization for repairable products considering two-dimensional warranty and customer satisfaction

2018 ◽  
Vol 233 (4) ◽  
pp. 553-566
Author(s):  
Yukun Wang ◽  
Yiliu Liu ◽  
Aibo Zhang
Keyword(s):  
Customer Satisfaction ◽  
Preventive Maintenance ◽  
Product Performance ◽  
Maintenance Optimization ◽  
Two Dimensional ◽  
Maintenance Strategy ◽  
Minimal Repair ◽  
Proposed Model ◽  
Useful Life ◽  
Practical Implications

Customer satisfaction with a purchased product is closely related to the product performance within the warranty region and even the performance during the remainder of its useful life. Every satisfied customer may boost the future sales of the same product with positive evaluations and recommendations to others, and thus will create more profits for the manufacturer. During the useful life of the product, the expected cost to the manufacturer normally depends on the warranty policy, product reliability and specific servicing strategies implemented. In this article, considering the effect of customer satisfaction on the manufacturer’s incurred cost, we investigate a periodic and imperfect preventive maintenance strategy for repairable products sold with a two-dimensional warranty policy. The customer satisfaction is measured with the probability of the customer making a repeat purchase from the same manufacturer. In the proposed model, the number of preventive maintenance actions and corresponding maintenance level are jointly derived with the objective of minimizing the expected total cost per product to the manufacturer. The performance of the proposed preventive maintenance strategy is compared with that of minimal repair corrective maintenance strategy in a numerical example, so as to illustrate its applicability. In addition, some practical implications from a detailed sensitivity analysis are elaborated.

Sign in / Sign up

Export Citation Format

Share Document