Architectural Features of Neural Network Forecasting Software Systems with Continuous Training

2020 ◽  
Vol 26 (11) ◽  
pp. 621-647
Author(s):  
D. I. Miloserdov ◽  

In recent years, a method of neural network event forecasting has been developed, based on the use of a pair of recurrent neural networks with controlled elements. This method allows you to make predictions without interrupting training. However, for its full use, a reasonable software implementation is necessary. This study considers the problem of searching for a software architecture that implements the method of neural network forecasting with continuous learning. Offers an improved prediction method that significantly reduces the required amount of memory. A procedure for accelerated calculation of the weights of neural network synapses has been developed. To assess the effectiveness of the proposed architectural solutions, a comparative analysis of various variants of software implementations was conducted. In systems developed with the proposed innovations, the requirements for memory and computing resources are much lower than in software implementations of the prototype method. For example, the amount of memory required has decreased by an average of 15 times, and system initialization has taken 16 times less time. At the same time, the strategy of maximum memory saving in such systems proved to be unproductive compared to the combined approach. Based on the obtained comparison results, recommendations are given for the use and choice of architectures depending on the specific tasks facing the end user, and the hardware and software environment in which the forecasting systems are supposed to operate.

Author(s):  
A. Syahputra

Surveillance is very important in managing a steamflood project. On the current surveillance plan, Temperature and steam ID logs are acquired on observation wells at least every year while CO log (oil saturation log or SO log) every 3 years. Based on those surveillance logs, a dynamic full field reservoir model is updated quarterly. Typically, a high depletion rate happens in a new steamflood area as a function of drainage activities and steamflood injection. Due to different acquisition time, there is a possibility of misalignment or information gaps between remaining oil maps (ie: net pay, average oil saturation or hydrocarbon pore thickness map) with steam chest map, for example a case of high remaining oil on high steam saturation interval. The methodology that is used to predict oil saturation log is neural network. In this neural network method, open hole observation wells logs (static reservoir log) such as vshale, porosity, water saturation effective, and pay non pay interval), dynamic reservoir logs as temperature, steam saturation, oil saturation, and acquisition time are used as input. A study case of a new steamflood area with 16 patterns of single reservoir target used 6 active observation wells and 15 complete logs sets (temperature, steam ID, and CO log), 19 incomplete logs sets (only temperature and steam ID) since 2014 to 2019. Those data were divided as follows ~80% of completed log set data for neural network training model and ~20% of completed log set data for testing the model. As the result of neural model testing, R2 is score 0.86 with RMS 5% oil saturation. In this testing step, oil saturation log prediction is compared to actual data. Only minor data that shows different oil saturation value and overall shape of oil saturation logs are match. This neural network model is then used for oil saturation log prediction in 19 incomplete log set. The oil saturation log prediction method can fill the gap of data to better describe the depletion process in a new steamflood area. This method also helps to align steam map and remaining oil to support reservoir management in a steamflood project.


2019 ◽  
Author(s):  
CHIEN WEI ◽  
Chi Chow Julie ◽  
Chou Willy

UNSTRUCTURED Backgrounds: Dengue fever (DF) is an important public health issue in Asia. However, the disease is extremely hard to detect using traditional dichotomous (i.e., absent vs. present) evaluations of symptoms. Convolution neural network (CNN), a well-established deep learning method, can improve prediction accuracy on account of its usage of a large number of parameters for modeling. Whether the HT person fit statistic can be combined with CNN to increase the prediction accuracy of the model and develop an application (APP) to detect DF in children remains unknown. Objectives: The aim of this study is to build a model for the automatic detection and classification of DF with symptoms to help patients, family members, and clinicians identify the disease at an early stage. Methods: We extracted 19 feature variables of DF-related symptoms from 177 pediatric patients (69 diagnosed with DF) using CNN to predict DF risk. The accuracy of two sets of characteristics (19 symptoms and four other variables, including person mean, standard deviation, and two HT-related statistics matched to DF+ and DF−) for predicting DF, were then compared. Data were separated into training and testing sets, and the former was used to predict the latter. We calculated the sensitivity (Sens), specificity (Spec), and area under the receiver operating characteristic curve (AUC) across studies for comparison. Results: We observed that (1) the 23-item model yields a higher accuracy rate (0.95) and AUC (0.94) than the 19-item model (accuracy = 0.92, AUC = 0.90) based on the 177-case training set; (2) the Sens values are almost higher than the corresponding Spec values (90% in 10 scenarios) for predicting DF; (3) the Sens and Spec values of the 23-item model are consistently higher than those of the 19-item model. An APP was subsequently designed to detect DF in children. Conclusion: The 23-item model yielded higher accuracy rates (0.95) and AUC (0.94) than the 19-item model (accuracy = 0.92, AUC = 0.90). An APP could be developed to help patients, family members, and clinicians discriminate DF from other febrile illnesses at an early stage.


Energies ◽  
2020 ◽  
Vol 13 (5) ◽  
pp. 1094 ◽  
Author(s):  
Lanjun Wan ◽  
Hongyang Li ◽  
Yiwei Chen ◽  
Changyun Li

To effectively predict the rolling bearing fault under different working conditions, a rolling bearing fault prediction method based on quantum particle swarm optimization (QPSO) backpropagation (BP) neural network and Dempster–Shafer evidence theory is proposed. First, the original vibration signals of rolling bearing are decomposed by three-layer wavelet packet, and the eigenvectors of different states of rolling bearing are constructed as input data of BP neural network. Second, the optimal number of hidden-layer nodes of BP neural network is automatically found by the dichotomy method to improve the efficiency of selecting the number of hidden-layer nodes. Third, the initial weights and thresholds of BP neural network are optimized by QPSO algorithm, which can improve the convergence speed and classification accuracy of BP neural network. Finally, the fault classification results of multiple QPSO-BP neural networks are fused by Dempster–Shafer evidence theory, and the final rolling bearing fault prediction model is obtained. The experiments demonstrate that different types of rolling bearing fault can be effectively and efficiently predicted under various working conditions.


2020 ◽  
Vol 8 (10) ◽  
pp. 766
Author(s):  
Dohan Oh ◽  
Julia Race ◽  
Selda Oterkus ◽  
Bonguk Koo

Mechanical damage is recognized as a problem that reduces the performance of oil and gas pipelines and has been the subject of continuous research. The artificial neural network in the spotlight recently is expected to be another solution to solve the problems relating to the pipelines. The deep neural network, which is on the basis of artificial neural network algorithm and is a method amongst various machine learning methods, is applied in this study. The applicability of machine learning techniques such as deep neural network for the prediction of burst pressure has been investigated for dented API 5L X-grade pipelines. To this end, supervised learning is employed, and the deep neural network model has four layers with three hidden layers, and the neural network uses the fully connected layer. The burst pressure computed by deep neural network model has been compared with the results of finite element analysis based parametric study, and the burst pressure calculated by the experimental results. According to the comparison results, it showed good agreement. Therefore, it is concluded that deep neural networks can be another solution for predicting the burst pressure of API 5L X-grade dented pipelines.


Author(s):  
Xinzhe Yin ◽  
Jinghua Li

Many experts and scholars at home and abroad have studied this topic in depth, laying a solid foundation for the research of financial market prediction. At present, the mainstream prediction method is to use neural network and autoregressive conditional heteroscedasticity to build models, which is a more scientific way, and also verified the feasibility of the way in many studies. In order to improve the accuracy of financial market trend prediction, this paper studies in detail the neural network system represented by BP and the autoregressive conditional heterogeneous variance model represented by GARCH. Analyze its structure and algorithm, combine the advantages of both, create a GARCH-BP model, and transform its combination structure and optimize the algorithm according to the uniqueness of the financial market, so as to meet the market as much as possible Characteristics. The novelty of this paper is the construction of the autoregressive conditional heteroscedasticity model, which lays the foundation for the prediction of financial market trends through the construction of the model. However, there are some shortcomings in this article. The overall overview of the financial market is not very clear, and the prediction of the BP network is not so comprehensive. Finally, through the actual data statistics of market transactions, the effectiveness of the GARCH-BP model was tested, analyzed and researched. The final results show that model has a good effect on the prediction and trend analysis of market, and its accuracy and availability greatly improved compared with the previous conventional approach, which is worth further study and extensive research It is believed that the financial market prediction model will become one of the mainstream tools in the industry after its later improvement.


Optik ◽  
2021 ◽  
pp. 167827
Author(s):  
Haolong Jia ◽  
Jing Zuo ◽  
Qiliang Bao ◽  
Chao Geng ◽  
Xinyang Li ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document