Simple addition to back-propagation learning for dynamic weight pruning, sparse network extraction and faster learning

Author(s):  
M. Heywood ◽  
P. Noakes
2011 ◽  
Vol 70 (1) ◽  
pp. 35-39 ◽  
Author(s):  
Muriel Fanget ◽  
Catherine Thevenot ◽  
Caroline Castel ◽  
Michel Fayol

In this study, we used a paradigm recently developed ( Thevenot, Fanget, & Fayol, 2007 ) to determine whether 10-year-old children solve simple addition problems by retrieval of the answer from long-term memory or by calculation procedures. Our paradigm is unique in that it does not rely on reaction times or verbal reports, which are known to potentially bias the results, especially in children. Rather, it takes advantage of the fact that calculation procedures degrade the memory traces of the operands, so that it is more difficult to recognize them when they have been involved in the solution of an addition problem by calculation rather than by retrieval. The present study sharpens the current conclusions in the literature and shows that, when the sum of addition problems is up to 10, children mainly use retrieval, but when it is greater than 10, they mainly use calculation procedures.


1990 ◽  
Vol 29 (03) ◽  
pp. 167-181 ◽  
Author(s):  
G. Hripcsak

AbstractA connectionist model for decision support was constructed out of several back-propagation modules. Manifestations serve as input to the model; they may be real-valued, and the confidence in their measurement may be specified. The model produces as its output the posterior probability of disease. The model was trained on 1,000 cases taken from a simulated underlying population with three conditionally independent manifestations. The first manifestation had a linear relationship between value and posterior probability of disease, the second had a stepped relationship, and the third was normally distributed. An independent test set of 30,000 cases showed that the model was better able to estimate the posterior probability of disease (the standard deviation of residuals was 0.046, with a 95% confidence interval of 0.046-0.047) than a model constructed using logistic regression (with a standard deviation of residuals of 0.062, with a 95% confidence interval of 0.062-0.063). The model fitted the normal and stepped manifestations better than the linear one. It accommodated intermediate levels of confidence well.


2020 ◽  
Vol 39 (5) ◽  
pp. 6419-6430
Author(s):  
Dusan Marcek

To forecast time series data, two methodological frameworks of statistical and computational intelligence modelling are considered. The statistical methodological approach is based on the theory of invertible ARIMA (Auto-Regressive Integrated Moving Average) models with Maximum Likelihood (ML) estimating method. As a competitive tool to statistical forecasting models, we use the popular classic neural network (NN) of perceptron type. To train NN, the Back-Propagation (BP) algorithm and heuristics like genetic and micro-genetic algorithm (GA and MGA) are implemented on the large data set. A comparative analysis of selected learning methods is performed and evaluated. From performed experiments we find that the optimal population size will likely be 20 with the lowest training time from all NN trained by the evolutionary algorithms, while the prediction accuracy level is lesser, but still acceptable by managers.


2020 ◽  
Vol 39 (6) ◽  
pp. 8823-8830
Author(s):  
Jiafeng Li ◽  
Hui Hu ◽  
Xiang Li ◽  
Qian Jin ◽  
Tianhao Huang

Under the influence of COVID-19, the economic benefits of shale gas development are greatly affected. With the large-scale development and utilization of shale gas in China, it is increasingly important to assess the economic impact of shale gas development. Therefore, this paper proposes a method for predicting the production of shale gas reservoirs, and uses back propagation (BP) neural network to nonlinearly fit reservoir reconstruction data to obtain shale gas well production forecasting models. Experiments show that compared with the traditional BP neural network, the proposed method can effectively improve the accuracy and stability of the prediction. There is a nonlinear correlation between reservoir reconstruction data and gas well production, which does not apply to traditional linear prediction methods


2018 ◽  
pp. 143-149 ◽  
Author(s):  
Ruijie CHENG

In order to further improve the energy efficiency of classroom lighting, a classroom lighting energy saving control system based on machine vision technology is proposed. Firstly, according to the characteristics of machine vision design technology, a quantum image storage model algorithm is proposed, and the Back Propagation neural network algorithm is used to analyze the technology, and a multi­feedback model for energy­saving control of classroom lighting is constructed. Finally, the algorithm and lighting model are simulated. The test results show that the design of this paper can achieve the optimization of the classroom lighting control system, different number of signals can comprehensively control the light and dark degree of the classroom lights, reduce the waste of resources of classroom lighting, and achieve the purpose of energy saving and emission reduction. Technology is worth further popularizing in practice.


2014 ◽  
Author(s):  
Quanshu Zeng ◽  
Zhiming Wang ◽  
Xiaoqiu Wang ◽  
Yiwei Li ◽  
Weilin Zou ◽  
...  

Sign in / Sign up

Export Citation Format

Share Document