scholarly journals A Neural Network Approach towards Generalized Resistive Switching Modelling

Micromachines ◽  
2021 ◽  
Vol 12 (9) ◽  
pp. 1132
Author(s):  
Guilherme Carvalho ◽  
Maria Pereira ◽  
Asal Kiazadeh ◽  
Vítor Grade Tavares
Keyword(s):  
Neural Network ◽  
Resistive Switching ◽  
Network Performance ◽  
Mean Squared Error ◽  
Model Complexity ◽  
Neural Network Approach ◽  
Research Teams ◽  
Neural Network Learning ◽  
Squared Error ◽  
Model Update

Resistive switching behaviour has been demonstrated to be a common characteristic to many materials. In this regard, research teams to date have produced a plethora of different devices exhibiting diverse behaviour, but when system design is considered, finding a ‘one-model-fits-all’ solution can be quite difficult, or even impossible. However, it is in the interest of the community to achieve more general modelling tools for design that allows a quick model update as devices evolve. Laying the grounds with such a principle, this paper presents an artificial neural network learning approach to resistive switching modelling. The efficacy of the method is demonstrated firstly with two simulated devices and secondly with a 4 μm2 amorphous IGZO device. For the amorphous IGZO device, a normalized root-mean-squared error (NRMSE) of 5.66 × 10−3 is achieved with a [2, 50,50 ,1] network structure, representing a good balance between model complexity and accuracy. A brief study on the number of hidden layers and neurons and its effect on network performance is also conducted with the best NRMSE reported at 4.63 × 10−3. The low error rate achieved in both simulated and real-world devices is a good indicator that the presented approach is flexible and can suit multiple device types.

scholarly journals RANDOM NEURAL NETWORK LEARNING HEURISTICS

2017 ◽  
Vol 31 (4) ◽  
pp. 436-456 ◽  
Author(s):  
Abbas Javed ◽  
Hadi Larijani ◽  
Ali Ahmadinia ◽  
Rohinton Emmanuel
Keyword(s):  
Neural Network ◽  
Mean Squared Error ◽  
Training Algorithms ◽  
Local Minima ◽  
Neural Network Learning ◽  
Bee Colony ◽  
Squared Error ◽  
Random Neural Network ◽  
Evolution Algorithms ◽  
Learning Heuristics

The random neural network (RNN) is a probabilitsic queueing theory-based model for artificial neural networks, and it requires the use of optimization algorithms for training. Commonly used gradient descent learning algorithms may reside in local minima, evolutionary algorithms can be also used to avoid local minima. Other techniques such as artificial bee colony (ABC), particle swarm optimization (PSO), and differential evolution algorithms also perform well in finding the global minimum but they converge slowly. The sequential quadratic programming (SQP) optimization algorithm can find the optimum neural network weights, but can also get stuck in local minima. We propose to overcome the shortcomings of these various approaches by using hybridized ABC/PSO and SQP. The resulting algorithm is shown to compare favorably with other known techniques for training the RNN. The results show that hybrid ABC learning with SQP outperforms other training algorithms in terms of mean-squared error and normalized root-mean-squared error.

scholarly journals Prediksi Indeks Harga Saham Gabungan (IHSG) Menggunakan Algoritma Neural Network

2018 ◽  
Vol 4 (1) ◽  
pp. 24
Author(s):  
Imam Halimi ◽  
Wahyu Andhyka Kusuma
Keyword(s):  
Neural Network ◽  
Data Mining ◽  
Linear Regression ◽  
Mean Squared Error ◽  
Composite Index ◽  
T Test ◽  
Sliding Windows ◽  
Root Mean Squared Error ◽  
Squared Error

Investasi saham merupakan hal yang tidak asing didengar maupun dilakukan. Ada berbagai macam saham di Indonesia, salah satunya adalah Indeks Harga Saham Gabungan (IHSG) atau dalam bahasa inggris disebut Indonesia Composite Index, ICI, atau IDX Composite. IHSG merupakan parameter penting yang dipertimbangkan pada saat akan melakukan investasi mengingat IHSG adalah saham gabungan. Penelitian ini bertujuan memprediksi pergerakan IHSG dengan teknik data mining menggunakan algoritma neural network dan dibandingkan dengan algoritma linear regression, yang dapat dijadikan acuan investor saat akan melakukan investasi. Hasil dari penelitian ini berupa nilai Root Mean Squared Error (RMSE) serta label tambahan angka hasil prediksi yang didapatkan setelah dilakukan validasi menggunakan sliding windows validation dengan hasil paling baik yaitu pada pengujian yang menggunakan algoritma neural network yang menggunakan windowing yaitu sebesar 37,786 dan pada pengujian yang tidak menggunakan windowing sebesar 13,597 dan untuk pengujian algoritma linear regression yang menggunakan windowing yaitu sebesar 35,026 dan pengujian yang tidak menggunakan windowing sebesar 12,657. Setelah dilakukan pengujian T-Test menunjukan bahwa pengujian menggunakan neural network yang dibandingkan dengan linear regression memiliki hasil yang tidak signifikan dengan nilai T-Test untuk pengujian dengan windowing dan tanpa windowing hasilnya sama, yaitu sebesar 1,000.

scholarly journals Forecasting Wind Power Generation Using Artificial Neural Network: “Pawan Danawi”—A Case Study from Sri Lanka

2021 ◽  
Vol 2021 ◽  
pp. 1-10
Author(s):  
Amila T. Peiris ◽  
Jeevani Jayasinghe ◽  
Upaka Rathnayake
Keyword(s):  
Neural Network ◽  
Power Generation ◽  
Wind Power ◽  
Wind Farm ◽  
Mean Squared Error ◽  
Wind Power Generation ◽  
Training Algorithms ◽  
Training Algorithm ◽  
Squared Error ◽  
Ann Models

Wind power, as a renewable energy resource, has taken much attention of the energy authorities in many countries, as it is used as one of the major energy sources to satisfy the ever-increasing energy demand. However, careful attention is needed in identifying the wind power potential in a particular area due to climate changes. In this sense, forecasting both wind power generation and wind power potential is essential. This paper develops artificial neural network (ANN) models to forecast wind power generation in “Pawan Danawi”, a functioning wind farm in Sri Lanka. Wind speed, wind direction, and ambient temperature of the area were used as the independent variable matrices of the developed ANN models, while the generated wind power was used as the dependent variable. The models were tested with three training algorithms, namely, Levenberg-Marquardt (LM), Scaled Conjugate Gradient (SCG), and Bayesian Regularization (BR) training algorithms. In addition, the model was calibrated for five validation percentages (5% to 25% in 5% intervals) under each algorithm to identify the best training algorithm with the most suitable training and validation percentages. Mean squared error (MSE), coefficient of correlation (R), root mean squared error ratio (RSR), Nash number, and BIAS were used to evaluate the performance of the developed ANN models. Results revealed that all three training algorithms produce acceptable predictions for the power generation in the Pawan Danawi wind farm with R > 0.91, MSE < 0.22, and BIAS < 1. Among them, the LM training algorithm at 70% of training and 5% of validation percentages produces the best forecasting results. The developed models can be effectively used in the prediction of wind power at the Pawan Danawi wind farm. In addition, the models can be used with the projected climatic scenarios in predicting the future wind power harvest. Furthermore, the models can acceptably be used in similar environmental and climatic conditions to identify the wind power potential of the area.

Identification of Complex System Based on Neural Network

2012 ◽  
Vol 433-440 ◽  
pp. 4342-4347
Author(s):  
Zhen Hai Dou ◽  
Ya Jing Wang
Keyword(s):  
Neural Network ◽  
Complex System ◽  
Mean Squared Error ◽  
Model Identification ◽  
Complex Model ◽  
System Model ◽  
Mathematics Model ◽  
Identification Method ◽  
Squared Error ◽  
Actual Output

In order to conquer the difficulty of building up the mathematics model of some complex system, model identification method based on neural network is put forward. By this method, according to actual sample datum, the complex model of crude oil heating furnace is identified at appropriate quantity of net layers and notes. The identification results show that output of model can basically consistent with the actual output and their mean squared error (MSE) almost is 0. Therefore, model identification method based on neural network is an effective method in complex system identification.

scholarly journals The method of array antenna constructive synthesis on the basis of neural network approach

2019 ◽  
Vol 30 ◽  
pp. 05001
Author(s):  
Sergey Mishchenko ◽  
Vitaliy Shatskiy ◽  
Alexey Litvinov ◽  
Denis Eliseev
Keyword(s):  
Neural Network ◽  
Active Element ◽  
Back Propagation ◽  
Array Antenna ◽  
Antenna Element ◽  
Network Approach ◽  
Passive Element ◽  
Neural Network Approach ◽  
Neural Network Learning ◽  
Error Back Propagation

The method to decision constructive synthesis of array antennas was conducted. The method usefull when antenna elements can be in discreste states (for example: active element, passive element, excluded item, active element with discrete nominal of output power e.t.c). The method is based on neural network approach. The structure of a neural network consist of a classifying neural network and several approximating neural networks is substantiated. Input signals correspond to phase centers of array antenna elements. Number of output signals in classifying part is equal to discrete status of antenna element. Each approximating part of network has one output signal wich correspond to continious meaning. Separate parts of network preliminary learning with error back propagation method. The genetic algorithm of neural network learning with limited number of training coefficients is proposed. Examples of solving problems of constructive synthesis, with different indicators of the quality of neural network training are given.

scholarly journals Novel FTLRNN with Gamma Memory for Short-Term and Long-Term Predictions of Chaotic Time Series

2009 ◽  
Vol 2009 ◽  
pp. 1-21
Author(s):  
Sanjay L. Badjate ◽  
Sanjay V. Dudul
Keyword(s):  
Neural Network ◽  
Time Series ◽  
Mean Squared Error ◽  
Chaotic Time Series ◽  
Nonstationary Time Series ◽  
Medium Term ◽  
Short Term ◽  
Squared Error ◽  
Wide Range

Multistep ahead prediction of a chaotic time series is a difficult task that has attracted increasing interest in the recent years. The interest in this work is the development of nonlinear neural network models for the purpose of building multistep chaotic time series prediction. In the literature there is a wide range of different approaches but their success depends on the predicting performance of the individual methods. Also the most popular neural models are based on the statistical and traditional feed forward neural networks. But it is seen that this kind of neural model may present some disadvantages when long-term prediction is required. In this paper focused time-lagged recurrent neural network (FTLRNN) model with gamma memory is developed for different prediction horizons. It is observed that this predictor performs remarkably well for short-term predictions as well as medium-term predictions. For coupled partial differential equations generated chaotic time series such as Mackey Glass and Duffing, FTLRNN-based predictor performs consistently well for different depths of predictions ranging from short term to long term, with only slight deterioration after k is increased beyond 50. For real-world highly complex and nonstationary time series like Sunspots and Laser, though the proposed predictor does perform reasonably for short term and medium-term predictions, its prediction ability drops for long term ahead prediction. However, still this is the best possible prediction results considering the facts that these are nonstationary time series. As a matter of fact, no other NN configuration can match the performance of FTLRNN model. The authors experimented the performance of this FTLRNN model on predicting the dynamic behavior of typical Chaotic Mackey-Glass time series, Duffing time series, and two real-time chaotic time series such as monthly sunspots and laser. Static multi layer perceptron (MLP) model is also attempted and compared against the proposed model on the performance measures like mean squared error (MSE), Normalized mean squared error (NMSE), and Correlation Coefficient (r). The standard back-propagation algorithm with momentum term has been used for both the models.

scholarly journals Ensemble Neural Network Approach for Accurate Load Forecasting in a Power System

2009 ◽  
Vol 19 (2) ◽  
pp. 303-315 ◽  
Author(s):  
Krzysztof Siwek ◽  
Stanisław Osowski ◽  
Ryszard Szupiluk
Keyword(s):  
Neural Network ◽  
Power System ◽  
Mean Squared Error ◽  
Load Forecasting ◽  
Weighted Averaging ◽  
Percentage Error ◽  
Network Approach ◽  
Three Solutions ◽  
Neural Network Approach ◽  
Ensemble Neural Network

Ensemble Neural Network Approach for Accurate Load Forecasting in a Power SystemThe paper presents an improved method for 1-24 hours load forecasting in the power system, integrating and combining different neural forecasting results by an ensemble system. We will integrate the results of partial predictions made by three solutions, out of which one relies on a multilayer perceptron and two others on self-organizing networks of the competitive type. As the expert system we will apply different integration methods: simple averaging, SVD based weighted averaging, principal component analysis and blind source separation. The results of numerical experiments, concerning forecasting the hourly load for the next 24 hours of the Polish power system, will be presented and discussed. We will compare the performance of different ensemble methods on the basis of the mean absolute percentage error, mean squared error and maximum percentage error. They show a significant improvement of the proposed ensemble method in comparison to the individual results of prediction. The comparison of our work with the results of other papers for the same data proves the superiority of our approach.

Application of Artificial Neural Network Over Nickel-Based Catalyst for Combined Steam-Carbon Dioxide of Methane Reforming (CSDRM)

2020 ◽  
Vol 20 (9) ◽  
pp. 5716-5719 ◽  
Author(s):  
Cho Hwe Kim ◽  
Young Chul Kim
Keyword(s):  
Neural Network ◽  
Carbon Dioxide ◽  
Artificial Neural Network ◽  
Mean Squared Error ◽  
Coefficient Of Determination ◽  
Feed Ratio ◽  
Squared Error ◽  
Highly Nonlinear ◽  
Feed Forward Network ◽  
Artificial Neural

The application of artificial neural network (ANN) for modeling, combined steam-carbon dioxide reforming of methane over nickel-based catalysts, was investigated. The artificial neural network model consisted of a 3-layer feed forward network, with hyperbolic tangent function. The number of hidden neurons is optimized by minimization of mean square error and maximization of R2 (R square, coefficient of determination) and set of 8 neurons. With feed ratio, flow rate, and temperature as independent variables, methane, carbon dioxide conversion, and H2/CO ratio, were measured using artificial neural network. Coefficient of determination (R2) values of 0.9997, 0.9962, and 0.9985 obtained, and MAE (Mean Absolute Error), MSE (Mean Squared Error), RMSE (Root Mean Squared Error), and MAPE (Mean Absolute Percentage Error) showed low value. This study indicates ANN can successfully model a highly nonlinear process and function.

Using BPNN to Predict Number of Low-Income Households in Taiwan Based on Seasonally Adjusted Annualized Rates for Real GDP

2014 ◽  
Vol 1044-1045 ◽  
pp. 1824-1827
Author(s):  
Yi Ti Tung ◽  
Tzu Yi Pai
Keyword(s):  
Neural Network ◽  
Low Income ◽  
Mean Squared Error ◽  
Back Propagation ◽  
Back Propagation Neural Network ◽  
Percentage Error ◽  
Real Gdp ◽  
Squared Error ◽  
Input Variables ◽  
Low Income Households

In this study, the back-propagation neural network (BPNN) was used to predict the number of low-income households (NLIH) in Taiwan, taking the seasonally adjusted annualized rates (SAAR) for real gross domestic product (GDP) as input variables. The results indicated that the lowest mean absolute percentage error (MAPE), mean squared error (MSE), root mean squared error (RMSE), and highest correlation coefficient (R) for training and testing were 4.759 % versus 19.343 %, 24429972.268 versus 781839890.859, 4942.669 versus 27961.400, and 0.945 versus 0.838, respectively.

Sign in / Sign up

Export Citation Format

Share Document