Intelligent scheduling using a neural network model in conjunction with reinforcement learning

2005 ◽  
Vol 219 (2) ◽  
pp. 229-235
Author(s):  
C J Fourie
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Reinforcement Learning ◽  
Learning From Experience ◽  
Scheduling System ◽  
Simulated Environment ◽  
The Neural Network ◽  
Learning Techniques ◽  
Proposed Model ◽  
Intelligent Scheduling

This paper describes the use of an artificial neural network in conjunction with reinforcement learning techniques to develop an intelligent scheduling system that is capable of learning from experience. In a simulated environment the model controls a mobile robot that transports material to machines. States of ‘happiness’ are defined for each machine, which are the inputs to the neural network. The output of the neural network is the decision on which machine to service next. After every decision, a critic evaluates the decision and a teacher ‘rewards’ the network to encourage good decisions and discourage bad decisions. From the results obtained, it is concluded that the proposed model is capable of learning from past experience and thereby improving the intelligence of the system.

scholarly journals Analysing 21cm signal with artificial neural network

2017 ◽  
Vol 12 (S333) ◽  
pp. 39-42
Author(s):  
Hayato Shimabukuro ◽  
Benoit Semelin
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Power Spectrum ◽  
Machine Learning Techniques ◽  
Inversion Method ◽  
Observation Data ◽  
The Neural Network ◽  
Learning Techniques ◽  
Artificial Neural ◽  
Artificial Neural Network Ann

AbstractThe 21cm signal at epoch of reionization (EoR) should be observed within next decade. We expect that cosmic 21cm signal at the EoR provides us both cosmological and astrophysical information. In order to extract fruitful information from observation data, we need to develop inversion method. For such a method, we introduce artificial neural network (ANN) which is one of the machine learning techniques. We apply the ANN to inversion problem to constrain astrophysical parameters from 21cm power spectrum. We train the architecture of the neural network with 70 training datasets and apply it to 54 test datasets with different value of parameters. We find that the quality of the parameter reconstruction depends on the sensitivity of the power spectrum to the different parameter sets at a given redshift and also find that the accuracy of reconstruction is improved by increasing the number of given redshifts. We conclude that the ANN is viable inversion method whose main strength is that they require a sparse extrapolation of the parameter space and thus should be usable with full simulation.

scholarly journals Prediction of Motor Failure Time Using An Artificial Neural Network

Sensors ◽  
2019 ◽  
Vol 19 (19) ◽  
pp. 4342 ◽  
Author(s):  
Gustavo Scalabrini Sampaio ◽  
Arnaldo Rabello de Aguiar Vallim Filho ◽  
Leilton Santos da Silva ◽  
Leandro Augusto da Silva
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Failure Time ◽  
Machine Learning Techniques ◽  
Network Training ◽  
Model Generalization ◽  
The Neural Network ◽  
Learning Techniques ◽  
Artificial Neural

Industry is constantly seeking ways to avoid corrective maintenance so as to reduce costs. Performing regular scheduled maintenance can help to mitigate this problem, but not necessarily in the most efficient way. In the context of condition-based maintenance, the main contributions of this work were to propose a methodology to treat and transform the collected data from a vibration system that simulated a motor and to build a dataset to train and test an Artificial Neural Network capable of predicting the future condition of the equipment, pointing out when a failure can happen. To achieve this goal, a device model was built to simulate typical motor vibrations, consisting of a computer cooler fan and several magnets. Measurements were made using an accelerometer, and the data were collected and processed to produce a structured dataset. The neural network training with this dataset converged quickly and stably, while the tests performed, k-fold cross-validation and model generalization, presented excellent performance. The same tests were performed with other machine learning techniques, to demonstrate the effectiveness of neural networks mainly in their generalizability. The results of the work confirm that it is possible to use neural networks to perform predictive tasks in relation to the conditions of industrial equipment. This is an important area of study that helps to support the growth of smart industries.

Development of a New Correlation and Post Processing of Heat Transfer Coefficient and Pressure Drop of Functionalized COOH MWCNT Nanofluid by Artificial Neural Network

2018 ◽  
Vol 14 (2) ◽  
pp. 104-112 ◽  
Author(s):  
Mohammad Hemmat Esfe ◽  
Somchai Wongwises ◽  
Saeed Esfandeh ◽  
Ali Alirezaie
Keyword(s):  
Neural Network ◽  
Heat Transfer ◽  
Thermal Conductivity ◽  
Artificial Neural Network ◽  
Heat Transfer Coefficient ◽  
Pressure Drop ◽  
Transfer Coefficient ◽  
Regression Coefficient ◽  
New Correlation ◽  
The Neural Network

Background: Because of nanofluids applications in improvement of heat transfer rate in heating and cooling systems, many researchers have conducted various experiments to investigate nanofluid's characteristics more accurate. Thermal conductivity, electrical conductivity, and heat transfer are examples of these characteristics. Method: This paper presents a modeling and validation method of heat transfer coefficient and pressure drop of functionalized aqueous COOH MWCNT nanofluids by artificial neural network and proposing a new correlation. In the current experiment, the ANN input data has included the volume fraction and the Reynolds number and heat transfer coefficient and pressure drop considered as ANN outputs. Results: Comparing modeling results with proposed correlation proves that the empirical correlation is not able to accurately predict the experimental output results, and this is performed with a lot more accuracy by the neural network. The regression coefficient of neural network outputs was equal to 99.94% and 99.84%, respectively, for the data of relative heat transfer coefficient and relative pressure drop. The regression coefficient for the provided equation was also equal to 97.02% and 77.90%, respectively, for these two parameters, which indicates this equation operates much less precisely than the neural network. Conclusion: So, relative heat transfer coefficient and pressure drop of nanofluids can also be modeled and estimated by the neural network, in addition to the modeling of nanofluid’s thermal conductivity and viscosity executed by different scholars via neural networks.

scholarly journals Natural Disasters Intensity Analysis and Classification Based on Multispectral Images Using Multi-Layered Deep Convolutional Neural Network

Sensors ◽  
2021 ◽  
Vol 21 (8) ◽  
pp. 2648
Author(s):  
Muhammad Aamir ◽  
Tariq Ali ◽  
Muhammad Irfan ◽  
Ahmad Shaf ◽  
Muhammad Zeeshan Azam ◽  
...  
Keyword(s):  
Neural Network ◽  
Convolutional Neural Network ◽  
Natural Disasters ◽  
Deep Convolutional Neural Network ◽  
Multispectral Images ◽  
Learning Techniques ◽  
Proposed Model ◽  
Disaster Intensity ◽  
And Performance

Natural disasters not only disturb the human ecological system but also destroy the properties and critical infrastructures of human societies and even lead to permanent change in the ecosystem. Disaster can be caused by naturally occurring events such as earthquakes, cyclones, floods, and wildfires. Many deep learning techniques have been applied by various researchers to detect and classify natural disasters to overcome losses in ecosystems, but detection of natural disasters still faces issues due to the complex and imbalanced structures of images. To tackle this problem, we propose a multilayered deep convolutional neural network. The proposed model works in two blocks: Block-I convolutional neural network (B-I CNN), for detection and occurrence of disasters, and Block-II convolutional neural network (B-II CNN), for classification of natural disaster intensity types with different filters and parameters. The model is tested on 4428 natural images and performance is calculated and expressed as different statistical values: sensitivity (SE), 97.54%; specificity (SP), 98.22%; accuracy rate (AR), 99.92%; precision (PRE), 97.79%; and F1-score (F1), 97.97%. The overall accuracy for the whole model is 99.92%, which is competitive and comparable with state-of-the-art algorithms.

scholarly journals Application of artificial neural networks to predict the deflections of reinforced concrete beams

2016 ◽  
Vol 38 (2) ◽  
pp. 37-46 ◽  
Author(s):  
Mateusz Kaczmarek ◽  
Agnieszka Szymańska
Keyword(s):  
Neural Network ◽  
Neural Networks ◽  
Artificial Neural Network ◽  
Reinforced Concrete ◽  
Concrete Beams ◽  
Reinforced Concrete Beams ◽  
The Neural Network ◽  
Eurocode 2 ◽  
Artificial Neural ◽  
Concrete Elements

Abstract Nonlinear structural mechanics should be taken into account in the practical design of reinforced concrete structures. Cracking is one of the major sources of nonlinearity. Description of deflection of reinforced concrete elements is a computational problem, mainly because of the difficulties in modelling the nonlinear stress-strain relationship of concrete and steel. In design practise, in accordance with technical rules (e.g., Eurocode 2), a simplified approach for reinforced concrete is used, but the results of simplified calculations differ from the results of experimental studies. Artificial neural network is a versatile modelling tool capable of making predictions of values that are difficult to obtain in numerical analysis. This paper describes the creation and operation of a neural network for making predictions of deflections of reinforced concrete beams at different load levels. In order to obtain a database of results, that is necessary for training and testing the neural network, a research on measurement of deflections in reinforced concrete beams was conducted by the authors in the Certified Research Laboratory of the Building Engineering Institute at Wrocław University of Science and Technology. The use of artificial neural networks is an innovation and an alternative to traditional methods of solving the problem of calculating the deflections of reinforced concrete elements. The results show the effectiveness of using artificial neural network for predicting the deflection of reinforced concrete beams, compared with the results of calculations conducted in accordance with Eurocode 2. The neural network model presented in this paper can acquire new data and be used for further analysis, with availability of more research results.

Watermelon Sorting Process by Frequency Identification and Artificial Neural Network

2021 ◽  
Author(s):  
Komsan Wongkalasin ◽  
Teerapon Upachaban ◽  
Wacharawish Daosawang ◽  
Nattadon Pannucharoenwong ◽  
Phadungsak Ratanadecho
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Selection Process ◽  
Network Processor ◽  
Data Set ◽  
The Neural Network ◽  
Frequency Identification ◽  
Sorting Process ◽  
Artificial Neural ◽  
Reasonable Prediction

This research aims to enhance the watermelon’s quality selection process, which was traditionally conducted by knocking the watermelon fruit and sort out by the sound’s character. The proposed method in this research is generating the sound spectrum through the watermelon and then analyzes the response signal’s frequency and the amplitude by Fast Fourier Transform (FFT). Then the obtained data were used to train and verify the neural network processor. The result shows that, the frequencies of 129 and 172 Hz were suit to be used in the comparison. Thirty watermelons, which were randomly selected from the orchard, were used to create a data set, and then were cut to manually check and match to the fruits’ quality. The 129 Hz frequency gave the response ranging from 13.57 and above in 3 groups of watermelons quality, including, not fully ripened, fully ripened, and close to rotten watermelons. When the 172 Hz gave the response between 11.11–12.72 in not fully ripened watermelons and those of 13.00 or more in the group of close to rotten and hollow watermelons. The response was then used as a training condition for the artificial neural network processor of the sorting machine prototype. The verification results provided a reasonable prediction of the ripeness level of watermelon and can be used as a pilot prototype to improve the efficiency of the tools to obtain a modern-watermelon quality selection tool, which could enhance the competitiveness of the local farmers on the product quality control.

A Model on the Correlation between Composition and Mechanical Properties of Mg-Al-Zn Alloys by Using Artificial Neural Network

2005 ◽  
Vol 488-489 ◽  
pp. 793-796 ◽  
Author(s):  
Hai Ding Liu ◽  
Ai Tao Tang ◽  
Fu Sheng Pan ◽  
Ru Lin Zuo ◽  
Ling Yun Wang
Keyword(s):  
Neural Network ◽  
Mechanical Properties ◽  
Artificial Neural Network ◽  
Magnesium Alloys ◽  
Tensile Yield Strength ◽  
Data Set ◽  
The Neural Network ◽  
Artificial Neural ◽  
Prediction Of Mechanical Properties ◽  
Artificial Neural Network Ann

A model was developed for the analysis and prediction of correlation between composition and mechanical properties of Mg-Al-Zn (AZ) magnesium alloys by applying artificial neural network (ANN). The input parameters of the neural network (NN) are alloy composition. The outputs of the NN model are important mechanical properties, including ultimate tensile strength, tensile yield strength and elongation. The model is based on multilayer feedforward neural network. The NN was trained with comprehensive data set collected from domestic and foreign literature. A very good performance of the neural network was achieved. The model can be used for the simulation and prediction of mechanical properties of AZ system magnesium alloys as functions of composition.

scholarly journals Using Monte Carlo method to estimate the behavior of neural training between balanced and unbalanced data in classification of patterns

2018 ◽  
Vol 7 (2) ◽  
pp. 1
Author(s):  
Paulo Marcelo Tasinaffo ◽  
Gildárcio Sousa Gonçalves ◽  
Adilson Marques da Cunha ◽  
Luiz Alberto Vieira Dias
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Monte Carlo ◽  
Monte Carlo Method ◽  
Mean Squared Error ◽  
Classification Problem ◽  
Computational Environment ◽  
The Monte Carlo Method ◽  
Proposed Model ◽  
Artificial Neural

This paper proposes to develop a model-based Monte Carlo method for computationally determining the best mean squared error of training for an artificial neural network with feedforward architecture. It is applied for a particular non-linear classification problem of input/output patterns in a computational environment with abundant data. The Monte Carlo method allows computationally checking that balanced data are much better than non-balanced ones for an artificial neural network to learn by means of supervised learning. The major contribution of this investigation is that, the proposed model can be tested by analogy, considering also the fraud detection problem in credit cards, where the amount of training patterns used are high.

scholarly journals Применение искусственной нейронной сети в экспериментах по ядерному спиновому эху

2019 ◽  
Vol 45 (12) ◽  
pp. 16
Author(s):  
С.Н. Полулях ◽  
А.И. Горбованов
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Nuclear Spin ◽  
Spin Echo ◽  
Gaussian Form ◽  
The Neural Network ◽  
Network Application ◽  
Artificial Neural

The possibility of artificial neural network application to detect nuclear spin echo signals under conditions when the echo amplitude is comparable to the amplitude of the noise is demonstrated. Data obtained by superimposing the model echo signals of a Gaussian form on experimentally recorded noise signals is proposed to use for training the neural network.

scholarly journals Intrusion Detection for Industrial Control Systems Based on Open Set Artificial Neural Network

2021 ◽  
Vol 2021 ◽  
pp. 1-14
Author(s):  
Chao Wang ◽  
Bailing Wang ◽  
Yunxiao Sun ◽  
Yuliang Wei ◽  
Kai Wang ◽  
...  
Keyword(s):  
Neural Network ◽  
Artificial Neural Network ◽  
Intrusion Detection ◽  
Control Systems ◽  
Industrial Control ◽  
Industrial Control Systems ◽  
Open Set ◽  
The Neural Network ◽  
Center Loss ◽  
Artificial Neural

The security of industrial control systems (ICSs) has received a lot of attention in recent years. ICSs were once closed networks. But with the development of IT technologies, ICSs have become connected to the Internet, increasing the potential of cyberattacks. Because ICSs are so tightly linked to human lives, any harm to them could have disastrous implications. As a technique of providing protection, many intrusion detection system (IDS) studies have been conducted. However, because of the complicated network environment and rising means of attack, it is difficult to cover all attack classes, most of the existing classification techniques are hard to deploy in a real environment since they cannot deal with the open set problem. We propose a novel artificial neural network based-methodology to solve this problem. Our suggested method can classify known classes while also detecting unknown classes. We conduct research from two points of view. On the one hand, we use the openmax layer instead of the traditional softmax layer. Openmax overcomes the limitations of softmax, allowing neural networks to detect unknown attack classes. During training, on the other hand, a new loss function termed center loss is implemented to improve detection ability. The neural network model learns better feature representations with the combined supervision of center loss and softmax loss. We evaluate the neural network on NF-BoT-IoT-v2 and Gas Pipeline datasets. The experiments show our proposed method is comparable with the state-of-the-art algorithm in terms of detecting unknown classes. But our method has a better overall classification performance.

Sign in / Sign up

Export Citation Format

Share Document