scholarly journals Extreme Learning Machine with Multi-Agent System for Regression

From the point of learning speed as well as generalization, Extreme Learning Machine(ELM) is widely known as an effective learning algorithm than the conventional learning methods. Basically, hidden neurons are not required in neuron alike, instead, weight is the parameter that would need to learn about the link in between output and hidden layers. The creation of an output is to integrate each independent of several ELMs. The precise approach is included in a Multi-Agent System. The novelty of ELM-MAS (extreme learning machine based multi-agent system) is put forward in the paper for solving data regression problems. The ELMs consist of two layers which are the parent agent layer and individual agent layer. The effectiveness of the ELM-MAS model is proved with some activation functions employing benchmark datasets (abalone, strike and space-ga) and real world application (Nox emission). The outcomes indicate that the proposed model is capable to attain improved results than other approaches.

2018 ◽  
Vol 7 (4.35) ◽  
pp. 347
Author(s):  
Chong Tak Yaw ◽  
Shen Yuong Wong ◽  
Keem Siah Yap ◽  
Chin Hooi Tan

Extreme Learning Machine (ELM) is widely known as an effective learning algorithm than the conventional learning methods from the point of learning speed as well as generalization. The hidden neurons are optional in neuron alike whereas the weights are the criteria required to study the linking among the output layer as well as hidden layers. On the other hand, the ensemble model to integrate every independent prediction of several ELMs to produce a final output. This particular approach was included in a Multi-Agent System (MAS). By hybrid those two approached, a novel extreme learning machine based multi-agent systems (ELM-MAS) for handling classification problems is presented in this paper. It contains two layers of ELMs, i.e., individual agent layer and parent agent layer. Several activation functions using benchmark datasets and real-world applications, i.e., satellite image, image segmentation, fault diagnosis in power generation (including circulating water systems as well as GAST governor) were used to test the ELM-MAS developed. Our experimental results suggest that ELM-MAS is capable of achieving good accuracy rates relative to others approaches.


2018 ◽  
Vol 29 (1) ◽  
pp. 877-893 ◽  
Author(s):  
Dounia El Bourakadi ◽  
Ali Yahyaouy ◽  
Jaouad Boumhidi

Abstract Renewable energies constitute an alternative to fossil energies for several reasons. The microgrid can be assumed as the ideal way to integrate a renewable energy source in the production of electricity and give the consumer the opportunity to participate in the electricity market not just like a consumer but also like a producer. In this paper, we present a multi-agent system based on wind and photovoltaic power prediction using the extreme learning machine algorithm. This algorithm was tested on real weather data taken from the region of Tetouan City in Morocco. The process aimed to implement a microgrid located in Tetouan City and composed of different generation units (solar and wind energies were combined together to increase the efficiency of the system) and storage units (batteries were used to ensure the availability of power on demand as much as possible). In the proposed architecture, the microgrid can exchange electricity with the main grid; therefore, it can buy or sell electricity. Thus, the goal of our multi-agent system is to control the amount of power delivered or taken from the main grid in order to reduce the cost and maximize the benefit. To address uncertainties in the system, we use fuzzy logic control to manage the flow of energy, to ensure the availability of power on demand, and to make a reasonable decision about storing or selling electricity.


Author(s):  
Chong Tak Yaw ◽  
Shen Young Wong ◽  
Keem Sian Yap

Extreme Learning Machine (ELM) is widely known as an effective learning algorithm than the conventional learning methods from the point of learning speed as well as generalization. In traditional fuzzy inference method which was the "if-then" rules, all the input and output objects were assigned to antecedent and consequent component respectively. However, a major dilemma was that the fuzzy rules' number kept increasing until the system and arrangement of the rules became complicated. Therefore, the single input rule modules connected type fuzzy inference (SIRM) method where consociated the output of the fuzzy rules modules significantly. In this paper, we put forward a novel single input rule modules based on extreme learning machine (denoted as SIRM-ELM) for solving data regression problems. In this hybrid model, the concept of SIRM is applied as hidden neurons of ELM and each of them represents a single input fuzzy rules. Hence, the number of fuzzy rule and the number of hidden neuron of ELM are the same. The effectiveness of proposed SIRM-ELM model is verified using sigmoid activation functions based on several benchmark datasets and a NOx emission of power generation plant.  Experimental results illustrate that our proposed SIRM-ELM model is capable of achieving small root mean square error, i.e., 0.027448 for prediction of NO<sub>x</sub> emission.


2015 ◽  
Vol 2015 ◽  
pp. 1-12 ◽  
Author(s):  
Pengbo Zhang ◽  
Zhixin Yang

Extreme learning machine (ELM) has been well recognized as an effective learning algorithm with extremely fast learning speed and high generalization performance. However, to deal with the regression applications involving big data, the stability and accuracy of ELM shall be further enhanced. In this paper, a new hybrid machine learning method called robust AdaBoost.RT based ensemble ELM (RAE-ELM) for regression problems is proposed, which combined ELM with the novel robust AdaBoost.RT algorithm to achieve better approximation accuracy than using only single ELM network. The robust threshold for each weak learner will be adaptive according to the weak learner’s performance on the corresponding problem dataset. Therefore, RAE-ELM could output the final hypotheses in optimally weighted ensemble of weak learners. On the other hand, ELM is a quick learner with high regression performance, which makes it a good candidate of “weak” learners. We prove that the empirical error of the RAE-ELM is within a significantly superior bound. The experimental verification has shown that the proposed RAE-ELM outperforms other state-of-the-art algorithms on many real-world regression problems.


Author(s):  
JUNHAI ZHAI ◽  
HONGYU XU ◽  
YAN LI

Extreme learning machine (ELM) is an efficient and practical learning algorithm used for training single hidden layer feed-forward neural networks (SLFNs). ELM can provide good generalization performance at extremely fast learning speed. However, ELM suffers from instability and over-fitting, especially on relatively large datasets. Based on probabilistic SLFNs, an approach of fusion of extreme learning machine (F-ELM) with fuzzy integral is proposed in this paper. The proposed algorithm consists of three stages. Firstly, the bootstrap technique is employed to generate several subsets of original dataset. Secondly, probabilistic SLFNs are trained with ELM algorithm on each subset. Finally, the trained probabilistic SLFNs are fused with fuzzy integral. The experimental results show that the proposed approach can alleviate to some extent the problems mentioned above, and can increase the prediction accuracy.


2020 ◽  
Vol 17 (2) ◽  
pp. 647-664
Author(s):  
Yangyang Ge ◽  
Fei Zhu ◽  
Wei Huang ◽  
Peiyao Zhao ◽  
Quan Liu

Multi-Agent system has broad application in real world, whose security performance, however, is barely considered. Reinforcement learning is one of the most important methods to resolve Multi-Agent problems. At present, certain progress has been made in applying Multi-Agent reinforcement learning to robot system, man-machine match, and automatic, etc. However, in the above area, an agent may fall into unsafe states where the agent may find it difficult to bypass obstacles, to receive information from other agents and so on. Ensuring the safety of Multi-Agent system is of great importance in the above areas where an agent may fall into dangerous states that are irreversible, causing great damage. To solve the safety problem, in this paper we introduce a Multi-Agent Cooperation Q-Learning Algorithm based on Constrained Markov Game. In this method, safety constraints are added to the set of actions, and each agent, when interacting with the environment to search for optimal values, should be restricted by the safety rules, so as to obtain an optimal policy that satisfies the security requirements. Since traditional Multi-Agent reinforcement learning algorithm is no more suitable for the proposed model in this paper, a new solution is introduced for calculating the global optimum state-action function that satisfies the safety constraints. We take advantage of the Lagrange multiplier method to determine the optimal action that can be performed in the current state based on the premise of linearizing constraint functions, under conditions that the state-action function and the constraint function are both differentiable, which not only improves the efficiency and accuracy of the algorithm, but also guarantees to obtain the global optimal solution. The experiments verify the effectiveness of the algorithm.


Sign in / Sign up

Export Citation Format

Share Document