Artificial Bee Colony-Fuzzy Q Learning for Reinforcement Fuzzy Control (Truck Backer-Upper Control Problem)

Author(s):  
Sima Saeed ◽  
Aliakbar Niknafs

A new method for reinforcement fuzzy controllers is presented by this article. The method uses Artificial Bee Colony algorithm based on Q-Value to control reinforcement fuzzy system; the algorithm is called Artificial Bee Colony-Fuzzy Q learning (ABC-FQ). In fuzzy inference system, precondition part of rules is generated by prior knowledge, but ABC-FQ algorithm is responsible to achieve the best combination of actions for the consequence part of the rules. In ABC-FQ algorithm, each combination of actions is considered a food source for consequence part of the rules and the fitness level of this food source is determined by Q-Value. ABC-FQ Algorithm selects the best food resource, which is the best combination of actions for fuzzy system, using Q criterion. This algorithm tries to generate the best reinforcement fuzzy system to control the agent. ABC-FQ algorithm is used to solve the problem of Truck Backer-Upper Control, a reinforcement fuzzy control. The results have indicated that this method arrives to a result with higher speed and fewer trials in comparison to previous methods.

2017 ◽  
Vol 10 (2) ◽  
pp. 166-182 ◽  
Author(s):  
Shabia Shabir Khan ◽  
S.M.K. Quadri

Purpose As far as the treatment of most complex issues in the design is concerned, approaches based on classical artificial intelligence are inferior compared to the ones based on computational intelligence, particularly this involves dealing with vagueness, multi-objectivity and good amount of possible solutions. In practical applications, computational techniques have given best results and the research in this field is continuously growing. The purpose of this paper is to search for a general and effective intelligent tool for prediction of patient survival after surgery. The present study involves the construction of such intelligent computational models using different configurations, including data partitioning techniques that have been experimentally evaluated by applying them over realistic medical data set for the prediction of survival in pancreatic cancer patients. Design/methodology/approach On the basis of the experiments and research performed over the data belonging to various fields using different intelligent tools, the authors infer that combining or integrating the qualification aspects of fuzzy inference system and quantification aspects of artificial neural network can prove an efficient and better model for prediction. The authors have constructed three soft computing-based adaptive neuro-fuzzy inference system (ANFIS) models with different configurations and data partitioning techniques with an aim to search capable predictive tools that could deal with nonlinear and complex data. After evaluating the models over three shuffles of data (training set, test set and full set), the performances were compared in order to find the best design for prediction of patient survival after surgery. The construction and implementation of models have been performed using MATLAB simulator. Findings On applying the hybrid intelligent neuro-fuzzy models with different configurations, the authors were able to find its advantage in predicting the survival of patients with pancreatic cancer. Experimental results and comparison between the constructed models conclude that ANFIS with Fuzzy C-means (FCM) partitioning model provides better accuracy in predicting the class with lowest mean square error (MSE) value. Apart from MSE value, other evaluation measure values for FCM partitioning prove to be better than the rest of the models. Therefore, the results demonstrate that the model can be applied to other biomedicine and engineering fields dealing with different complex issues related to imprecision and uncertainty. Originality/value The originality of paper includes framework showing two-way flow for fuzzy system construction which is further used by the authors in designing the three simulation models with different configurations, including the partitioning methods for prediction of patient survival after surgery. Several experiments were carried out using different shuffles of data to validate the parameters of the model. The performances of the models were compared using various evaluation measures such as MSE.


2012 ◽  
Vol 42 (1) ◽  
pp. 166-171 ◽  
Author(s):  
Leandro Ferreira ◽  
Tadayuki Yanagi Junior ◽  
Wilian Soares Lacerda ◽  
Giovanni Francisco Rabelo

Cloacal temperature (CT) of broiler chickens is an important parameter to classify its comfort status; therefore its prediction can be used as decision support to turn on acclimatization systems. The aim of this research was to develop and validate a system using the fuzzy set theory for CT prediction of broiler chickens. The fuzzy system was developed based on three input variables: air temperature (T), relative humidity (RH) and air velocity (V). The output variable was the CT. The fuzzy inference system was performed via Mamdani's method which consisted in 48 rules. The defuzzification was done using center of gravity method. The fuzzy system was developed using MAPLE® 8. Experimental results, used for validation, showed that the average standard deviation between simulated and measured values of CT was 0.13°C. The proposed fuzzy system was found to satisfactorily predict CT based on climatic variables. Thus, it could be used as a decision support system on broiler chicken growth.


2018 ◽  
Vol 10 (1) ◽  
pp. 17
Author(s):  
Nursyiva Irsalinda ◽  
Sugiyarto Surono

Artificial Bee Colony (ABC) algorithm is one of metaheuristic optimization technique based on population. This algorithm mimicking honey bee swarm to find the best food source. ABC algorithm consist of four phases: initialization phase, employed bee phase, onlooker bee phase and scout bee phase. This study modify the onlooker bee phase in selection process to find the neighborhood food source. Not all food sources obtained are randomly sought the neighborhood as in ABC algorithm. Food sources are selected by comparing their objective function values. The food sources that have value lower than average value in that iteration will be chosen by onlooker bee to get the better food source. In this study the modification of this algorithm is called New Modification of Artificial Bee Colony Algorithm (MB-ABC). MB-ABC was applied to 4 Benchmark functions. The results show that MB-ABC algorithm better than ABC algorithm


2018 ◽  
Vol 12 (4) ◽  
pp. 484-506 ◽  
Author(s):  
Farhad Mirzaei ◽  
Mahmoud Delavar ◽  
Isham Alzoubi ◽  
Babak Nadjar Arrabi

PurposeThe purpose of this paper is to develop three methods including artificial bee colony algorithm (ABC-ANN), regression and adaptive neural fuzzy inference system (ANFIS) to predict the environmental indicators for land leveling and to analysis the sensitivity of these parameters.Design/methodology/approachThis paper develops three methods including artificial bee colony algorithm (ABC-ANN), regression and adaptive neural fuzzy inference system (ANFIS) to predict the environmental indicators for land leveling and to analysis the sensitivity of these parameters. So, several soil properties such as soil, cut/fill volume, soil compressibility factor, specific gravity, moisture content, slope, sand per cent and soil swelling index in energy consumption were investigated. A total of 90 samples were collected from three land areas with the selected grid size of (20 m × 20 m). Acquired data were used to develop accurate models for labor, energy (LE), fuel energy (FE), total machinery cost (TMC) and total machinery energy (TM).FindingsBy applying the three mentioned analyzing methods, the results of regression showed that, only three parameters of sand per cent, slope and soil, cut/fill volume had significant effects on energy consumption. All developed models (Regression, ANFIS and ABC-ANN) had satisfactory performance in predicting aforementioned parameters in various field conditions. The adaptive neural fuzzy inference system (ANFIS) has the most capability in prediction according to least RMSE and the highestR2value of 0.0143, 0.9990 for LE. The ABC-ANN has the most capability in prediction of the environmental and energy parameters with the least RMSE and the highestR2with the related values for TMC, FE and TME (0.0248, 0.9972), (0.0322, 0.9987) and (0.0161, 0.9994), respectively.Originality/valueAs land leveling with machines requires considerable amount of energy, optimizing energy consumption in land leveling operation is of a great importance. So, three approaches comprising: ABC-ANN, ANFIS as powerful and intensive methods and regression as a fast and simplex model have been tested and surveyed to predict the environmental indicators for land leveling and determine the best method. Hitherto, only a limited number of studies associated with energy consumption in land leveling have been done. In mentioned studies, energy was a function of the volume of excavation (cut/fill volume). Therefore, in this research, energy and cost of land leveling are functions of all the properties of the land including slope, coefficient of swelling, density of the soil, soil moisture, special weight and swelling index which will be thoroughly mentioned and discussed. In fact, predicting minimum cost of land leveling for field irrigation according to the field properties is the main goal of this research which is in direct relation with environment and weather pollution.


Author(s):  
Tripti Rani Borah ◽  
Kandarpa Kumar Sarma ◽  
Pranhari Talukdar

In all authentication systems, biometric samples are regarded to be the most reliable one. Biometric samples like fingerprint, retina etc. is unique. Most commonly available biometric system prefers these samples as reliable inputs. In a biometric authentication system, the design of decision support system is critical and it determines success or failure. Here, we propose such a system based on neuro and fuzzy system. Neuro systems formulated using Artificial Neural Network learn from numeric data while fuzzy based approaches can track finite variations in the environment. Thus NFS systems formed using ANN and fuzzy system demonstrate adaptive, numeric and qualitative processing based learning. These attributes have motivated the formulation of an adaptive neuro fuzzy inference system which is used as a DSS of a biometric authenticable system. The experimental results show that the system is reliable and can be considered to be a part of an actual design.


Sign in / Sign up

Export Citation Format

Share Document