scholarly journals A Modified Quad Q Network Algorithm for Predicting Resource Management

2021 ◽  
Vol 11 (11) ◽  
pp. 5154
Author(s):  
Yeonggwang Kim ◽  
Jaehyung Park ◽  
Jinyoung Kim ◽  
Junchurl Yoon ◽  
Sangjoon Lee ◽  
...  
Keyword(s):  
Resource Management ◽  
Demand Response ◽  
Distribution System ◽  
Fuzzy Inference ◽  
Learning Algorithm ◽  
Resource Distribution ◽  
Control Logic ◽  
Q Learning ◽  
Network Algorithm ◽  
Reward Mechanism

As the resource management systems continues to grow, the resource distribution system is expected to expand steadily. The demand response system enables producers to reduce the consumption costs of an enterprise during fluctuating periods in order balance the supply grid and resell the remaining resources of the product to generate revenue. Q-learning, a reinforcement learning algorithm based on a resource distribution compensation mechanism, is used to make optimal decisions to schedule the operation of smart factory appliances. In this paper, we proposed an effective resource management system for enterprise demand response using a Quad Q Network algorithm. The proposed algorithm is based on a Deep Q Network algorithm that directly integrates supply-demand inputs into control logic and employs fuzzy inference as a reward mechanism. In addition to using uses the Compare Optimizer method to reduce the loss value of the proposed Q Network Algorithm, Quad Q Network also maintains a high accuracy with fewer epochs. The proposed algorithm was applied to market capitalization data obtained from Google and Apple. Also, we verified that the Compare Optimizer used in Quad Q Network derives the minimum loss value through the double operation of Double Q value.

Water Leakage Detection for Complex Pipe Systems Using Hybrid Learning Algorithm Based on ANFIS Method

2018 ◽  
Vol 18 (4) ◽  
Author(s):  
Barış Can Yalçın ◽  
Cihan Demir ◽  
Murat Gökçe ◽  
Ahmet Koyun
Keyword(s):  
Distribution System ◽  
Nuclear Power ◽  
Distribution Systems ◽  
Water Distribution ◽  
Fuzzy Inference ◽  
Water Distribution System ◽  
Learning Algorithm ◽  
Chemical Waste ◽  
Inference System ◽  
Anfis Method

In most city water distribution systems, a considerable amount of water is lost because of leaks occurring in pipes. Moreover, an unobservable fluid leakage fault that may occur in a hazardous industrial system, such as nuclear power plant cooling process or chemical waste disposal, can cause both environmental and economical disasters. This situation generates crucial interest for industry and academia due to the financial cost related with public health risks, environmental responsibility, and energy efficiency. In this paper, to find a reliable and economic solution for this problem, adaptive neuro fuzzy inference system (ANFIS) method which consists of backpropagation and least-squares learning algorithms is proposed for estimating leakage locations in a complex water distribution system. The hybrid algorithm is trained with acceleration, pressure, and flow rate data measured through the sensors located on some specific points of the complex water distribution system. The effectiveness of the proposed method is discussed comparing the results with the current methods popularly used in this area.

A Reinforcement Learning Scheme of Fuzzy Rules with Reduced Conditions

2000 ◽  
Vol 4 (2) ◽  
pp. 146-151 ◽  
Author(s):  
Hiroshi Kawakami ◽  
◽  
Osamu Katai ◽  
Tadataka Konishi ◽  
Keyword(s):  
Fuzzy Inference ◽  
Learning Algorithm ◽  
Fuzzy Rule ◽  
Fuzzy Rules ◽  
Q Value ◽  
Huge Number ◽  
Q Learning ◽  
Control Rules ◽  
A Value ◽  
Rule System

This paper proposes a new method of Q-learning for the case where the states (conditions) and actions of systems are assumed to be continuous. The components of Q-tables are interpolated by fuzzy inference. The initial set of fuzzy rules is made of all combinations of conditions and actions relevant to the problem. Each rule is then associated with a value by which the Q-values of condition/action pairs are estimated. The values are revised by the Q-learning algorithm so as to make the fuzzy rule system effective. Although this framework may require a huge number of the initial fuzzy rules, we will show that considerable reduction of the number can be done by adopting what we call Condition Reduced Fuzzy Rules (CRFR). The antecedent part of CRFR consists of all actions and the selected conditions, and its consequent is set to be its Q-value. Finally, experimental results show that controllers with CRFRs perform equally well to the system with the most detailed fuzzy control rules, while the total number of parameters that have to be revised through the whole learning process is considerably reduced, and the number of the revised parameters at each step of learning increased.

Application of improved Q learning algorithm to job shop problem

2009 ◽  
Vol 28 (12) ◽  
pp. 3268-3270
Author(s):  
Chao WANG ◽  
Jing GUO ◽  
Zhen-qiang BAO
Keyword(s):  
Job Shop ◽  
Learning Algorithm ◽  
Q Learning

scholarly journals Network Attack Path Selection and Evaluation Based on Q-Learning

2020 ◽  
Vol 11 (1) ◽  
pp. 285
Author(s):  
Runze Wu ◽  
Jinxin Gong ◽  
Weiyue Tong ◽  
Bing Fan
Keyword(s):  
Distribution System ◽  
Path Selection ◽  
Cyber Attacks ◽  
Power Distribution System ◽  
Q Learning ◽  
Attack Model ◽  
Cross Domain ◽  
Time Operation ◽  
Attack Path ◽  
The Impact

As the coupling relationship between information systems and physical power grids is getting closer, various types of cyber attacks have increased the operational risks of a power cyber-physical System (CPS). In order to effectively evaluate this risk, this paper proposed a method of cross-domain propagation analysis of a power CPS risk based on reinforcement learning. First, the Fuzzy Petri Net (FPN) was used to establish an attack model, and Q-Learning was improved through FPN. The attack gain was defined from the attacker’s point of view to obtain the best attack path. On this basis, a quantitative indicator of information-physical cross-domain spreading risk was put forward to analyze the impact of cyber attacks on the real-time operation of the power grid. Finally, the simulation based on Institute of Electrical and Electronics Engineers (IEEE) 14 power distribution system verifies the effectiveness of the proposed risk assessment method.

Sign in / Sign up

Export Citation Format

Share Document