Infrared Air Combat Simulation Model for Deep Reinforcement Learning

2021 ◽  
Author(s):  
Conghui Huang ◽  
Chaozhe Wang ◽  
Qi Tong
Keyword(s):  
Reinforcement Learning ◽  
Simulation Model ◽  
Combat Simulation ◽  
Air Combat

scholarly journals Improving Maneuver Strategy in Air Combat by Alternate Freeze Games with a Deep Reinforcement Learning Algorithm

2020 ◽  
Vol 2020 ◽  
pp. 1-17
Author(s):  
Zhuang Wang ◽  
Hui Li ◽  
Haolin Wu ◽  
Zhaoxin Wu
Keyword(s):  
Reinforcement Learning ◽  
Learning Algorithm ◽  
Adaptive Strategy ◽  
Simulation Software ◽  
Learning Agents ◽  
Combat Simulation ◽  
Air Combat ◽  
Reward Shaping ◽  
Flight Level ◽  
The One

In a one-on-one air combat game, the opponent’s maneuver strategy is usually not deterministic, which leads us to consider a variety of opponent’s strategies when designing our maneuver strategy. In this paper, an alternate freeze game framework based on deep reinforcement learning is proposed to generate the maneuver strategy in an air combat pursuit. The maneuver strategy agents for aircraft guidance of both sides are designed in a flight level with fixed velocity and the one-on-one air combat scenario. Middleware which connects the agents and air combat simulation software is developed to provide a reinforcement learning environment for agent training. A reward shaping approach is used, by which the training speed is increased, and the performance of the generated trajectory is improved. Agents are trained by alternate freeze games with a deep reinforcement algorithm to deal with nonstationarity. A league system is adopted to avoid the red queen effect in the game where both sides implement adaptive strategies. Simulation results show that the proposed approach can be applied to maneuver guidance in air combat, and typical angle fight tactics can be learnt by the deep reinforcement learning agents. For the training of an opponent with the adaptive strategy, the winning rate can reach more than 50%, and the losing rate can be reduced to less than 15%. In a competition with all opponents, the winning rate of the strategic agent selected by the league system is more than 44%, and the probability of not losing is about 75%.

scholarly journals UAV cooperative air combat maneuver decision based on multi-agent reinforcement learning

2021 ◽  
Vol 32 (6) ◽  
pp. 1421-1438
Author(s):  
Zhang Jiandong ◽  
Yang Qiming ◽  
Shi Guoqing ◽  
Lu Yi ◽  
Wu Yong
Keyword(s):  
Reinforcement Learning ◽  
Air Combat ◽  
Multi Agent
Sign in / Sign up

Export Citation Format

Share Document