Research on Autonomous Decision-Making of UCAV Based on Deep Reinforcement Learning

In order to improve the intelligence level of training opponents in UCAV air combat simulation and the realism and immersion of air combat simulation in 3D space, this paper proposes a deep reinforcement learning algorithm for UCAV autonomous control based on virtual reality technology. A combination of reinforcement learning and Unity3D is used to train UCAV agents to achieve air combat tasks in 3D virtual reality space, and imitation learning is added to improve the efficiency of policy generation. Multiple perceptrons are used to simplify the agent's acquisition of environmental state data, and reward functions are designed by integrating UCAV angle, speed, and altitude considerations to visualize the entire 3D visualization process of reinforcement learning training UCAV agents to interact with the environment.