Air combat maneuvering method based on parallel self-play

US11794898B2 · kind B2 · utility

Assignee

• Northwestern Polytechnical University · CN

Inventors

• Bo LI · Xi'an, CN
• Kaifang Wan · Xi'an, CN
• Xiaoguang Gao · Xi'an, CN
• Zhigang Gan · Xi'an, CN
• Shiyang Liang · Xi'an, CN
• Kaiqiang Yue · Xi'an, CN
• Zhipeng Yang · Longbeilingcun, CN

Key dates

• Filing date: Oct 13, 2021
• Grant date: Oct 24, 2023
• Expiry date: Jan 28, 2042

Classification

• Technology area (CPC B): Performing Operations; Transporting
• CPC primary: B64U2101/15
• WIPO field: Computer technology
• WIPO sector: Electrical engineering

Abstract

The present disclosure provides an air combat maneuvering method based on parallel self-play, including the steps of constructing a UAV (unmanned aerial vehicle) maneuver model, constructing a red-and-blue motion situation acquiring model to describe a relative combat situation of red and blue sides, constructing state spaces and action spaces of both red and blue sides and a reward function according to a Markov process, followed by constructing a maneuvering decision-making model structure based on a soft actor-critic (SAC) algorithm, training the SAC algorithm by performing air combat confrontations to realize parallel self-play, and finally testing a trained network, displaying combat trajectories and calculating a combat success rate. The level of confrontations can be effectively enhanced and the combat success rate of the decision-making model can be increased.