Intuitionistic Fuzzy MADM in Wargame Leveraging With Deep Reinforcement Learning

被引:1
作者
Sun, Yuxiang [1 ]
Li, Yuanbai [1 ]
Li, Huaxiong [1 ]
Liu, Jiubing [2 ]
Zhou, Xianzhong [1 ]
机构
[1] Nanjing Univ, Dept Control Sci & Intelligence Engn, Nanjing 210023, Peoples R China
[2] Shantou Univ, Business Sch, Shantou 515063, Peoples R China
基金
中国国家自然科学基金;
关键词
Intelligent game; multiagent; multiple attribute decision making (MADM); reinforcement learning (RL); DECISION-MAKING; GAME; GO; SETS; MCDM;
D O I
10.1109/TFUZZ.2024.3435400
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Presently, intelligent games have emerged as a substantial research area. Nonetheless, the slow convergence of intelligent wargame training and the low success rates of agents against specific rules present challenges. In this article, we propose a game confrontation algorithm combining the multiple attribute decision making (MADM) approach from management science and reinforcement learning (RL) technology. This integration enables us to combine the strengths of both approaches and addresses the above issues effectively. This study conducts experiments using the algorithm that integrates MADM and RL techniques to gather confrontation data from the red and blue sides within the winning-first wargame platform. The data is then analyzed using the weight calculation method of intuitionistic fuzzy numbers to determine each intelligent opponent agent's threat level from the perspective of MADM. The threat level calculated by MADM is used to construct the reward function for the red side. The simulation results demonstrate that the algorithm combining MADM and RL proposed in this study outperforms classical RL algorithms regarding intelligence. This approach effectively addresses issues, such as the convergence difficulty, caused by random initialization and the sparse rewards for agent neural networks in wargame environments with large maps. Combining the MADM method from management with the RL algorithm in control can lead to cross-disciplinary innovation in academic fields, which provides innovative research values for intelligent wargame design and RL algorithm improvements.
引用
收藏
页码:5033 / 5045
页数:13
相关论文
共 48 条
[1]  
[Anonymous], 2017, P AAAI C ART INT INT
[2]   INTUITIONISTIC FUZZY-SETS [J].
ATANASSOV, KT .
FUZZY SETS AND SYSTEMS, 1986, 20 (01) :87-96
[3]   Improving RTS Game AI by Supervised Policy Learning, Tactical Search, and Deep Reinforcement Learning [J].
Barriga, Nicolas A. ;
Stanescu, Marius ;
Besoain, Felipe ;
Buro, Michael .
IEEE COMPUTATIONAL INTELLIGENCE MAGAZINE, 2019, 14 (03) :8-18
[4]   A Human-Machine Agent Based on Active Reinforcement Learning for Target Classification in Wargame [J].
Chen, Li ;
Zhang, Yulong ;
Feng, Yanghe ;
Zhang, Longfei ;
Liu, Zhong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, 35 (07) :9858-9870
[5]   Online Intention Recognition With Incomplete Information Based on a Weighted Contrastive Predictive Coding Model in Wargame [J].
Chen, Li ;
Liang, Xingxing ;
Feng, Yanghe ;
Zhang, Longfei ;
Yang, Jing ;
Liu, Zhong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (10) :7515-7528
[6]  
Chen M.S, 2022, 3 INT C COMP SCI COM, P1200
[7]   A novel similarity measure between intuitionistic fuzzy sets based on the centroid points of transformed fuzzy numbers with applications to pattern recognition [J].
Chen, Shyi-Ming ;
Cheng, Shou-Hsiung ;
Lan, Tzu-Chun .
INFORMATION SCIENCES, 2016, 343 :15-40
[8]  
Cheng Kai, 2021, Systems Engineering and Electronics, P2911, DOI 10.12305/j.issn.1001-506X.2021.10.26
[9]   Accelerating wargaming reinforcement learning by dynamic multi-demonstrator ensemble [J].
Dong, Liwei ;
Li, Ni ;
Yuan, Haitao ;
Gong, Guanghong .
INFORMATION SCIENCES, 2023, 648
[10]   A Wargame-Augmented Knowledge Elicitation Method for the Agile Development of Novel Systems [J].
Dorton, Stephen L. ;
Maryeski, LeeAnn R. ;
Ogren, Lauren ;
Dykens, Ian T. ;
Main, Adam .
SYSTEMS, 2020, 8 (03) :1-15