Simulating Human Behavior in Fighting Games using Reinforcement Learning and Artificial Neural Networks

被引:9
作者
Mendonca, Matheus R. F. [1 ]
Bernardino, Heder S. [2 ]
Neto, Raul F. [2 ]
机构
[1] Univ Fed Juiz de Fora, Juiz De Fora, Brazil
[2] Univ Fed Juiz de Fora, Dept Comp Sci, Juiz De Fora, Brazil
来源
2015 14TH BRAZILIAN SYMPOSIUM ON COMPUTER GAMES AND DIGITAL ENTERTAINMENT (SBGAMES) | 2016年
关键词
Reinforcement Learning; Intelligent Agents; Game Applications; Fighting Games;
D O I
10.1109/SBGames.2015.25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The study of intelligent agent training is of great interest to the gaming industry due to its wide application in various game genres and its capabilities of simulating a human-like behavior. In this work two machine learning techniques, namely, a reinforcement learning approach and an Artificial Neural Network (ANN), are used in a fighting game in order to allow the agent/fighter to emulate a human player. We propose a special reward function for the reinforcement learning approach that is capable of integrating specific human-like behaviors to the agent. The ANN is trained with several recorded battles of a human player. The proposed methods are compared to other two reinforcement learning methods presented in the literature. Furthermore, we present a detailed discussion of the empirical evaluations performed, regarding the training process and the main characteristics of each method used. The results obtained in the experiments indicated that the proposed methods have a good performance against human players and are also more enjoyable to play against when compared to the other existing methods.
引用
收藏
页码:152 / 159
页数:8
相关论文
共 18 条
[1]  
Amato C., 2010, PROC INT C AUTON AGE, V1, P75
[2]  
Andrade G., 2005, Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems, P1111, DOI [10.1145/1082473.1082648, DOI 10.1145/1082473.1082648]
[3]  
[Anonymous], 2013, P ADV NEUR INF PROC
[4]   AI in computer cames: Survey and perspectives [J].
Cavazza M. .
Virtual Reality, 2000, 5 (4) :223-235
[5]  
Charles D., 2003, 1 WORLD C DIG GAM
[6]  
D'Silva T., 2005, ARTIFICIAL INTELLIGE
[7]  
Graepel T., 2004, Proceedings of the International Conference on Computer Games: Artificial Intelligence, Design and Education, P193
[8]  
Hefny A. S., 2008, AIIDE
[9]   Reinforcement Learning in First Person Shooter Games [J].
McPartland, Michelle ;
Gallagher, Marcus .
IEEE TRANSACTIONS ON COMPUTATIONAL INTELLIGENCE AND AI IN GAMES, 2011, 3 (01) :43-56
[10]  
Overmars M., 2012, A Brief History of Computer Games