Evolving an expert checkers playing program without using human expertise

被引:102
作者
Chellapilla, K [1 ]
Fogel, DB [1 ]
机构
[1] Nat Select Inc, La Jolla, CA 92037 USA
关键词
checkers; coevolution; evolutionary computation;
D O I
10.1109/4235.942536
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
An evolutionary algorithm has taught itself how to play the game of checkers without using features that would normally require human expertise. Using only the raw positions of pieces on the board and the piece differential, the evolutionary program optimized artificial neural networks to evaluate alternative positions in the game. Over the course of several hundred generations, the program taught itself to play at a level that is competitive with human experts (one level below human masters). This was verified by playing the best evolved neural network against 165 human players on an Internet gaming zone. The neural network's performance earned a rating that was better than 99.61% of all registered players at the website. Control experiments between the best evolved neural network and a program that relies on material advantage indicate the superiority of the neural network both at equal levels of look ahead and CPU time. The results suggest that the principles of Darwinian evolution may be usefully applied to solving problems that have not yet been solved by human expertise.
引用
收藏
页码:422 / 428
页数:7
相关论文
共 15 条
[1]   RANDOM EVALUATIONS IN CHESS [J].
BEAL, D ;
SMITH, MC .
ICCA JOURNAL, 1994, 17 (01) :3-9
[2]   Evolution, neural networks, games, and intelligence [J].
Chellapilla, K ;
Fogel, DB .
PROCEEDINGS OF THE IEEE, 1999, 87 (09) :1471-1496
[3]   Co-evolving checkers playing programs using only win, lose, or draw [J].
Chellapilla, K ;
Fogel, DB .
APPLICATIONS AND SCIENCE OF COMPUTATIONAL INTELLIGENCE II, 1999, 3722 :303-312
[4]   Evolving neural networks to play checkers without relying on expert knowledge [J].
Chellapilla, K ;
Fogel, DB .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (06) :1382-1391
[5]  
FOGEL DB, 1993, P IEEE INT C NEUR NE, P875
[6]  
FOGEL DB, 2001, IN PRESS NEUROCOMPUT
[7]  
Kaindl H., 1990, COMPUTERS CHESS COGN, P133, DOI [10.1007/978-1-4613-9080-0, DOI 10.1007/978-1-4613-9080-0]
[8]   STEPS TOWARD ARTIFICIAL INTELLIGENCE [J].
MINSKY, M .
PROCEEDINGS OF THE INSTITUTE OF RADIO ENGINEERS, 1961, 49 (01) :8-+
[9]   CELL SIGNALING PATHWAY INVOLVED IN PACAP-INDUCED AR4-2J CELL-PROLIFERATION [J].
MORISSET, J ;
DOUZIECH, N ;
RYDZEWSKA, G ;
BUSCAIL, L ;
RIVARD, N .
CELLULAR SIGNALLING, 1995, 7 (03) :195-205
[10]   Co-evolution in the successful learning of backgammon strategy [J].
Pollack, JB ;
Blair, AD .
MACHINE LEARNING, 1998, 32 (03) :225-240