Retrieving Videogame Moments with Natural Language Queries

被引：2

作者：

Zhang, Xiaoxuan ^{[1
]}

Smith, Adam M. ^{[1
]}

机构：

[1] Univ Calif Santa Cruz, Dept Computat Media, Santa Cruz, CA 95064 USA

来源：

PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON THE FOUNDATIONS OF DIGITAL GAMES (FDG'19) | 2019年

关键词：

videogames; content-based retrieval; natural language processing; image recognition;

D O I：

10.1145/3337722.3341867

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Search engines for books can usually tell us which specific pages in a book mention the concepts we seek. A similar ability to search within the contents of games, locating specific moments in their spaces of interactivity, is not yet available. This limits players' ability to find deeply relevant games and game scholars' ability to find moments that advance their arguments. Drawing on computer vision and natural language processing, our work introduces the ability to search within a space of game moments using natural language queries. We describe and evaluate a prototype system which is capable of retrieving moments from two contemporary, narrative-driven games by semantic matching on both the auditory and visual content of scenes.

引用

页数：7