Retrieving Videogame Moments with Natural Language Queries

被引：2

作者：

Zhang, Xiaoxuan ^{[1
]}

Smith, Adam M. ^{[1
]}

机构：

[1] Univ Calif Santa Cruz, Dept Computat Media, Santa Cruz, CA 95064 USA

来源：

PROCEEDINGS OF THE 14TH INTERNATIONAL CONFERENCE ON THE FOUNDATIONS OF DIGITAL GAMES (FDG'19) | 2019年

关键词：

videogames; content-based retrieval; natural language processing; image recognition;

D O I：

10.1145/3337722.3341867

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Search engines for books can usually tell us which specific pages in a book mention the concepts we seek. A similar ability to search within the contents of games, locating specific moments in their spaces of interactivity, is not yet available. This limits players' ability to find deeply relevant games and game scholars' ability to find moments that advance their arguments. Drawing on computer vision and natural language processing, our work introduces the ability to search within a space of game moments using natural language queries. We describe and evaluate a prototype system which is capable of retrieving moments from two contemporary, narrative-driven games by semantic matching on both the auditory and visual content of scenes.

引用

页数：7

共 21 条

[1]

Anderson Barrett, 2019, P 14 INT C FDN DIG G

[2]

[Anonymous], 2016, CoRR abs/1512.00567, DOI DOI 10.1109/CVPR.2016.308

[3]

[Anonymous], 1999, Visual Information Retrieval

[4]

Bojanowski Piotr, 2017, Trans. Assoc. Comput. Linguist., V5, P135, DOI DOI 10.1162/TACL_A_00051

[5]

Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848

[6]

Dontnod Entertainment, 2015, LIF IS STRANG

[7]

Genette Gerard., 1987, Paratexts: Thresholds of Interpretation

[8]

Github Engineering, 2018, NAT LANG SEM COD SEA

[9]

Knees Peter, 2007, 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, P447, DOI 10.1145/1277741.1277818

[10] Combining textual and visual cues for content-based image retrieval on the World Wide Web [J].

La Cascia, M ;

Sethi, S ;

Sclaroff, S .

IEEE WORKSHOP ON CONTENT-BASED ACCESS OF IMAGE AND VIDEO LIBRARIES - PROCEEDINGS, 1998, :24-28

← 1 2 3 →