Sketch-based manga retrieval using manga109 dataset

被引:976
作者
Matsui, Yusuke [1 ]
Ito, Kota [1 ]
Aramaki, Yuji [1 ]
Fujimoto, Azuma [1 ]
Ogawa, Toru [1 ]
Yamasaki, Toshihiko [2 ,3 ]
Aizawa, Kiyoharu [4 ]
机构
[1] Univ Tokyo, Tokyo, Japan
[2] Univ Tokyo, Grad Sch Frontier Sci, Dept Frontier Informat, Tokyo, Japan
[3] Univ Tokyo, Grad Sch Informat Sci & Technol, Dept Informat & Commun Engn, Tokyo, Japan
[4] Univ Tokyo, Dept Informat & Commun Engn, Tokyo, Japan
关键词
SCALE;
D O I
10.1007/s11042-016-4020-z
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Manga (Japanese comics) are popular worldwide. However, current e-manga archives offer very limited search support, i.e., keyword-based search by title or author. To make the manga search experience more intuitive, efficient, and enjoyable, we propose a manga-specific image retrieval system. The proposed system consists of efficient margin labeling, edge orientation histogram feature description with screen tone removal, and approximate nearest-neighbor search using product quantization. For querying, the system provides a sketch-based interface. Based on the interface, two interactive reranking schemes are presented: relevance feedback and query retouch. For evaluation, we built a novel dataset of manga images, Manga109, which consists of 109 comic books of 21,142 pages drawn by professional manga artists. To the best of our knowledge, Manga109 is currently the biggest dataset of manga images available for research. Experimental results showed that the proposed framework is efficient and scalable (70 ms from 21,142 pages using a single computer with 204 MB RAM).
引用
收藏
页码:21811 / 21838
页数:28
相关论文
共 73 条
[1]   Measuring the Objectness of Image Windows [J].
Alexe, Bogdan ;
Deselaers, Thomas ;
Ferrari, Vittorio .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2189-2202
[2]  
[Anonymous], 2005, PROC CVPR IEEE
[3]  
[Anonymous], P BMVC
[4]  
[Anonymous], P CVPR
[5]  
[Anonymous], P CVPR
[6]  
[Anonymous], P CVPR
[7]  
[Anonymous], 2016, ARXIV160600185
[8]  
[Anonymous], P CVPR
[9]  
[Anonymous], 2013, P ICDAR
[10]  
[Anonymous], P CVPR