Sketch-Based Image Retrieval: Benchmark and Bag-of-Features Descriptors

被引:225
作者
Eitz, Mathias [1 ]
Hildebrand, Kristian [1 ]
Boubekeur, Tamy [2 ]
Alexa, Marc [1 ]
机构
[1] Tech Univ Berlin, Fak Elektrotech & Informat 4, Sekretariat EN 7 1, D-10587 Berlin, Germany
[2] Telecom ParisTech CNRS, TSI, F-75013 Paris, France
关键词
Image/video retrieval; image databases; benchmarking; NUMBER; SHAPE;
D O I
10.1109/TVCG.2010.266
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
We introduce a benchmark for evaluating the performance of large-scale sketch-based image retrieval systems. The necessary data are acquired in a controlled user study where subjects rate how well given sketch/image pairs match. We suggest how to use the data for evaluating the performance of sketch-based image retrieval systems. The benchmark data as well as the large image database are made publicly available for further studies of this type. Furthermore, we develop new descriptors based on the bag-of-features approach and use the benchmark to demonstrate that they significantly outperform other descriptors in the literature.
引用
收藏
页码:1624 / 1636
页数:13
相关论文
共 31 条
[1]   Idiosyncratic characteristics of saccadic eye movements when viewing different visual environments [J].
Andrews, TJ ;
Coppola, DM .
VISION RESEARCH, 1999, 39 (17) :2947-2953
[2]  
[Anonymous], 2002, Introduction to MPEG-7: Multimedia Content Description Interface
[3]   Shape matching and object recognition using shape contexts [J].
Belongie, S ;
Malik, J ;
Puzicha, J .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2002, 24 (04) :509-522
[5]   Sketch-based image matching using angular partitioning [J].
Chalechale, A ;
Naghdy, G ;
Mertins, A .
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART A-SYSTEMS AND HUMANS, 2005, 35 (01) :28-41
[6]   Storyboard sketches for content based video retrieval [J].
Collomosse, J. P. ;
McNeill, G. ;
Qian, Y. .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :245-252
[7]   Histograms of oriented gradients for human detection [J].
Dalal, N ;
Triggs, B .
2005 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, VOL 1, PROCEEDINGS, 2005, :886-893
[8]   Image retrieval: Ideas, influences, and trends of the new age [J].
Datta, Ritendra ;
Joshi, Dhiraj ;
Li, Jia ;
Wang, James Z. .
ACM COMPUTING SURVEYS, 2008, 40 (02)
[9]   Do data characteristics change according to the number of scale points used? An experiment using 5-point, 7-point and 10-point scales [J].
Dawes, John .
INTERNATIONAL JOURNAL OF MARKET RESEARCH, 2008, 50 (01) :61-77
[10]   Suggestive contours for conveying shape [J].
DeCarlo, D ;
Finkelstein, A ;
Rusinkiewicz, S ;
Santella, A .
ACM TRANSACTIONS ON GRAPHICS, 2003, 22 (03) :848-855