Multimedia Retrieval Through Unsupervised Hypergraph-Based Manifold Ranking

被引:37
作者
Guimaraes Pedronette, Daniel Carlos [1 ]
Valem, Lucas Pascotti [1 ]
Almeida, Jurandy [2 ]
Tones, Ricardo da S. [3 ]
机构
[1] State Univ Sao Paulo, Dept Stat Appl Maths & Comp, BR-13506900 Rio Claro, Brazil
[2] Univ Fed Sao Paulo, Inst Sci & Technol, BR-12231280 Sao Jose Dos Campos, Brazil
[3] Univ Estadual Campinas, Inst Comp, RECOD Lab, BR-13083852 Campinas, SP, Brazil
基金
巴西圣保罗研究基金会;
关键词
Multimedia; retrieval; ranking; unsupervised; manifold; hypergraph; IMAGE RETRIEVAL; DIFFUSION PROCESS; RE-RANKING; COLOR; RECOGNITION; SIMILARITY; SCALE; GRAPH; REPRESENTATIONS; CLASSIFICATION;
D O I
10.1109/TIP.2019.2920526
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Accurately ranking images and multimedia objects are of paramount relevance in many retrieval and learning tasks. Manifold learning methods have been investigated for ranking mainly due to their capacity of taking into account the intrinsic global manifold structure. In this paper, a novel manifold ranking algorithm is proposed based on the hypergraphs for unsupervised multimedia retrieval tasks. Different from traditional graph-based approaches, which represent only pairwise relationships, hypergraphs are capable of modeling similarity relationships among a set of objects. The proposed approach uses the hyperedges for constructing a contextual representation of data samples and exploits the encoded information for deriving a more effective similarity function. An extensive experimental evaluation was conducted on nine public datasets including diverse retrieval scenarios and multimedia content. Experimental results demonstrate that high effectiveness gains can be obtained in comparison with the state-of-the-art methods.
引用
收藏
页码:5824 / 5838
页数:15
相关论文
共 105 条
[71]  
Pass G, 1996, Proceedings of the 4th ACM International Conference on Multimedia, MULTIMEDIA 1996, P65, DOI DOI 10.1145/244130.244148
[72]   Convolutional Patch Representations for Image Retrieval: An Unsupervised Approach [J].
Paulin, Mattis ;
Mairal, Julien ;
Douze, Matthijs ;
Harchaoui, Zaid ;
Perronnin, Florent ;
Schmid, Cordelia .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2017, 121 (01) :149-168
[73]   Query Adaptive Similarity for Large Scale Object Retrieval [J].
Qin, Danfeng ;
Wengert, Christian ;
van Gool, Luc .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1610-1617
[74]   Revisiting Oxford and Paris: Large-Scale Image Retrieval Benchmarking [J].
Radenovic, Filip ;
Iscen, Ahmet ;
Tolias, Giorgos ;
Avrithis, Yannis ;
Chum, Ondrej .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :5706-5715
[75]   CNN Features off-the-shelf: an Astounding Baseline for Recognition [J].
Razavian, Ali Sharif ;
Azizpour, Hossein ;
Sullivan, Josephine ;
Carlsson, Stefan .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2014, :512-519
[76]  
Stehling R. O., 2002, Proceedings of the Eleventh International Conference on Information and Knowledge Management. CIKM 2002, P102, DOI 10.1145/584792.584812
[77]  
Sun L., 2008, P 14 ACM SIGKDD INT, P668, DOI DOI 10.1145/1401890.1401971
[78]   Local residual similarity for image re-ranking [J].
Sun, Shaoyan ;
Li, Ying ;
Zhou, Wengang ;
Tian, Qi ;
Li, Houqiang .
INFORMATION SCIENCES, 2017, 417 :143-153
[79]   COLOR INDEXING [J].
SWAIN, MJ ;
BALLARD, DH .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1991, 7 (01) :11-32
[80]  
Tao B, 2000, J VIS COMMUN IMAGE R, V11, P327, DOI 10.1006/jvci.1999.0448