Multi-feature Late Fusion for Image Tagging

被引:3
作者
Liu, Xi [1 ]
Liu, Rujie [1 ]
Cao, Qiong [1 ]
Li, Fei [1 ]
机构
[1] Fujitsu Res & Dev Ctr Co LTD, Beijing, Peoples R China
来源
2013 SECOND IAPR ASIAN CONFERENCE ON PATTERN RECOGNITION (ACPR 2013) | 2013年
关键词
Late fusion; Image tagging; Multi-feature; Tag relevance; Low rank; ANNOTATION;
D O I
10.1109/ACPR.2013.25
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Image tagging plays a critical role in image indexing and retrieval and it has gained more and more attention along with the increasing availability of large quantities of web images. However, most of current tagging methods only utilize single feature type, while combining multiple types of features has been proved to be effective for image analysis. In this paper, we propose a multi-feature late fusion method for image tagging. For an image, we first learn several scores with regard to each tag by using different single features or combinations of single features based on a tag relevance learner. Then we learn an optimal combination weight for each tag score and linearly combine all the tag scores with the learned weights. Finally, a low-rank tag pairwise matrix is learned with the linearly combined tag scores and a robust tag score is recovered from the low-rank matrix. The tags with the largest scores are regarded as the predicted tags. We compare our approach with several multi-feature fusion techniques over a real-world dataset NUS-WIDE and show the effectiveness of the proposed multi-feature fusion method.
引用
收藏
页码:34 / 37
页数:4
相关论文
共 17 条
  • [1] [Anonymous], 2012, CVPR
  • [2] [Anonymous], CIVR
  • [3] [Anonymous], 2010, NIPS
  • [4] [Anonymous], 2004, ICML
  • [5] [Anonymous], 2009, CIVR
  • [6] Supervised learning of semantic classes for image annotation and retrieval
    Carneiro, Gustavo
    Chan, Antoni B.
    Moreno, Pedro J.
    Vasconcelos, Nuno
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2007, 29 (03) : 394 - 410
  • [7] Datta R., 2007, ACM MULTIMEDIA, P393
  • [8] Gehler Peter., 2009, ICCV
  • [9] Gleich D. F., 2011, SIGKDD
  • [10] Jiang X., 2010, MATH PROGRAMMING, V127