Adaptive Hypergraph Embedded Semi-Supervised Multi-Label Image Annotation

被引:56
作者
Tang, Chang [1 ]
Liu, Xinwang [2 ]
Wang, Pichao [3 ]
Zhang, Changqing [4 ]
Li, Miaomiao [2 ]
Wang, Lizhe [1 ]
机构
[1] China Univ Geosci, Sch Comp Sci, Wuhan 430074, Hubei, Peoples R China
[2] Natl Univ Def Technol, Sch Comp Sci, Changsha 410073, Hunan, Peoples R China
[3] Alibaba Grp US Inc, San Mateo, CA 94402 USA
[4] Tianjin Univ, Sch Comp Sci & Technol, Tianjin 300072, Peoples R China
基金
美国国家科学基金会;
关键词
Image annotation; Semisupervised learning; Semantics; Computational modeling; Task analysis; Training; Computer science; Multi-label image annotation; hypergraph learning; semi-supervised learning; feature projection; CLASSIFICATION; RECOGNITION; MODEL;
D O I
10.1109/TMM.2019.2909860
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Multilabel image annotation attracts a lot of research interest due to its practicability in multimedia and computer vision fields, while the need for a large amount of labeled training data to achieve promising performance makes it a challenging task. Fortunately, unlabeled and relevant data are widely available and these data can be used to serve the annotation task. To this end, we propose a novel adaptive hypergraph learning (AHL) method for multilabel image annotation in a semisupervised way, in which both the limited labeled data and abundant unlabeled data are utilized to facilitate the annotation performance. In detail, we seek a multilabel propagation scheme by learning a hypergraph which is used to preserve the local geometric structures of data in a high-order manner. Meanwhile, a feature projection is integrated into AHL to obtain a latent feature space where unlabeled instances can be effectively and robustly assigned with multiple labels. Experiments on six widely used image datasets are conducted to evaluate our model and the results demonstrate that the proposed AHL outperforms other state-of-the-art semisupervised methods.
引用
收藏
页码:2837 / 2849
页数:13
相关论文
共 82 条
[21]  
Feng SL, 2004, PROC CVPR IEEE, P1002
[22]   Concurrent Single-Label Image Classification and Annotation via Efficient Multi-Layer Group Sparse Coding [J].
Gao, Shenghua ;
Chia, Liang-Tien ;
Tsang, Ivor Wai-Hung ;
Ren, Zhixiang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (03) :762-771
[23]   Hyperspectral Image Classification Through Bilayer Graph-Based Learning [J].
Gao, Yue ;
Ji, Rongrong ;
Cui, Peng ;
Dai, Qionghai ;
Hua, Gang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (07) :2769-2778
[24]  
Ghahramani Z., 2003, ICML, P912
[25]   A discriminative kernel-based model to rank images from text queries [J].
Grangier, David ;
Bengio, Samy .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2008, 30 (08) :1371-1384
[26]   TagProp: Discriminative Metric Learning in Nearest Neighbor Models for Image Auto-Annotation [J].
Guillaumin, Matthieu ;
Mensink, Thomas ;
Verbeek, Jakob ;
Schmid, Cordelia .
2009 IEEE 12TH INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2009, :309-316
[27]  
Guo BL, 2016, IEEE DATA MINING, P919, DOI [10.1109/ICDM.2016.0113, 10.1109/ICDM.2016.48]
[28]   Deep Residual Learning for Image Recognition [J].
He, Kaiming ;
Zhang, Xiangyu ;
Ren, Shaoqing ;
Sun, Jian .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :770-778
[29]   Joint and Progressive Learning from High-Dimensional Data for Multi-label Classification [J].
Hong, Danfeng ;
Yokoya, Naoto ;
Xu, Jian ;
Zhu, Xiaoxiang .
COMPUTER VISION - ECCV 2018, PT VIII, 2018, 11212 :478-493
[30]   RETRACTED: PKI and secret key based mobile IP security (Retracted Article) [J].
Hu, Dong ;
Zhou, Dong ;
Li, Ping .
2006 INTERNATIONAL CONFERENCE ON COMMUNICATIONS, CIRCUITS AND SYSTEMS PROCEEDINGS, VOLS 1-4: VOL 1: SIGNAL PROCESSING, 2006, :1605-+