RGB-T Image Saliency Detection via Collaborative Graph Learning

被引:182
作者
Tu, Zhengzheng [1 ]
Xia, Tian [1 ]
Li, Chenglong [1 ,2 ]
Wang, Xiaoxiao [1 ]
Ma, Yan [1 ]
Tang, Jin [1 ]
机构
[1] Anhui Univ, Sch Comp Sci & Technol, Minist Educ, Key Lab Intelligent Comp & Signal Proc, Hefei 230601, Peoples R China
[2] Anhui Univ, Inst Phys Sci & Informat Technol, Hefei 230601, Peoples R China
关键词
Image saliency detection; RGB-thermal fusion; Collaborative graph; Joint optimization; Benchmark dataset; OBJECT DETECTION;
D O I
10.1109/TMM.2019.2924578
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Image saliency detection is an active research topic in the community of computer vision and multimedia. Fusing complementary RGB and thermal infrared data has been proven to be effective for image saliency detection. In this paper, we propose an effective approach for RGB-T image saliency detection. Our approach relies on a novel collaborative graph learning algorithm. In particular, we take superpixels as graph nodes, and collaboratively use hierarchical deep features to jointly learn graph affinity and node saliency in a unified optimization framework. Moreover, we contribute a more challenging dataset for the purpose of RGB-T image saliency detection, which contains 1000 spatially aligned RGB-T image pairs and their ground truth annotations. Extensive experiments on the public dataset and the newly created dataset suggest that the proposed approach performs favorably against the state-of-the-art RGB-T saliency detection methods.
引用
收藏
页码:160 / 173
页数:14
相关论文
共 44 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[3]  
[Anonymous], 2006, Advances in neural information processing systems
[4]  
[Anonymous], 2011, Advances in Neural Information Processing Systems
[5]  
[Anonymous], 2018, ARXIV180508982
[6]   Smooth Neighborhood Structure Mining on Multiple Affinity Graphs with Applications to Context-Sensitive Similarity [J].
Bai, Song ;
Sun, Shaoyan ;
Bai, Xiang ;
Zhang, Zhaoxiang ;
Tian, Qi .
COMPUTER VISION - ECCV 2016, PT II, 2016, 9906 :592-608
[7]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Sihite, Dicky N. ;
Itti, Laurent .
COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 :414-429
[8]  
Chao M., 2019, IEEE Trans. Pattern Anal. Mach. Intell.
[9]   Bilevel Feature Learning for Video Saliency Detection [J].
Chen, Chenglizhao ;
Li, Shuai ;
Qin, Hong ;
Pan, Zhenkuan ;
Yang, Guowei .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (12) :3324-3336
[10]   Object-Based Visual Saliency via Laplacian Regularized Kernel Regression [J].
Dou, Hao ;
Ming, Delie ;
Yang, Zhi ;
Pan, Zhihong ;
Li, Yansheng ;
Tian, Jinwen .
IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (08) :1718-1729