Graph-based saliency detection using a learning joint affinity matrix

被引:5
作者
Wang, Fan [1 ]
Peng, Guohua [1 ]
机构
[1] Northwestern Polytech Univ Shaanxi, Sch Nat & Appl Sci, Xian, Peoples R China
关键词
Saliency detection; Learning  joint affinity matrix; Cross-view diffusion  processing; Diffusion-based compactness; Single-layer cellular automata; OBJECT DETECTION; VISUAL-ATTENTION; MANIFOLD;
D O I
10.1016/j.neucom.2021.03.131
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The graph model is a reliable propagation mechanism in saliency detection, saliency value propagation diffusion results between any two nodes are determined merely by defining an effect affinity matrix. Most existing methods generally calculamatrix using mean values of single or multiple feature vectors, not fully exploit the diversity and consistency of multi-view features, may produce poor foreground uniformity and completeness in the complex scene. Multi-views should share an affinity matrix as well as complement each other. In this paper, we propose a graph-based saliency detection with a learning joint affinity matrix. First, we capture multiple appearance features from the image and generate a learning joint affinity matrix based on low-rank representation. Then, for computing an effect affinity matrix, we linearly integrate the traditional affinity matrix and learning joint affinity matrix, helping to construct an affinity graph for diffusion-based compactness. Finally, to effectively optimize the initial saliency map, we diffuse the learning joint affinity matrix and traditional impact factor matrix via cross-view diffusion processing, which begets an approving advantage for single-layer cellular automata. Results on three benchmark datasets demonstrate that our proposed method shows the best performance against nine state-of-the-art models. (c) 2021 Elsevier B.V. All rights reserved.
引用
收藏
页码:33 / 46
页数:14
相关论文
共 67 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   ALGORITHM - SOLUTION OF MATRIX EQUATION AX+XB = C [J].
BARTELS, RH ;
STEWART, GW .
COMMUNICATIONS OF THE ACM, 1972, 15 (09) :820-&
[3]  
Borji Ali, 2019, [Computational Visual Media, 计算可视媒体], V5, P117
[4]  
Borji A, 2012, PROC CVPR IEEE, P478, DOI 10.1109/CVPR.2012.6247711
[5]  
Chang KY, 2011, IEEE I CONF COMP VIS, P914, DOI 10.1109/ICCV.2011.6126333
[6]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[7]   Ranking on Data Manifold with Sink Points [J].
Cheng, Xue-Qi ;
Du, Pan ;
Guo, Jiafeng ;
Zhu, Xiaofei ;
Chen, Yixin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2013, 25 (01) :177-191
[8]   Robust manifold-preserving diffusion-based saliency detection by adaptive weight construction [J].
Fu, Keren ;
Gu, Irene Y. H. ;
Gong, Chen ;
Yang, Jie .
NEUROCOMPUTING, 2016, 175 :336-347
[9]   Context-Aware Saliency Detection [J].
Goferman, Stas ;
Zelnik-Manor, Lihi ;
Tal, Ayellet .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (10) :1915-1926
[10]   Video Saliency Detection Using Object Proposals [J].
Guo, Fang ;
Wang, Wenguan ;
Shen, Jianbing ;
Shao, Ling ;
Yang, Jian ;
Tao, Dacheng ;
Tang, Yuan Yan .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (11) :3159-3170