Saliency Detection via Manifold Ranking on Multi-Layer Graph

被引:1
作者
Wang, Suwei [1 ]
Ning, Yang [2 ]
Li, Xuemei [1 ]
Zhang, Caiming [1 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250101, Shandong, Peoples R China
[2] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Manifolds; Image edge detection; Image segmentation; Computational modeling; Image color analysis; Manifold ranking; multi-layer graph; superpixel algorithm; saliency detection; OBJECT DETECTION;
D O I
10.1109/ACCESS.2023.3347812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Saliency detection is increasingly a crucial task in the computer vision area. In previous graph-based saliency detection, superpixels are usually regarded as the primary processing units to enhance computational efficiency. Nevertheless, most methods do not take into account the potential impact of errors in superpixel segmentation, which may result in incorrect saliency values. To address this issue, we propose a novel approach that leverages the diversity of superpixel algorithms and constructs a multi-layer graph. Specifically, we segment the input image into multiple sets by different superpixel algorithms. Through connections within and connections between these superpixel sets, we can mitigate the errors caused by individual algorithms through collaborative solutions. In addition to spatial proximity, we also consider feature similarity in the process of graph construction. Connecting superpixels that are similar in feature space can force them to obtain consistent saliency values, thus addressing challenges brought by the scattered spatial distribution and the uneven internal appearance of salient objects. Additionally, we use the two-stage manifold ranking to compute the saliency value of each superpixel, which includes a background-based ranking and a foreground-based ranking. Finally, we employ a mean-field-based propagation method to refine the saliency map iteratively and achieve smoother results. To evaluate the performance of our approach, we compare our work with multiple advanced methods in four datasets quantitatively and qualitatively.
引用
收藏
页码:6615 / 6627
页数:13
相关论文
共 53 条
[31]   Graph-based saliency detection using a learning joint affinity matrix [J].
Wang, Fan ;
Peng, Guohua .
NEUROCOMPUTING, 2021, 458 :33-46
[32]   PISA: Pixelwise Image Saliency by Aggregating Complementary Appearance Contrast Measures With Edge-Preserving Coherence [J].
Wang, Keze ;
Lin, Liang ;
Lu, Jiangbo ;
Li, Chenglong ;
Shi, Keyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (10) :3019-3033
[33]   Learning to Detect Salient Objects with Image-level Supervision [J].
Wang, Lijun ;
Lu, Huchuan ;
Wang, Yifan ;
Feng, Mengyang ;
Wang, Dong ;
Yin, Baocai ;
Ruan, Xiang .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :3796-3805
[34]  
Wang LJ, 2015, PROC CVPR IEEE, P3183, DOI 10.1109/CVPR.2015.7298938
[35]   GraB: Visual Saliency via Novel Graph Model and Background Priors [J].
Wang, Qiaosong ;
Zheng, Wen ;
Piramuthu, Robinson .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :535-543
[36]   Geodesic Saliency Using Background Priors [J].
Wei, Yichen ;
Wen, Fang ;
Zhu, Wangjiang ;
Sun, Jian .
COMPUTER VISION - ECCV 2012, PT III, 2012, 7574 :29-42
[37]   What is and What is not a Salient Object? Learning Salient Object Detector by Ensembling Linear Exemplar Regressors [J].
Xia, Changqun ;
Li, Jia ;
Chen, Xiaowu ;
Zheng, Anlin ;
Zhang, Yu .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :4399-4407
[38]   Hierarchical Saliency Detection [J].
Yan, Qiong ;
Xu, Li ;
Shi, Jianping ;
Jia, Jiaya .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :1155-1162
[39]   Saliency Detection via Graph-Based Manifold Ranking [J].
Yang, Chuan ;
Zhang, Lihe ;
Lu, Huchuan ;
Ruan, Xiang ;
Yang, Ming-Hsuan .
2013 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2013, :3166-3173
[40]  
Yang H., 2017, Advances in Multimedia Information Processing-PCM 2017 (Lecture Notes in Computer Science, P45