Saliency Detection via Manifold Ranking on Multi-Layer Graph

被引:1
作者
Wang, Suwei [1 ]
Ning, Yang [2 ]
Li, Xuemei [1 ]
Zhang, Caiming [1 ]
机构
[1] Shandong Univ, Sch Software, Jinan 250101, Shandong, Peoples R China
[2] Shandong Jianzhu Univ, Sch Comp Sci & Technol, Jinan 250101, Shandong, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Manifolds; Image edge detection; Image segmentation; Computational modeling; Image color analysis; Manifold ranking; multi-layer graph; superpixel algorithm; saliency detection; OBJECT DETECTION;
D O I
10.1109/ACCESS.2023.3347812
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Saliency detection is increasingly a crucial task in the computer vision area. In previous graph-based saliency detection, superpixels are usually regarded as the primary processing units to enhance computational efficiency. Nevertheless, most methods do not take into account the potential impact of errors in superpixel segmentation, which may result in incorrect saliency values. To address this issue, we propose a novel approach that leverages the diversity of superpixel algorithms and constructs a multi-layer graph. Specifically, we segment the input image into multiple sets by different superpixel algorithms. Through connections within and connections between these superpixel sets, we can mitigate the errors caused by individual algorithms through collaborative solutions. In addition to spatial proximity, we also consider feature similarity in the process of graph construction. Connecting superpixels that are similar in feature space can force them to obtain consistent saliency values, thus addressing challenges brought by the scattered spatial distribution and the uneven internal appearance of salient objects. Additionally, we use the two-stage manifold ranking to compute the saliency value of each superpixel, which includes a background-based ranking and a foreground-based ranking. Finally, we employ a mean-field-based propagation method to refine the saliency map iteratively and achieve smoother results. To evaluate the performance of our approach, we compare our work with multiple advanced methods in four datasets quantitatively and qualitatively.
引用
收藏
页码:6615 / 6627
页数:13
相关论文
共 53 条
[1]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[2]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Jiang, Huaizu ;
Li, Jia .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5706-5722
[3]   A UA-net based Salient Object Detection Method for UAV [J].
Chen, Lingfeng ;
Liu, Gan ;
Tan, Ying ;
Sun, Zhe ;
Ge, Hangli ;
Dian, Feng ;
Zhu, Chi .
2021 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND BIOMIMETICS (IEEE-ROBIO 2021), 2021, :1662-1667
[4]   Improved seam carving combining with 3D saliency for image retargeting [J].
Chen, Yanxiang ;
Pan, Yifei ;
Song, Minglong ;
Wang, Meng .
NEUROCOMPUTING, 2015, 151 :645-653
[5]   Global Contrast Based Salient Region Detection [J].
Cheng, Ming-Ming ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Torr, Philip H. S. ;
Hu, Shi-Min .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) :569-582
[6]   Saliency Detection via a Multiple Self-Weighted Graph-Based Manifold Ranking [J].
Deng, Cheng ;
Yang, Xu ;
Nie, Feiping ;
Tao, Dapeng .
IEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22 (04) :885-896
[7]   Structure-measure: A New Way to Evaluate Foreground Maps [J].
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Liu, Yun ;
Li, Tao ;
Borji, Ali .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4558-4567
[8]   Trustful Internet of Surveillance Things Based on Deeply Represented Visual Co-Saliency Detection [J].
Gao, Zhifan ;
Xu, Chenchu ;
Zhang, Heye ;
Li, Shuo ;
de Albuquerque, Victor Hugo C. .
IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (05) :4092-4100
[9]   Saliency-Aware Video Compression [J].
Hadizadeh, Hadi ;
Bajic, Ivan V. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2014, 23 (01) :19-33
[10]  
Harel J, 2006, Advances in neural information processing systems, P545