Reversion Correction and Regularized Random Walk Ranking for Saliency Detection

被引:142
作者
Yuan, Yuchen [1 ]
Li, Changyang [1 ]
Kim, Jinman [1 ]
Cai, Weidong [1 ]
Feng, David Dagan [2 ,3 ]
机构
[1] Univ Sydney, Biomed & Multimedia Informat Technol Res Grp, Sch Informat Technol, Sydney, NSW 2008, Australia
[2] Univ Sydney, BMIT Res Grp, Sydney, NSW 2008, Australia
[3] Shanghai Jiao Tong Univ, MedX Res Inst, Shanghai 200030, Peoples R China
关键词
Reversion correction; regularized random walk ranking; saliency optimization; saliency detection; OBJECT DETECTION; CONTRAST; COLOR;
D O I
10.1109/TIP.2017.2762422
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent saliency detection research, many graphbased algorithms have applied boundary priors as background queries, which may generate completely "reversed" saliency maps if the salient objects are on the image boundaries. Moreover, these algorithms usually depend heavily on pre-processed superpixel segmentation, which may lead to notable degradation in image detail features. In this paper, a novel saliency detection method is proposed to overcome the above issues. First, we propose a saliency reversion correction process, which locates and removes the boundary-adjacent foreground superpixels, and thereby increases the accuracy and robustness of the boundary priorbased saliency estimations. Second, we propose a regularized random walk ranking model, which introduces prior saliency estimation to every pixel in the image by taking both region and pixel image features into account, thus leading to pixeldetailed and superpixel-independent saliency maps. Experiments are conducted on four well-recognized data sets; the results indicate the superiority of our proposed method against 14 state-of-the-art methods, and demonstrate its general extensibility as a saliency optimization algorithm. We further evaluate our method on a new data set comprised of images that we define as boundary adjacent object saliency, on which our method performs better than the comparison methods.
引用
收藏
页码:1311 / 1322
页数:12
相关论文
共 50 条
[1]   Regularized Random Walk Ranking for Co-Saliency Detection in images [J].
Bardhan, Sayanti ;
Jacob, Shibu .
ELEVENTH INDIAN CONFERENCE ON COMPUTER VISION, GRAPHICS AND IMAGE PROCESSING (ICVGIP 2018), 2018,
[2]   Robust Saliency Detection via Regularized Random Walks Ranking [J].
Li, Changyang ;
Yuan, Yuchen ;
Cai, Weidong ;
Xia, Yong ;
Feng, David Dagan .
2015 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2015, :2710-2717
[3]   Image Saliency Detection Based on Manifold Regularized Random Walk [J].
Wang Lihua ;
Tu Zhengzheng ;
Wang Zeliang .
LASER & OPTOELECTRONICS PROGRESS, 2018, 55 (12)
[4]   Visual Saliency Detection via Prior Regularized Manifold Ranking [J].
Xiao, Yun ;
Jiang, Bo ;
Tu, Zhengzheng ;
Tang, Jin .
COMPUTER VISION, PT III, 2017, 773 :711-722
[5]   VIDEO SALIENCY DETECTION BASED ON RANDOM WALK WITH RESTART [J].
Kim, Jun-Seong ;
Kim, Hansang ;
Sim, Jae-Young ;
Kim, Chang-Su ;
Lee, Sang-Uk .
2013 20TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP 2013), 2013, :2465-2469
[6]   Saliency detection based on background seeds by object proposals and extended random walk [J].
Jian, Muwei ;
Zhao, Runxia ;
Sun, Xin ;
Luo, Hanjiang ;
Zhang, Wenyin ;
Zhang, Huaxiang ;
Dong, Junyu ;
Yin, Yilong ;
Lam, Kin-Man .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2018, 57 :202-211
[7]   Local Regression Ranking for Saliency Detection [J].
Zhang, Ying-Ying ;
Zhang, Shuo ;
Zhang, Ping ;
Song, Hai-Zhen ;
Zhang, Xin-Gang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :1536-1547
[8]   Kernelized Subspace Ranking for Saliency Detection [J].
Wang, Tiantian ;
Zhang, Lihe ;
Lu, Huchuan ;
Sun, Chong ;
Qi, Jinqing .
COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 :450-466
[9]   Spatiotemporal Saliency Detection for Video Sequences Based on Random Walk With Restart [J].
Kim, Hansang ;
Kim, Youngbae ;
Sim, Jae-Young ;
Kim, Chang-Su .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (08) :2552-2564
[10]   Saliency Detection Based on Multi-Level Deep Features and Random Walk [J].
Cui D. ;
Wang M. ;
Li G. ;
Gu G. ;
Li H. .
Li, Gang (lg@ysu.edu.cn), 1600, South China University of Technology (48) :49-55