Bagging-based saliency distribution learning for visual saliency detection

被引:10
作者
Pang, Yu [1 ]
Yu, Xiaosheng [1 ]
Wu, Yunhe [2 ]
Wu, Chengdong [1 ]
Jiang, Yang [1 ]
机构
[1] Northeastern Univ, Fac Robot Sci & Engn, Shenyang 110169, Peoples R China
[2] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Prior knowledge; Bagging method; Saliency distribution learning; Saliency optimization; Prejudgment mechanism; OBJECT DETECTION;
D O I
10.1016/j.image.2020.115928
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Saliency detection is still very challenging in computer vision and image processing. In this paper, we propose a novel visual saliency detection framework via bagging-based saliency distribution learning (BSDL). Given an input image, we firstly segment it into superpixels as basic units. Then two prior knowledge containing background prior and center prior are integrated to generate an initial prior map, which is used to select training samples from all superpixels to train the BSDL model. Specifically, the BSDL contains two stages: In the first stage, we use bagging-based sampling method to train.. saliency classifiers from all training samples... saliency classifiers are used to predict each superpixel saliency value. In the second stage, we aim to learn a saliency distribution model, whose goal is to infer the relationship between each classifier and each superpixel. i.e., for each superpixel, the BSDL not only trains.. saliency classifiers to predict its saliency value, but also infers the reliability of using each saliency classifier to predict its saliency value. As a result, each superpixel's saliency value is determined by its.. prediction saliency values and saliency distribution. After the BSDL, we propose a so called foreground consistency saliency optimization framework (FCSO) to further refine saliency map obtained by BSDL. To improve computation efficiency, a prejudgment rule is proposed to evaluate the quality of saliency map obtained by BSDL, which is used to decide whether the FCSO is needed for input image. Experimental results on four public datasets demonstrate the superiority of the proposed method than other state-of-the-art methods.
引用
收藏
页数:13
相关论文
共 47 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]  
Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
[3]   Improved Robust Video Saliency Detection Based on Long-Term Spatial-Temporal Information [J].
Chen, Chenglizhao ;
Wang, Guotao ;
Peng, Chong ;
Zhang, Xiaowei ;
Qin, Hong .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 :1090-1100
[4]   Bilevel Feature Learning for Video Saliency Detection [J].
Chen, Chenglizhao ;
Li, Shuai ;
Qin, Hong ;
Pan, Zhenkuan ;
Yang, Guowei .
IEEE TRANSACTIONS ON MULTIMEDIA, 2018, 20 (12) :3324-3336
[5]   Video Saliency Detection via Spatial-Temporal Fusion and Low-Rank Coherency Diffusion [J].
Chen, Chenglizhao ;
Li, Shuai ;
Wang, Yongguang ;
Qin, Hong ;
Hao, Aimin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2017, 26 (07) :3156-3170
[6]   Structure-Sensitive Saliency Detection via Multilevel Rank Analysis in Intrinsic Feature Space [J].
Chen, Chenglizhao ;
Li, Shuai ;
Qin, Hong ;
Hao, Aimin .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (08) :2303-2316
[7]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[8]   Depth-aware saliency detection using convolutional neural networks [J].
Ding, Yu ;
Liu, Zhi ;
Huang, Mengke ;
Shi, Ran ;
Wang, Xiangyang .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 61 :1-9
[9]   Learning Discriminative Subspaces on Random Contrasts for Image Saliency Analysis [J].
Fang, Shu ;
Li, Jia ;
Tian, Yonghong ;
Huang, Tiejun ;
Chen, Xiaowu .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2017, 28 (05) :1095-1108
[10]   Label Distribution Learning [J].
Geng, Xin .
IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2016, 28 (07) :1734-1748