Saliency Detection via a Multiple Self-Weighted Graph-Based Manifold Ranking

被引:51
作者
Deng, Cheng [1 ]
Yang, Xu [1 ]
Nie, Feiping [2 ,3 ]
Tao, Dapeng [4 ]
机构
[1] Xidian Univ, Sch Elect Engn, Xian 710071, Peoples R China
[2] Northwestern Polytech Univ, Sch Comp Sci, Xian 710072, Peoples R China
[3] Northwestern Polytech Univ, Ctr OPT IMagery Anal & Learning, Xian 710072, Peoples R China
[4] Yunnan Univ, Sch Informat Sci & Engn, Kunming 650091, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Feature extraction; Manifolds; Image color analysis; Task analysis; Image reconstruction; Convolutional neural nets; multiple graphs manifold learning; self-adaptive weight; OBJECT DETECTION; MODEL;
D O I
10.1109/TMM.2019.2934833
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
As an important task in the process of image understanding and analysis, saliency detection has recently received increasing attention. In this paper, we propose an efficient multiple self-weighted graph-based manifold ranking method to construct salient maps. First, we extract several different views of features from superpixels, and generate original salient regions as foreground and background cues using boundary information via multiple graph-based manifold ranking. Furthermore, a set of hyperparameters is learned to distinguish the importance between different graphs, which can be viewed as an adaptive weighting of each graph, and then a centroid graph is generated by using these self-weighted multiple graphs. An iterative algorithm is proposed to simultaneously optimize the hyperparameters as well as the centroid graph connection. Thus, an ideal centroid graph can be obtained, offering a more clear profile of the separated structure. Finally, the saliency maps can be produced with an approximate binary image from the manifold ranking. Extensive experiments have demonstrated our method consistently achieves superior detection performance than several state-of-the-arts.
引用
收藏
页码:885 / 896
页数:12
相关论文
共 66 条
[1]   SLIC Superpixels Compared to State-of-the-Art Superpixel Methods [J].
Achanta, Radhakrishna ;
Shaji, Appu ;
Smith, Kevin ;
Lucchi, Aurelien ;
Fua, Pascal ;
Suesstrunk, Sabine .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2012, 34 (11) :2274-2281
[2]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Jiang, Huaizu ;
Li, Jia .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5706-5722
[3]   Iteratively Reweighted Least Squares Minimization for Sparse Recovery [J].
Daubechies, Ingrid ;
Devore, Ronald ;
Fornasier, Massimo ;
Guentuerk, C. Sinan .
COMMUNICATIONS ON PURE AND APPLIED MATHEMATICS, 2010, 63 (01) :1-38
[4]   Unsupervised Semantic-Preserving Adversarial Hashing for Image Search [J].
Deng, Cheng ;
Yang, Erkun ;
Liu, Tongliang ;
Li, Jie ;
Liu, Wei ;
Tao, Dacheng .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (08) :4032-4044
[5]   Active multi-kernel domain adaptation for hyperspectral image classification [J].
Deng, Cheng ;
Liu, Xianglong ;
Li, Chao ;
Tao, Dacheng .
PATTERN RECOGNITION, 2018, 77 :306-315
[6]   Weakly Supervised Multi-Graph Learning for Robust Image Reranking [J].
Deng, Cheng ;
Ji, Rongrong ;
Tao, Dacheng ;
Gao, Xinbo ;
Li, Xuelong .
IEEE TRANSACTIONS ON MULTIMEDIA, 2014, 16 (03) :785-795
[7]  
Deng ZJ, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P684
[8]   Human Visual System-Based Saliency Detection for High Dynamic Range Content [J].
Dong, Yuanyuan ;
Pourazad, Mahsa T. ;
Nasiopoulos, Panos .
IEEE TRANSACTIONS ON MULTIMEDIA, 2016, 18 (04) :549-562
[9]  
Duchi J., 2008, P 25 INT C MACH LEAR, P272, DOI [DOI 10.1145/1390156.1390191, 10.1145/1390156.1390191]
[10]   Structure-measure: A New Way to Evaluate Foreground Maps [J].
Fan, Deng-Ping ;
Cheng, Ming-Ming ;
Liu, Yun ;
Li, Tao ;
Borji, Ali .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :4558-4567