SalNet: Edge Constraint Based End-to-End Model for Salient Object Detection

被引:7
作者
Han, Le [1 ,2 ]
Li, Xuelong [1 ]
Dong, Yongsheng [1 ]
机构
[1] Chinese Acad Sci, Xian Inst Opt & Precis Mech, Ctr OpT IMagery Anal & Learning OPTIMAL, Xian 710119, Shaanxi, Peoples R China
[2] Univ Chinese Acad Sci, 19A Yuquanlu, Beijing 100049, Peoples R China
来源
PATTERN RECOGNITION AND COMPUTER VISION (PRCV 2018), PT IV | 2018年 / 11259卷
基金
中国国家自然科学基金;
关键词
Salient object detection; U-Net; Auto-encoder; Image convolution;
D O I
10.1007/978-3-030-03341-5_16
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Salient object detection is a fundamental task in computer vision and pattern recognition. And it has been investigated by many researchers in many fields for a long time. Numerous salient object detection models based on deep learning have been designed in recent years. However, the saliency maps extracted by most of the existing models are blurry or have irregular edges. To alleviate these problems, we propose a novel approach named SalNet to detect the salient objects accurately in this paper. The architecture of the SalNet is an U-Net which can combine the features of the shallow and deep layers. Moreover, a new objective function based on the image convolution is further proposed to refine the edges of saliency maps by using a constraint on the L1 distance between edge information of the ground-truth and the saliency maps. Finally, we evaluate our proposed SalNet on benchmark datasets and compare it with the state-of-the-art algorithms. Experimental results demonstrate that the SalNet is effective and outperforms several representative methods in salient object detection task.
引用
收藏
页码:186 / 198
页数:13
相关论文
共 29 条
[1]   SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation [J].
Badrinarayanan, Vijay ;
Kendall, Alex ;
Cipolla, Roberto .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (12) :2481-2495
[2]   Salient Object Detection: A Benchmark [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Jiang, Huaizu ;
Li, Jia .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (12) :5706-5722
[3]   Salient object detection: A survey [J].
Borji, Ali ;
Cheng, Ming-Ming ;
Hou, Qibin ;
Jiang, Huaizu ;
Li, Jia .
COMPUTATIONAL VISUAL MEDIA, 2019, 5 (02) :117-150
[4]   What is a Salient Object? A Dataset and a Baseline Model for Salient Object Detection [J].
Borji, Ali .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2015, 24 (02) :742-756
[5]   Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study [J].
Borji, Ali ;
Sihite, Dicky N. ;
Itti, Laurent .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2013, 22 (01) :55-69
[6]   Global Contrast based Salient Region Detection [J].
Cheng, Ming-Ming ;
Zhang, Guo-Xin ;
Mitra, Niloy J. ;
Huang, Xiaolei ;
Hu, Shi-Min .
2011 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2011, :409-416
[7]   Background Prior-Based Salient Object Detection via Deep Reconstruction Residual [J].
Han, Junwei ;
Zhang, Dingwen ;
Hu, Xintao ;
Guo, Lei ;
Ren, Jinchang ;
Wu, Feng .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2015, 25 (08) :1309-1321
[8]   Eye movements in natural behavior [J].
Hayhoe, M ;
Ballard, D .
TRENDS IN COGNITIVE SCIENCES, 2005, 9 (04) :188-194
[9]   Reducing the dimensionality of data with neural networks [J].
Hinton, G. E. ;
Salakhutdinov, R. R. .
SCIENCE, 2006, 313 (5786) :504-507
[10]  
Isola P., 2017, ARXIV