Focal Boundary Guided Salient Object Detection

被引:36
|
作者
Wang, Yupei [1 ,2 ]
Zhao, Xin [1 ,2 ]
Hu, Xuecai [3 ,4 ]
Li, Yin [5 ,6 ]
Huang, Kaiqi [2 ,7 ,8 ]
机构
[1] Chinese Acad Sci, Inst Automat, Ctr Res Intelligent Syst & Engn, Beijing 100190, Peoples R China
[2] Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
[3] Chinese Acad Sci, Inst Automat, Ctr Res Intelligent Percept & Comp, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[4] Univ Sci & Technol China, Sch Informat Sci & Technol, Hefei 230026, Anhui, Peoples R China
[5] Univ Wisconsin, Dept Biostat & Med Informat, Madison, WI 53706 USA
[6] Univ Wisconsin, Dept Comp Sci, 1210 W Dayton St, Madison, WI 53706 USA
[7] Chinese Acad Sci, Inst Automat, Ctr Res Intelligent Syst & Engn, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
[8] CAS Ctr Excellence Brain Sci & Intelligence Techn, Shanghai 20031, Peoples R China
基金
中国国家自然科学基金;
关键词
Visual saliency detection; salient object segmentation; boundary detection; deep learning; MODEL;
D O I
10.1109/TIP.2019.2891055
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The performance of salient object segmentation has been significantly advanced by using the deep convolutional networks. However, these networks often produce blob-like saliency maps without accurate object boundaries. This is caused by the limited spatial resolution of their feature maps after multiple pooling operations and might hinder downstream applications that require precise object shapes. To address this issue, we propose a novel deep model-Focal Boundary Guided (Focal-BG) network. Our model is designed to jointly learn to segment salient object masks and detect salient object boundaries. Our key idea is that additional knowledge about object boundaries can help to precisely identify the shape of the object. Moreover, our model incorporates a refinement pathway to refine the mask prediction and makes use of the focal lass to facilitate the learning of the hard boundary pixels. To evaluate our model, we conduct extensive experiments. Our Focal-BG network consistently outperforms the state-of-the-art methods on five major benchmarks. We provide a detailed analysis of these results and demonstrate that our joint modeling of salient object boundary and mask helps to better capture the shape details, especially in the vicinity of object boundaries.
引用
收藏
页码:2813 / 2824
页数:12
相关论文
共 50 条
  • [1] Attention and boundary guided salient object detection
    Zhang, Qing
    Shi, Yanjiao
    Zhang, Xueqin
    PATTERN RECOGNITION, 2020, 107 (107)
  • [2] Salient object detection via a boundary-guided graph structure
    Wu, Yunhe
    Jia, Tong
    Pang, Yu
    Sun, Jiaduo
    Xue, Dingyu
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2021, 75
  • [3] Boundary-Guided Feature Aggregation Network for Salient Object Detection
    Zhuge, Yunzhi
    Yang, Gang
    Zhang, Pingping
    Lu, Huchuan
    IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (12) : 1800 - 1804
  • [4] GUIDED FOCAL STACK REFINEMENT NETWORK FOR LIGHT FIELD SALIENT OBJECT DETECTION
    Yuan, Bo
    Jiang, Yao
    Fu, Keren
    Zhao, Qijun
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2387 - 2392
  • [5] Edge guided salient object detection
    Yang, Bing
    Zhang, Xiaoyun
    Chen, Li
    Yang, Hua
    Gao, Zhiyong
    NEUROCOMPUTING, 2017, 221 : 60 - 71
  • [6] Focusness Guided Salient Object Detection
    Xiao, Xiaolin
    Zhou, Yicong
    2017 IEEE INTERNATIONAL CONFERENCE ON SYSTEMS, MAN, AND CYBERNETICS (SMC), 2017, : 3462 - 3466
  • [7] SALIENT OBJECT DETECTION WITH BOUNDARY INFORMATION
    Chen, Kai
    Wang, Yongxiong
    Hu, Chuanfei
    Shao, Hang
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [8] Blurriness Guided Underwater Salient Object Detection
    Peng, Yan-Tsung
    Lin, Yu-Cheng
    Peng, Wen-Yi
    OCEANS 2021: SAN DIEGO - PORTO, 2021,
  • [9] Motion Guided Attention for Video Salient Object Detection
    Li, Haofeng
    Chen, Guanqi
    Li, Guanbin
    Yu, Yizhou
    2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7273 - 7282
  • [10] Deep layer guided network for salient object detection
    Liu, Zhengyi
    Li, Quanlong
    Li, Wei
    NEUROCOMPUTING, 2020, 372 : 55 - 63