PANet: Patch-Aware Network for Light Field Salient Object Detection

被引:35
作者
Piao, Yongri [1 ]
Jiang, Yongyao [1 ]
Zhang, Miao [2 ,3 ]
Wang, Jian [1 ]
Lu, Huchuan [1 ]
机构
[1] Dalian Univ Technol, Sch Informat & Commun Engn, Dalian 116024, Peoples R China
[2] Dalian Univ Technol, DUT RU Int Sch Informat Sci & Engn, Dalian 116024, Peoples R China
[3] Dalian Univ Technol, Key Lab Ubiquitous Network & Serv Software Liaoni, Dalian 116024, Peoples R China
基金
中国国家自然科学基金;
关键词
Saliency detection; Feature extraction; Object detection; Decoding; Task analysis; Cybernetics; Sensors; Convolutional neural networks (CNNs); light field; saliency object detection; FUSION;
D O I
10.1109/TCYB.2021.3095512
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Most existing light field saliency detection methods have achieved great success by exploiting unique light field data-focus information in focal slices. However, they process light field data in a slicewise way, leading to suboptimal results because the relative contribution of different regions in focal slices is ignored. How we can comprehensively explore and integrate focused saliency regions that would positively contribute to accurate saliency detection. Answering this question inspires us to develop a new insight. In this article, we propose a patch-aware network to explore light field data in a regionwise way. First, we excavate focused salient regions with a proposed multisource learning module (MSLM), which generates a filtering strategy for integration followed by three guidances based on saliency, boundary, and position. Second, we design a sharpness recognition module (SRM) to refine and update this strategy and perform feature integration. With our proposed MSLM and SRM, we can obtain more accurate and complete saliency maps. Comprehensive experiments on three benchmark datasets prove that our proposed method achieves competitive performance over 2-D, 3-D, and 4-D salient object detection methods. The code and results of our method are available at https://github.com/OIPLab-DUT/IEEE-TCYB-PANet.
引用
收藏
页码:379 / 391
页数:13
相关论文
共 57 条
  • [1] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [2] Distributed optimization and statistical learning via the alternating direction method of multipliers
    Boyd S.
    Parikh N.
    Chu E.
    Peleato B.
    Eckstein J.
    [J]. Foundations and Trends in Machine Learning, 2010, 3 (01): : 1 - 122
  • [3] Three-Stream Attention-Aware Network for RGB-D Salient Object Detection
    Chen, Hao
    Li, Youfu
    [J]. IEEE TRANSACTIONS ON IMAGE PROCESSING, 2019, 28 (06) : 2825 - 2835
  • [4] Progressively Complementarity-aware Fusion Network for RGB-D Salient Object Detection
    Chen, Hao
    Li, Youfu
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3051 - 3060
  • [5] Multi-modal fusion network with multi-scale multi-path and cross-modal interactions for RGB-D salient object detection
    Chen, Hao
    Li, Youfu
    Su, Dan
    [J]. PATTERN RECOGNITION, 2019, 86 : 376 - 385
  • [6] Global Contrast Based Salient Region Detection
    Cheng, Ming-Ming
    Mitra, Niloy J.
    Huang, Xiaolei
    Torr, Philip H. S.
    Hu, Shi-Min
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2015, 37 (03) : 569 - 582
  • [7] Going From RGB to RGBD Saliency: A Depth-Guided Transformation Model
    Cong, Runmin
    Lei, Jianjun
    Fu, Huazhu
    Hou, Junhui
    Huang, Qingming
    Kwong, Sam
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (08) : 3627 - 3639
  • [8] Review of Visual Saliency Detection With Comprehensive Information
    Cong, Runmin
    Lei, Jianjun
    Fu, Huazhu
    Cheng, Ming-Ming
    Lin, Weisi
    Huang, Qingming
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (10) : 2941 - 2959
  • [9] An Iterative Co-Saliency Framework for RGBD Images
    Cong, Runmin
    Lei, Jianjun
    Fu, Huazhu
    Lin, Weisi
    Huang, Qingming
    Cao, Xiaochun
    Hou, Chunping
    [J]. IEEE TRANSACTIONS ON CYBERNETICS, 2019, 49 (01) : 233 - 246
  • [10] Deng ZJ, 2018, PROCEEDINGS OF THE TWENTY-SEVENTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P684