A foreground-context dual-guided network for light-field salient object detection

被引:0
|
作者
Zheng, Xin [1 ]
Wang, Boyang [1 ]
Liu, Deyang [2 ,5 ]
Lv, Chengtao [3 ]
Yan, Jiebin [5 ]
An, Ping [4 ]
机构
[1] Anqing Normal Univ, Sch Comp & Informat, Anqing 246000, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Elect Engn & Automation, Qingdao 266590, Peoples R China
[3] Hangzhou Dianzi Univ, Sch Automat, Hangzhou 310018, Peoples R China
[4] Shanghai Univ, Shanghai Inst Adv Commun & Data Sci, Shanghai 200444, Peoples R China
[5] Jiangxi Univ Finance & Econ, Sch Informat Management, Nanchang 330032, Peoples R China
基金
中国国家自然科学基金;
关键词
Light-field; Salient object detection; Deep learning; Information fusion; Dual-guided network; AWARE NETWORK;
D O I
10.1016/j.image.2024.117165
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Light-field salient object detection (SOD) has become an emerging trend as it records comprehensive information about natural scenes that can benefit salient object detection in various ways. However, salient object detection models with light-field data as input have not been thoroughly explored. The existing methods cannot effectively suppress the noise, and it is difficult to distinguish the foreground and background under challenging conditions including self-similarity, complex backgrounds, large depth of field, and non-Lambertian scenarios. In order to extract the feature of light-field images effectively and suppress the noise in light-field, in this paper, we propose a foreground and context dual guided network. Specifically, we design a global context extraction module (GCEM) and a local foreground extraction module (LFEM). GCEM is used to suppress global noise and roughly predict saliency maps. GCEM also can extract global context information from deeplevel features to guide decoding process. By extracting local information from shallow-level, LFEM refines the prediction obtained by GCEM. In addition, we use RGB images to enhance the light-field images before the input GCEM. Experimental results show that our proposed method is effective in suppressing global noise and achieves better results when dealing with transparent objects and complex backgrounds. The experimental results show that the proposed method outperforms several other state-of-the-art methods on three light-field datasets.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] TENet: Accurate light-field salient object detection with a transformer embedding network
    Wang, Xingzheng
    Chen, Songwei
    Wei, Guoyao
    Liu, Jiehao
    IMAGE AND VISION COMPUTING, 2023, 129
  • [2] Dual guidance enhanced network for light field salient object detection
    Liang, Yanhua
    Qin, Guihe
    Sun, Minghui
    Qin, Jun
    Yan, Jie
    Zhang, Zhonghan
    IMAGE AND VISION COMPUTING, 2022, 118
  • [3] Dual guidance enhanced network for light field salient object detection
    Liang, Yanhua
    Qin, Guihe
    Sun, Minghui
    Qin, Jun
    Yan, Jie
    Zhang, Zhonghan
    Image and Vision Computing, 2022, 118
  • [4] GUIDED FOCAL STACK REFINEMENT NETWORK FOR LIGHT FIELD SALIENT OBJECT DETECTION
    Yuan, Bo
    Jiang, Yao
    Fu, Keren
    Zhao, Qijun
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 2387 - 2392
  • [5] High Edge-Quality Light-Field Salient Object Detection Using Convolutional Neural Network
    Wang, Xingzheng
    Chen, Songwei
    Liu, Jiehao
    Wei, Guoyao
    ELECTRONICS, 2022, 11 (07)
  • [6] Foreground-Background Collaboration Network for Salient Object Detection
    Sun, Fengming
    Huang, Lufei
    Yuan, Xia
    Zhao, Chunxia
    PATTERN RECOGNITION, ACPR 2021, PT I, 2022, 13188 : 212 - 225
  • [7] LFNet: Light Field Fusion Network for Salient Object Detection
    Zhang, Miao
    Ji, Wei
    Piao, Yongri
    Li, Jingjing
    Zhang, Yu
    Xu, Shuang
    Lu, Huchuan
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6276 - 6287
  • [8] OPTIMIZATION OF COMPRESSIVE LIGHT FIELD DISPLAY IN DUAL-GUIDED LEARNING
    Sun, Yangfan
    Li, Zhu
    Li, Li
    Wang, Shizheng
    Gao, Wei
    2022 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2022, : 2075 - 2079
  • [9] Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation
    Zheng, Xin
    Li, Zhengqu
    Liu, Deyang
    Zhou, Xiaofei
    Shan, Caifeng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (12) : 12437 - 12449
  • [10] Occlusion-aware Bi-directional Guided Network for Light Field Salient Object Detection
    Jing, Dong
    Zhang, Shuo
    Cong, Runmin
    Lin, Youfang
    PROCEEDINGS OF THE 29TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2021, 2021, : 1692 - 1701