MULTI-GENERATOR ADVERSARIAL NETWORKS FOR LIGHT FIELD SALIENCY DETECTION

被引:2
作者
Cai, Hongyan
Zhang, Xudong
Sun, Rui
Poppe, Ronald
Zhang, Jun
机构
来源
2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW) | 2021年
关键词
light field; saliency detection; multi-generator adversarial network; focal stack;
D O I
10.1109/ICMEW53276.2021.9456017
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Compared to traditional cameras, light field imaging can additionally record the direction of incoming light. Based on this, light fields can be represented in focus stacks that focus at different depths and all-in-focus images. The refocusing information of focal stacks can provide supplementary information for saliency detection. In this paper, we propose a novel multi-generator adversarial network for saliency detection that consists of a cascaded multi-generator and a discriminator. The multi-generator extract saliency features from allin-focus images and focal stacks. Besides, we set the predicted map multiplied by the all-in-focus image as the input of the discriminator. With this multiplication, we can preserve color and texture information of the salient objects, and reduce the computational cost. We conduct experiments on three public datasets. Compared with existing methods, our method achieves competitive results.
引用
收藏
页数:6
相关论文
共 31 条
  • [1] Achanta R, 2009, PROC CVPR IEEE, P1597, DOI 10.1109/CVPRW.2009.5206596
  • [2] SINGLE LENS STEREO WITH A PLENOPTIC CAMERA
    ADELSON, EH
    WANG, JYA
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1992, 14 (02) : 99 - 106
  • [3] Depth really Matters: Improving Visual Salient Region Detection with Depth
    Desingh, Karthik
    Krishna, K. Madhava
    Rajan, Deepu
    Jawahar, C. V.
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2013, 2013,
  • [4] Structure-measure: A New Way to Evaluate Foreground Maps
    Fan, Deng-Ping
    Cheng, Ming-Ming
    Liu, Yun
    Li, Tao
    Borji, Ali
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, : 4558 - 4567
  • [5] Goodfellow I., 2020, ADV NEUR IN, V63, P139, DOI [DOI 10.1145/3422622, 10.1145/3422622]
  • [6] SDM: Semantic Distortion Measurement for Video Encryption
    Hu, Yongquan
    Zhou, Wei
    Zhao, Shuxin
    Chen, Zhibo
    Li, Weiping
    [J]. PROCEEDINGS 2018 13TH IEEE INTERNATIONAL CONFERENCE ON AUTOMATIC FACE & GESTURE RECOGNITION (FG 2018), 2018, : 764 - 768
  • [7] Ioffe S, 2015, PR MACH LEARN RES, V37, P448
  • [8] Image-to-Image Translation with Conditional Adversarial Networks
    Isola, Phillip
    Zhu, Jun-Yan
    Zhou, Tinghui
    Efros, Alexei A.
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 5967 - 5976
  • [9] Depth Matters: Influence of Depth Cues on Visual Saliency
    Lang, Congyan
    Nguyen, Tam V.
    Katti, Harish
    Yadati, Karthik
    Kankanhalli, Mohan
    Yan, Shuicheng
    [J]. COMPUTER VISION - ECCV 2012, PT II, 2012, 7573 : 101 - 115
  • [10] Backpropagation Applied to Handwritten Zip Code Recognition
    LeCun, Y.
    Boser, B.
    Denker, J. S.
    Henderson, D.
    Howard, R. E.
    Hubbard, W.
    Jackel, L. D.
    [J]. NEURAL COMPUTATION, 1989, 1 (04) : 541 - 551