Saliency Detection of Light Field Image Based on Feature Fusion and Feedback Refinement

被引:0
|
作者
Liang Xiao [1 ,2 ]
Deng Huiping [1 ,2 ]
Xiang Sen [1 ,2 ]
Wu Jin [1 ,2 ]
机构
[1] Wuhan Univ Sci & Technol, Sch Informat Sci & Engn, Wuhan 430081, Hubei, Peoples R China
[2] Wuhan Univ Sci & Technol, Engn Res Ctr Met Automat & Measurement Technol, Minist Educ, Wuhan 430081, Hubei, Peoples R China
关键词
image processing; saliency detection; deep learning; light field image; convolutional neural network;
D O I
10.3788/LOP202259.2210006
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
The existing light field image saliency detection algorithms cannot effectively measure the focus information, resulting in an incomplete salient object, information redundancy, and blurred edges. Considering that different slices of the focal stack and the all-focus image play different roles in saliency prediction, this study combines the efficient channel attention (ECA) network and convolutional long short-term memory model (Convl,STM) network to form a feature fusion network that adaptively fuse the features of the focal stack slices and all-focus images without reducing the dimension: then the feedback network composed of the cross feature module refines the information and eliminates the redundant information generated after the feature fusion; finally, the ECA network is used for weighing the high-level features to better highlight the saliency area to obtain a more accurate saliency map. The network proposed has F-measure and mean absolute error (MAE) of 0.871 and 0.049, respectively, in the most recent data set, which are significantly better than the existing red, green, and blue (RGB) images, red, green, blue, and depth (RGB-D) images, and light field images saliency detection algorithms. The experimental results show that the proposed network can effectively separate the foreground and background regions of the focal stack slices and produce a more accurate saliency map.
引用
收藏
页数:9
相关论文
共 24 条
  • [1] Chen ZY, 2020, AAAI CONF ARTIF INTE, V34, P10599
  • [2] Gongyang Li, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12362), P665, DOI 10.1007/978-3-030-58520-4_39
  • [3] Hu J, 2018, PROC CVPR IEEE, P7132, DOI [10.1109/TPAMI.2019.2913372, 10.1109/CVPR.2018.00745]
  • [4] A model of saliency-based visual attention for rapid scene analysis
    Itti, L
    Koch, C
    Niebur, E
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1998, 20 (11) : 1254 - 1259
  • [5] Foveated JND Model Based on Stereo Vision and Its Application in Image Compression with Hardware Implementation
    Ji Yuan
    Zheng Zhijie
    Wu Hao
    Zhang Yin
    Chen Wendong
    Mu Tingzhou
    [J]. ACTA OPTICA SINICA, 2021, 41 (12)
  • [6] Saliency Detection on Light Field
    Li, Nianyi
    Ye, Jinwei
    Ji, Yu
    Ling, Haibin
    Yu, Jingyi
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (08) : 1605 - 1616
  • [7] Saliency Detection on Light Field
    Li, Nianyi
    Ye, Jinwei
    Ji, Yu
    Ling, Haibin
    Yu, Jingyi
    [J]. 2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 2806 - 2813
  • [8] [李爽 Li Shuang], 2020, [中国图象图形学报, Journal of Image and Graphics], V25, P2578
  • [9] Liu N, 2020, PROC CVPR IEEE, P13753, DOI 10.1109/CVPR42600.2020.01377
  • [10] Optimization of Image Semantic Segmentation Algorithms Based on Deeplab v3+
    Meng Junxi
    Zhang Li
    Cao Yang
    Zhang Letian
    Song Qian
    [J]. LASER & OPTOELECTRONICS PROGRESS, 2022, 59 (16)