Synthesizing Light Field Views based on Superpixels in Epipolar Plane Image Domain

被引:0
|
作者
Yim, Jonghoon [1 ]
Van Duong, Vinh [1 ]
Huu, Thuc Nguyen [1 ]
Jeon, Byeungwoo [1 ]
机构
[1] Sungkyunkwan Univ, Dept Elect & Comp Engn, Seoul, South Korea
来源
INTERNATIONAL WORKSHOP ON ADVANCED IMAGING TECHNOLOGY, IWAIT 2023 | 2023年 / 12592卷
基金
新加坡国家研究基金会;
关键词
Light field; view synthesis; superpixel segmentation; epipolar plane image;
D O I
10.1117/12.2667015
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the perspective of alleviating the inherent trade-off between the spatial and angular resolutions of light field (LF) images, much research has been carried out to increase the angular resolution of LFs by synthesizing intermediate views. Since the height of each EPI is equal to the angular resolution of LF, we tackle the view synthesis problem as doubling the height of each EPI in LF. To efficiently stretch the EPI while not consuming too much computing time, we propose to first segment the EPI into superpixels and then adaptively interpolate each superpixel separately. The test results on the synthetic and real-scene LF datasets show that our scheme can achieve average Peak signal-to-noise ratio (PSNR) / structural similarity index measure (SSIM) around 30.58dB / 0.9131 and 32.28dB / 0.9510, by taking computing time of 5.80 minute and 1.83 minute for HCI and EPFL dataset, respectively.
引用
收藏
页数:5
相关论文
共 50 条
  • [11] Learning an epipolar shift compensation for light field image super-resolution
    Wang, Xinya
    Ma, Jiayi
    Yi, Peng
    Tian, Xin
    Jiang, Junjun
    Zhang, Xiao-Ping
    INFORMATION FUSION, 2022, 79 : 188 - 199
  • [12] Multi-view Object Segmentation Based on Epipolar Plane Image Analysis
    Fan, Liangzhong
    Yu, Xin
    Shu, Zhenyu
    Zhang, Qiaowen
    ISCSCT 2008: INTERNATIONAL SYMPOSIUM ON COMPUTER SCIENCE AND COMPUTATIONAL TECHNOLOGY, VOL 2, PROCEEDINGS, 2008, : 602 - +
  • [13] Synthesizing Light Field From a Single Image with Variable MPI and Two Network Fusion
    Li, Qinbo
    Kalantari, Nima Khademi
    ACM TRANSACTIONS ON GRAPHICS, 2020, 39 (06):
  • [14] Light Field Synthesis by Training Deep Network in the Refocused Image Domain
    Liu, Chang-Le
    Shih, Kuang-Tsu
    Huang, Jiun-Woei
    Chen, Homer H.
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2020, 29 : 6630 - 6640
  • [15] ZEPI-Net: Light Field Super Resolution via Internal Cross-Scale Epipolar Plane Image Zero-Shot Learning
    Xiao, Zhaolin
    Liu, Yinhai
    Jin, Haiyan
    Guillemot, Christine
    NEURAL PROCESSING LETTERS, 2023, 55 (02) : 1649 - 1662
  • [16] ZEPI-Net: Light Field Super Resolution via Internal Cross-Scale Epipolar Plane Image Zero-Shot Learning
    Zhaolin Xiao
    Yinhai Liu
    Haiyan Jin
    Christine Guillemot
    Neural Processing Letters, 2023, 55 : 1649 - 1662
  • [17] A learning-based method using Epipolar Geometry for light field depth estimation
    Wang, Xucheng
    Liu, Wan
    Sun, Yan
    Yang, Lin
    Qin, Zhentao
    Zheng, Zhenrong
    OPTOELECTRONIC IMAGING AND MULTIMEDIA TECHNOLOGY VI, 2019, 11187
  • [18] Light-field angular super-resolution reconstruction via fusing 3D epipolar plane images
    Chen C.
    Fan X.
    Hu X.
    Yu H.
    Guangxue Jingmi Gongcheng/Optics and Precision Engineering, 2023, 31 (21): : 3167 - 3177
  • [19] END-TO-END LEARNED LIGHT FIELD IMAGE RESCALING USING JOINT SPATIAL-ANGULAR AND EPIPOLAR INFORMATION
    Vinh Van Duong
    Thuc Nguyen Huu
    Yim, Jonghoon
    Jeon, Byeungwoo
    2023 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, ICIP, 2023, : 1935 - 1939
  • [20] Deep Learning-Based Light Field Image Quality Assessment Using Frequency Domain Inputs
    Alamgeer, Sana
    Farias, Mylene C. Q.
    2022 14TH INTERNATIONAL CONFERENCE ON QUALITY OF MULTIMEDIA EXPERIENCE, QOMEX, 2022,