Real-time virtual view synthesis using light field

被引:0
|
作者
Li Yao
Yunjian Liu
Weixin Xu
机构
[1] Southeast University,College of Computer Science and Engineering
关键词
Light field; Virtual view synthesis; Real time; Light field imaging;
D O I
暂无
中图分类号
学科分类号
摘要
Virtual view synthesis technique renders a virtual view image from several pre-collected viewpoint images. The hotspot on virtual view synthesis area is depth image-based rendering (DIBR), which has low one-time imaging quality. To achieve high imaging quality artifacts, the holes must be inpainted after image warping which means high computational complexity. This paper proposed a real-time virtual view synthesis method from light field. Then the light field is transformed into frequency domain. The light field is parameterized and reconstructed from image array. The virtual view is rendered by resampling the light field in frequency domain. After resampling the image by performing Fourier slice, the virtual view image is obtained by inverse Fourier transform. Experiments show that our method can get high one-time imaging quality in real time.
引用
收藏
相关论文
共 50 条
  • [1] Real-time virtual view synthesis using light field
    Yao, Li
    Liu, Yunjian
    Xu, Weixin
    EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2016, : 1 - 10
  • [2] Real-Time CPU-Based Virtual View Synthesis
    Dziembowski, Adrian
    Stankowski, Jakub
    2018 INTERNATIONAL CONFERENCE ON SIGNALS AND ELECTRONIC SYSTEMS (ICSES 2018), 2018, : 78 - 82
  • [3] Real-time Virtual View Synthesis Based on GPU Parallel Programming
    Pan Ling-jiao
    Zhu You-lian
    Qian Zhi-wen
    Chen Qin
    Hong Yue
    2015 27TH CHINESE CONTROL AND DECISION CONFERENCE (CCDC), 2015, : 3687 - 3690
  • [4] Dimensionality Reduction for the Real-Time Light-Field View Synthesis of Kernel-Based Models
    Courteaux, Martijn
    Mareen, Hannes
    Ramlot, Bert
    Lambert, Peter
    Van Wallendael, Glenn
    ELECTRONICS, 2024, 13 (20)
  • [5] REAL-TIME UNSUPERVISED MULTI-VIEW DEPTH ESTIMATION NETWORK FOR VIRTUAL VIEW SYNTHESIS
    Qiu, Ke
    Gu, Song
    Liu, Shiyi
    Lai, Yawen
    Cai, Yangang
    Wang, Ronggang
    2021 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA & EXPO WORKSHOPS (ICMEW), 2021,
  • [6] Virtual Viewpoint Disparity Estimation and Convergence Check for Real-Time View Synthesis
    Shin, In-Yong
    Ho, Yo-Sung
    ADVANCES IN IMAGE AND VIDEO TECHNOLOGY, PT I, 2011, 7087 : 121 - 131
  • [7] Foveated light-field display and real-time rendering for virtual reality
    Gao, Chen
    Peng, Yifan
    Wang, Rui
    Zhang, Zhuopeng
    Li, Haifeng
    Liu, Xu
    APPLIED OPTICS, 2021, 60 (28) : 8634 - 8643
  • [8] Real-time virtual view rendering for video communication systems using OpenCL
    Lange, Tobias
    Petrovic, Goran
    Herfet, Thorsten
    2014 IEEE INTERNATIONAL SYMPOSIUM ON BROADBAND MULTIMEDIA SYSTEMS AND BROADCASTING (BMSB), 2014,
  • [9] PIPELINE FOR REAL-TIME VIDEO VIEW SYNTHESIS
    Vandame, Benoit
    Sabater, Neus
    Boisson, Guillaume
    Doyen, Didier
    Allie, Valerie
    Babon, Frederic
    Gendrot, Remy
    Langlois, Tristan
    Schubert, Arno
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [10] Real-time synthesis of bleeding for virtual hysteroscopy
    Zátonyi, J
    Paget, R
    Székely, G
    Bajka, M
    MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION - MICCAI 2003, PT 1, 2003, 2878 : 67 - 74