Real-Time Light Field Video Focusing and GPU Accelerated Streaming

被引:3
|
作者
Chlubna, Tomas [1 ]
Milet, Tomas [1 ]
Zemcik, Pavel [1 ]
Kula, Michal [1 ]
机构
[1] Brno Univ Technol, Fac Informat Technol, Dept Comp Graph & Multimedia, Bozetechova 2, Brno 61200, Czech Republic
来源
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2023年 / 95卷 / 06期
关键词
Light field; GPU; Image-based rendering; DEPTH; RECONSTRUCTION;
D O I
10.1007/s11265-023-01874-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a novel solution of real-time depth range and correct focusing estimation in light field videos represented by arrays of video sequences. This solution, compared to previous approaches, offers a novel way to render high-quality synthetic views from light field videos on contemporary hardware in real-time. Only the video frames containing color information with no other attributes, such as captured depth, are needed. The drawbacks of the previous proposals such as block artifacts in the defocused parts of the scene or manual setting of the depth range are also solved in this paper. This paper describes a complete solution that solves the main memory and performance issues of light field rendering on contemporary personal computers. The whole integration of high-quality light field videos supersedes the approaches in previous works and the paper also provides measurements and experimental results. While reaching the same quality as slower state-of-the-art approaches, this method can still be used in real-time which makes it suitable for industry and real-life scenarios as an alternative to standard 3D rendering approaches.
引用
收藏
页码:703 / 719
页数:17
相关论文
共 50 条
  • [1] Real-Time Light Field Video Focusing and GPU Accelerated Streaming
    Tomáš Chlubna
    Tomáš Milet
    Pavel Zemčík
    Michal Kula
    Journal of Signal Processing Systems, 2023, 95 : 703 - 719
  • [2] Real-time per-pixel focusing method for light field rendering
    Chlubna, T.
    Milet, T.
    Zemcik, P.
    COMPUTATIONAL VISUAL MEDIA, 2021, 7 (03) : 319 - 333
  • [3] Real-time per-pixel focusing method for light field rendering
    T. Chlubna
    T. Milet
    P. Zemčík
    Computational Visual Media, 2021, 7 : 319 - 333
  • [4] Real-Time GPU Based Video Segmentation with Depth Information
    Bidyanta, Nilangshu
    Akoglu, Ali
    2018 IEEE/ACS 15TH INTERNATIONAL CONFERENCE ON COMPUTER SYSTEMS AND APPLICATIONS (AICCSA), 2018,
  • [5] Geocube – GPU accelerated real-time rendering of transparency and translucency
    Bin Chan
    Wenping Wang
    The Visual Computer, 2005, 21 : 579 - 590
  • [6] Geocube - GPU accelerated real-time rendering of transparency and translucency
    Chan, B
    Wang, WP
    VISUAL COMPUTER, 2005, 21 (8-10) : 579 - 590
  • [7] GPU-accelerated Real-time Free-viewpoint DIBR for 3DTV
    Do, Luat
    Bravo, German
    Zinger, Svitlana
    de With, Peter H. N.
    IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, 2012, 58 (02) : 633 - 640
  • [8] REAL-TIME ARBITRARY VIEW RENDERING ON GPU FROM STEREO VIDEO AND TIME-OF-FLIGHT CAMERA
    Ates, Tugrul K.
    Alatan, A. Aydin
    2011 3DTV CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2011,
  • [9] Real-time video breakup detection for multiple HD video streams on a single GPU
    Rosner, Jakub
    Fassold, Hannes
    Winter, Martin
    Schallauer, Peter
    REAL-TIME IMAGE AND VIDEO PROCESSING 2012, 2012, 8437
  • [10] Real-time multi-camera video analytics system on GPU
    Guler, Puren
    Emeksiz, Deniz
    Temizel, Alptekin
    Teke, Mustafa
    Temizel, Tugba Taskaya
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2016, 11 (03) : 457 - 472