Real-Time Light Field Video Focusing and GPU Accelerated Streaming

被引:3
|
作者
Chlubna, Tomas [1 ]
Milet, Tomas [1 ]
Zemcik, Pavel [1 ]
Kula, Michal [1 ]
机构
[1] Brno Univ Technol, Fac Informat Technol, Dept Comp Graph & Multimedia, Bozetechova 2, Brno 61200, Czech Republic
来源
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2023年 / 95卷 / 06期
关键词
Light field; GPU; Image-based rendering; DEPTH; RECONSTRUCTION;
D O I
10.1007/s11265-023-01874-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a novel solution of real-time depth range and correct focusing estimation in light field videos represented by arrays of video sequences. This solution, compared to previous approaches, offers a novel way to render high-quality synthetic views from light field videos on contemporary hardware in real-time. Only the video frames containing color information with no other attributes, such as captured depth, are needed. The drawbacks of the previous proposals such as block artifacts in the defocused parts of the scene or manual setting of the depth range are also solved in this paper. This paper describes a complete solution that solves the main memory and performance issues of light field rendering on contemporary personal computers. The whole integration of high-quality light field videos supersedes the approaches in previous works and the paper also provides measurements and experimental results. While reaching the same quality as slower state-of-the-art approaches, this method can still be used in real-time which makes it suitable for industry and real-life scenarios as an alternative to standard 3D rendering approaches.
引用
收藏
页码:703 / 719
页数:17
相关论文
共 50 条
  • [21] Real-time image deconvolution on the GPU
    Klosowski, James T.
    Krishnan, Shankar
    PARALLEL PROCESSING FOR IMAGING APPLICATIONS, 2011, 7872
  • [22] 4K-UHD REAL-TIME HEVC ENCODER WITH GPU ACCELERATED MOTION ESTIMATION
    Takano, Fumiyo
    Igarashi, Hiroaki
    Moriyoshi, Tatsuji
    2017 24TH IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2017, : 2731 - 2735
  • [23] Architectural and Qos Issues in Mobile Cloud Computing Environment for Real-Time Video Streaming
    Chakraverti, Ashish Kumar
    Dhir, Vijay
    Chakraverti, Sugandha
    INTERNATIONAL JOURNAL OF ADVANCED COMPUTER SCIENCE AND APPLICATIONS, 2016, 7 (01) : 355 - 366
  • [24] FAST AND EFFICIENT REAL-TIME GPU BASED IMPLEMENTATION OF WAVE FIELD SYNTHESIS
    Ranjan, Rishabh
    Gan, Woon-Seng
    2014 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2014,
  • [25] Panoramic Light Field From Hand-Held Video and Its Sampling for Real-Time Rendering
    Zhao, Qiang
    Dai, Feng
    Lv, Jing
    Ma, Yike
    Zhang, Yongdong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2020, 30 (04) : 1011 - 1021
  • [26] Real-time High Resolution Fusion of Depth Maps on GPU
    Trifonov, Dmitry S.
    2013 INTERNATIONAL CONFERENCE ON COMPUTER-AIDED DESIGN AND COMPUTER GRAPHICS (CAD/GRAPHICS), 2013, : 441 - 442
  • [27] A real-time implementation of SIFT using GPU
    K. Aniruddha Acharya
    R. Venkatesh Babu
    Sathish S. Vadhiyar
    Journal of Real-Time Image Processing, 2018, 14 : 267 - 277
  • [28] UAVSAR Real-Time Embedded GPU Processor
    Hawkins, Brian P.
    Tung, Wayne
    2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, : 545 - 547
  • [29] A REAL-TIME CROSSTALK CANCELLER ON A NOTEBOOK GPU
    Belloch, Jose A.
    Gonzalez, Alberto
    Martinez-Zaldivar, F. J.
    Vidal, Antonio M.
    2011 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2011,
  • [30] A real-time implementation of SIFT using GPU
    Acharya, K. Aniruddha
    Babu, R. Venkatesh
    Vadhiyar, Sathish S.
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2018, 14 (02) : 267 - 277