Real-Time Light Field Video Focusing and GPU Accelerated Streaming

被引:3
|
作者
Chlubna, Tomas [1 ]
Milet, Tomas [1 ]
Zemcik, Pavel [1 ]
Kula, Michal [1 ]
机构
[1] Brno Univ Technol, Fac Informat Technol, Dept Comp Graph & Multimedia, Bozetechova 2, Brno 61200, Czech Republic
来源
JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY | 2023年 / 95卷 / 06期
关键词
Light field; GPU; Image-based rendering; DEPTH; RECONSTRUCTION;
D O I
10.1007/s11265-023-01874-8
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper proposes a novel solution of real-time depth range and correct focusing estimation in light field videos represented by arrays of video sequences. This solution, compared to previous approaches, offers a novel way to render high-quality synthetic views from light field videos on contemporary hardware in real-time. Only the video frames containing color information with no other attributes, such as captured depth, are needed. The drawbacks of the previous proposals such as block artifacts in the defocused parts of the scene or manual setting of the depth range are also solved in this paper. This paper describes a complete solution that solves the main memory and performance issues of light field rendering on contemporary personal computers. The whole integration of high-quality light field videos supersedes the approaches in previous works and the paper also provides measurements and experimental results. While reaching the same quality as slower state-of-the-art approaches, this method can still be used in real-time which makes it suitable for industry and real-life scenarios as an alternative to standard 3D rendering approaches.
引用
收藏
页码:703 / 719
页数:17
相关论文
共 50 条
  • [31] A real-time fisheye video correction method based on Android smart-phone GPU
    Peng, Zhiyong
    Zhu, Xiaopu
    Wu, Jun
    Qin, Zujun
    OPTIK, 2020, 220 (220):
  • [32] Bayesian real-time perception algorithms on GPU
    Ferreira, Joao Filipe
    Lobo, Jorge
    Dias, Jorge
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2011, 6 (03) : 171 - 186
  • [33] GPU Based Real-time Trinocular Steroevision
    Yao, Yuanbin
    Linton, R. J.
    Padir, Taskin
    INTELLIGENT ROBOTS AND COMPUTER VISION XXX: ALGORITHMS AND TECHNIQUES, 2013, 8662
  • [34] A Real-time GPU Implementation of the SIFT Algorithm for Large-Scale Video Analysis Tasks
    Fassold, Hannes
    Rosner, Jakub
    REAL-TIME IMAGE AND VIDEO PROCESSING 2015, 2015, 9400
  • [35] Real-Time Optical Mapping of Contracting Cardiac Tissues With GPU-Accelerated Numerical Motion Tracking
    Lebert, Jan
    Ravi, Namita
    Kensah, George
    Christoph, Jan
    FRONTIERS IN CARDIOVASCULAR MEDICINE, 2022, 9
  • [36] Developing Systems for Real-Time Streaming Analysis
    Michalak, Sarah
    DuBois, Andrew
    DuBois, David
    Wel, Scott Vander
    Hogden, John
    JOURNAL OF COMPUTATIONAL AND GRAPHICAL STATISTICS, 2012, 21 (03) : 561 - 580
  • [37] Real-time 3D light field transmission
    Balogh, Tibor
    Kovacs, Peter Tamas
    REAL-TIME IMAGE AND VIDEO PROCESSING 2010, 2010, 7724
  • [38] Real-time virtual view synthesis using light field
    Li Yao
    Yunjian Liu
    Weixin Xu
    EURASIP Journal on Image and Video Processing, 2016
  • [39] Real-time integral imaging system for light field microscopy
    Kim, Jonghyun
    Jung, Jae-Hyun
    Jeong, Youngmo
    Hong, Keehoon
    Lee, Byoungho
    OPTICS EXPRESS, 2014, 22 (09): : 10210 - 10220
  • [40] A Compact Light Field Camera for Real-Time Depth Estimation
    Anisimov, Yuriy
    Wasenmuller, Oliver
    Stricker, Didier
    COMPUTER ANALYSIS OF IMAGES AND PATTERNS, CAIP 2019, PT I, 2019, 11678 : 52 - 63