Efficient random-access GPU video decoding for light-field rendering

被引:0
作者
Chlubna, Tomas [1 ]
Milet, Tomas [1 ]
Zemcik, Pavel [1 ,2 ]
机构
[1] Brno Univ Technol, Fac Informat Technol, Bozetechova 1-2, Brno 61200, Czech Republic
[2] Lappeenranta Lahti Univ Technol, Sch Engn Sci, Yliopistonkatu 34, Lappeenranta 53850, Finland
关键词
Light field; Plane sweep; Image-based; Rendering; GPU; Focusing; IMAGE COMPRESSION;
D O I
10.1016/j.jvcir.2024.104201
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Compression method for GPU streaming of discrete light fields is proposed in this paper. Views on the scene are encoded with video codec to enable streaming in real time. Instead of using a classic scheme, all frames are encoded according to one reference frame. Any frame is decoded directly, in a random-access manner that is suitable for light -field rendering methods, where only few frames are necessary on the GPU. The proposed scheme reaches the best decoding quality/time ratio in comparison to other schemes, where all preceding frames need to be decompressed, and all -key -frame video that supports random access, but is extremely large. The proposed method solves the space -requirements and streaming -bandwidth issues using the GPU accelerated decoding, and enables incorporating light -field assets in real-time 3D simulations. Compared to existing methods, the proposal is easy to implement, does not depend on specific video format or extension and is efficient on consumer GPUs.
引用
收藏
页数:14
相关论文
共 53 条
[1]   Computationally Efficient Light Field Image Compression Using a Multiview HEVC Framework [J].
Ahmad, Waqas ;
Ghafoor, Mubeen ;
Tariq, Syed Ali ;
Hassan, Ali ;
Sjostrom, Marten ;
Olsson, Roger .
IEEE ACCESS, 2019, 7 :143002-143014
[2]  
Alain M, 2019, Arxiv, DOI arXiv:1910.04699
[3]  
[Anonymous], 1991, The Plenoptic Function and The Elements of Early Vision
[4]   Random access prediction structures for light field video coding with MV-HEVC [J].
Avramelos, Vasileios ;
De Praeter, Johan ;
Van Wallendael, Glenn ;
Lambert, Peter .
MULTIMEDIA TOOLS AND APPLICATIONS, 2020, 79 (19-20) :12847-12867
[5]   LIGHT FIELD IMAGE CODING USING DUAL DISCRIMINATOR GENERATIVE ADVERSARIAL NETWORK AND VVC TEMPORAL SCALABILITY [J].
Bakier, Nader ;
Hamidouche, Wassim ;
Fezza, Sid Ahmed ;
Samrouth, Khouloud ;
Deforges, Olivier .
2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
[6]  
Barina D., 2019, COMPUTER SCI RES N 1, V2901, P55, DOI [10.24132/CSRN.2019.2901.1.7, DOI 10.24132/CSRN.2019.2901.1.7]
[7]   Comparison of light field compression methods [J].
Barina, David ;
Solony, Marek ;
Chlubna, Tomas ;
Dlabaja, Drahomir ;
Klima, Ondrej ;
Zemcik, Pavel .
MULTIMEDIA TOOLS AND APPLICATIONS, 2022, 81 (02) :2517-2528
[8]  
Bhaskaran Vasudev, 1997, Image and Video Compression Standards: Algorithms and Architectures
[9]   Lenslet Light Field Image Coding: Classifying, Reviewing and Evaluating [J].
Brites, Catarina ;
Ascenso, Joao ;
Pereira, Fernando .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (01) :339-354
[10]  
Chai JX, 2000, COMP GRAPH, P307, DOI 10.1145/344779.344932