A Light-Field Video Dataset of Scenes with Moving Objects Captured with a Plenoptic Video Camera

被引:0
|
作者
Javidi, Kamran [1 ]
Martini, Maria G. [1 ]
机构
[1] Kingston Univ, Fac Engn Comp & Environm, Sch Comp Sci & Math, Dept Networks & Digital Media,Wireless & Multimedi, Penrhyn Rd Campus, Kingston Upon Thames KT1 2EE, England
关键词
light field; dataset; content characterisation; objective quality assessment;
D O I
10.3390/electronics13112223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Light-field video provides a detailed representation of scenes captured from different perspectives. This results in a visualisation modality that enhances the immersion and engagement of the viewers with the depicted environment. In order to perform research on compression, transmission and signal processing of light field data, datasets with light-field contents of different categories and acquired with different modalities are required. In particular, the development of machine learning models for quality assessment and for light-field processing, including the generation of new views, require large amounts of data. Most existing datasets consist of static scenes and, in many cases, synthetic contents. This paper presents a novel light-field plenoptic video dataset, KULFR8, involving six real-world scenes with moving objects and 336 distorted light-field videos derived from the original contents; in total, the original scenes in the dataset contain 1800 distinctive frames, with angular resolution of 5x5 with and total spatial resolution of 9600x5400 pixels (considering all the views); overall, the dataset consists of 45,000 different views with spatial resolution of 1920x1080 pixels. We analyse the content characteristics based on the dimensions of the captured objects and via the acquired videos using the central views extracted from each quilted frame. Additionally, we encode and decode the contents using various video encoders across different bitrate ranges. For quality assessments, we consider all the views, utilising frames measuring 9600x5400 pixels, and employ two objective quality metrics: PSNR and SSIM.
引用
收藏
页数:20
相关论文
共 43 条
  • [1] From the Calibration of a Light-Field Camera to Direct Plenoptic Odometry
    Zeller, Niclas
    Quint, Franz
    Stilla, Uwe
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2017, 11 (07) : 1004 - 1019
  • [2] Hologram with the enlarged depth of field captured by the commercial plenoptic camera
    Ai, Lingyu
    Shi, Xiao
    Wang, Xiaodong
    OPTICS FRONTIER ONLINE 2020: OPTICS IMAGING AND DISPLAY, 2020, 11571
  • [3] Light-field reconstruction from scattered light using plenoptic data
    Sasaki, Takahiro
    Leger, James R.
    UNCONVENTIONAL AND INDIRECT IMAGING, IMAGE RECONSTRUCTION, AND WAVEFRONT SENSING 2018, 2018, 10772
  • [4] LIGHT-FIELD VIDEO CODING USING GEOMETRY-BASED DISPARITY COMPENSATION
    Conti, Caroline
    Kovacs, Peter Tamas
    Balogh, Tibor
    Nunes, Paulo
    Soares, Luis Ducla
    2014 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2014,
  • [5] Efficient random-access GPU video decoding for light-field rendering
    Chlubna, Tomas
    Milet, Tomas
    Zemcik, Pavel
    JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2024, 102
  • [6] A Spatial Calibrated and Colour Corrected Light Field Outdoor Video Dataset from a 5x5 Dense Camera Array
    Wang, Yixiao
    Mehajabin, Nusrat
    Tohidypour, Hamid Reza
    Song, Jerry
    Huang, Menghong
    Babaghorbani, Behnoosh
    Chen, Zuhao
    Pourazad, Mahsa T.
    Nasiopoulos, Panos
    Leung, Victor C. M.
    2023 IEEE INTERNATIONAL SYMPOSIUM ON CIRCUITS AND SYSTEMS, ISCAS, 2023,
  • [7] 4DLFVD: A 4D Light Field Video Dataset
    Hu, Xinjue
    Wang, Chenchen
    Pan, Yuxuan
    Liu, Yunming
    Wang, Yumei
    Liu, Yu
    Zhang, Lin
    Shirmohammadi, Shervin
    MMSYS '21: PROCEEDINGS OF THE 2021 MULTIMEDIA SYSTEMS CONFERENCE, 2021, : 287 - 292
  • [8] Survey on video anomaly detection in dynamic scenes with moving cameras
    Jiao, Runyu
    Wan, Yi
    Poiesi, Fabio
    Wang, Yiming
    ARTIFICIAL INTELLIGENCE REVIEW, 2023, 56 (SUPPL3) : S3515 - S3570
  • [9] UrbanLF: A Comprehensive Light Field Dataset for Semantic Segmentation of Urban Scenes
    Sheng, Hao
    Cong, Ruixuan
    Yang, Da
    Chen, Rongshan
    Wang, Sizhe
    Cui, Zhenglong
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (11) : 7880 - 7893
  • [10] Nanofabricated optical and detector elements for light-field camera sensors
    Narasimhan, Vijay K.
    Cui, Yi
    NANOENGINEERING: FABRICATION, PROPERTIES, OPTICS, AND DEVICES IX, 2012, 8463