A Light-Field Video Dataset of Scenes with Moving Objects Captured with a Plenoptic Video Camera

被引:0
|
作者
Javidi, Kamran [1 ]
Martini, Maria G. [1 ]
机构
[1] Kingston Univ, Fac Engn Comp & Environm, Sch Comp Sci & Math, Dept Networks & Digital Media,Wireless & Multimedi, Penrhyn Rd Campus, Kingston Upon Thames KT1 2EE, England
关键词
light field; dataset; content characterisation; objective quality assessment;
D O I
10.3390/electronics13112223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Light-field video provides a detailed representation of scenes captured from different perspectives. This results in a visualisation modality that enhances the immersion and engagement of the viewers with the depicted environment. In order to perform research on compression, transmission and signal processing of light field data, datasets with light-field contents of different categories and acquired with different modalities are required. In particular, the development of machine learning models for quality assessment and for light-field processing, including the generation of new views, require large amounts of data. Most existing datasets consist of static scenes and, in many cases, synthetic contents. This paper presents a novel light-field plenoptic video dataset, KULFR8, involving six real-world scenes with moving objects and 336 distorted light-field videos derived from the original contents; in total, the original scenes in the dataset contain 1800 distinctive frames, with angular resolution of 5x5 with and total spatial resolution of 9600x5400 pixels (considering all the views); overall, the dataset consists of 45,000 different views with spatial resolution of 1920x1080 pixels. We analyse the content characteristics based on the dimensions of the captured objects and via the acquired videos using the central views extracted from each quilted frame. Additionally, we encode and decode the contents using various video encoders across different bitrate ranges. For quality assessments, we consider all the views, utilising frames measuring 9600x5400 pixels, and employ two objective quality metrics: PSNR and SSIM.
引用
收藏
页数:20
相关论文
共 43 条
  • [21] Light-field camera and display as information retrieval systems for three-dimensional images
    Iwane, Toru
    Shoda, Marie
    OPTICAL ENGINEERING, 2018, 57 (06)
  • [22] A HIGH-RESOLUTION HIGH DYNAMIC RANGE LIGHT-FIELD DATASET WITH AN APPLICATION TO VIEW SYNTHESIS AND TONE-MAPPING
    Gul, M. Shahzeb Khan
    Wolf, Thorsten
    Baetz, Michel
    Ziegler, Matthias
    Keinert, Joachim
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO WORKSHOPS (ICMEW), 2020,
  • [23] Non-Planar Inside-Out Dense Light-Field Dataset and Reconstruction Pipeline
    Zakeri, Faezeh Sadat
    Durmush, Ahmed
    Ziegler, Matthias
    Baetz, Michel
    Keinert, Joachim
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1059 - 1063
  • [24] Compositing Light field Video Using Multiplane Images
    DuVall, Matthew
    Flynn, John
    Broxton, Michael
    Debevec, Paul
    SIGGRAPH '19 - ACM SIGGRAPH 2019 POSTERS, 2019,
  • [25] Near-Lossless Coding of Plenoptic Camera Sensor Images for Archiving Light Field Array of Views
    Palma, Emanuele
    Tabus, Ioan
    2022 ELEVENTH INTERNATIONAL CONFERENCE ON IMAGE PROCESSING THEORY, TOOLS AND APPLICATIONS (IPTA), 2022,
  • [26] Light-field image acquisition from a conventional camera: design of a four minilens ring device
    Bazeille, Stephane
    Maillot, Yvan
    Cordier, Frederic
    Riou, Cecile
    Cudel, Christophe
    OPTICAL ENGINEERING, 2019, 58 (01)
  • [27] A FEATURE-BASED APPROACH FOR LIGHT FIELD VIDEO ENHANCEMENT
    Brizzi, Michele
    Battisti, Federica
    Neri, Alessandro
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 1204 - 1209
  • [28] Proposal of a light-field descriptor considering light-ray direction —Image matching robust to object shape and camera pose—
    Shimizu M.
    Kawanishi Y.
    Deguchi D.
    Ide I.
    Murase H.
    Seimitsu Kogaku Kaishi/Journal of the Japan Society for Precision Engineering, 2021, 87 (02): : 197 - 205
  • [29] Tragic Talkers: A Shakespearean Sound- and Light-Field Dataset for Audio-Visual Machine Learning Research
    Berghi, Davide
    Volino, Marco
    Jackson, Philip J. B.
    19TH ACM SIGGRAPH EUROPEAN CONFERENCE ON VISUAL MEDIA PRODUCTION, CVMP 2022, 2022,
  • [30] Stereo-Knowledge Distillation from dpMV to Dual Pixels for Light Field Video Reconstruction
    Garg, Aryan
    Mallampali, Raghav
    Joshi, Akshat
    Govindarajan, Shrisudhan
    Mitra, Kaushik
    2024 IEEE INTERNATIONAL CONFERENCE ON COMPUTATIONAL PHOTOGRAPHY, ICCP 2024, 2024,