A Light-Field Video Dataset of Scenes with Moving Objects Captured with a Plenoptic Video Camera

被引:0
|
作者
Javidi, Kamran [1 ]
Martini, Maria G. [1 ]
机构
[1] Kingston Univ, Fac Engn Comp & Environm, Sch Comp Sci & Math, Dept Networks & Digital Media,Wireless & Multimedi, Penrhyn Rd Campus, Kingston Upon Thames KT1 2EE, England
关键词
light field; dataset; content characterisation; objective quality assessment;
D O I
10.3390/electronics13112223
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Light-field video provides a detailed representation of scenes captured from different perspectives. This results in a visualisation modality that enhances the immersion and engagement of the viewers with the depicted environment. In order to perform research on compression, transmission and signal processing of light field data, datasets with light-field contents of different categories and acquired with different modalities are required. In particular, the development of machine learning models for quality assessment and for light-field processing, including the generation of new views, require large amounts of data. Most existing datasets consist of static scenes and, in many cases, synthetic contents. This paper presents a novel light-field plenoptic video dataset, KULFR8, involving six real-world scenes with moving objects and 336 distorted light-field videos derived from the original contents; in total, the original scenes in the dataset contain 1800 distinctive frames, with angular resolution of 5x5 with and total spatial resolution of 9600x5400 pixels (considering all the views); overall, the dataset consists of 45,000 different views with spatial resolution of 1920x1080 pixels. We analyse the content characteristics based on the dimensions of the captured objects and via the acquired videos using the central views extracted from each quilted frame. Additionally, we encode and decode the contents using various video encoders across different bitrate ranges. For quality assessments, we consider all the views, utilising frames measuring 9600x5400 pixels, and employ two objective quality metrics: PSNR and SSIM.
引用
收藏
页数:20
相关论文
共 43 条
  • [31] 3D OBJECTIVE QUALITY ASSESSMENT OF LIGHT FIELD VIDEO FRAMES
    Tamboli, Roopak R.
    Kara, Peter A.
    Cserkaszky, Aron
    Barsi, Attila
    Martini, Maria G.
    Appina, Balasubramanyam
    Channappayya, Sumohana S.
    Jana, Soumya
    2018 - 3DTV-CONFERENCE: THE TRUE VISION - CAPTURE, TRANSMISSION AND DISPLAY OF 3D VIDEO (3DTV-CON), 2018,
  • [32] Real-Time Light Field Video Focusing and GPU Accelerated Streaming
    Chlubna, Tomas
    Milet, Tomas
    Zemcik, Pavel
    Kula, Michal
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2023, 95 (06): : 703 - 719
  • [33] Region-of-Interest Compression and View Synthesis for Light Field Video Streaming
    Wang, Bing
    Peng, Qiang
    Wang, Eric
    Han, Kang
    Xiang, Wei
    IEEE ACCESS, 2019, 7 : 41183 - 41192
  • [34] Real-Time Light Field Video Focusing and GPU Accelerated Streaming
    Tomáš Chlubna
    Tomáš Milet
    Pavel Zemčík
    Michal Kula
    Journal of Signal Processing Systems, 2023, 95 : 703 - 719
  • [35] A 3-D DISPLAY PIPELINE FROM CODED-APERTURE CAMERA TO TENSOR LIGHT-FIELD DISPLAY THROUGH CNN
    Maruyama, Keita
    Inagaki, Yasutaka
    Takahashi, Keita
    Fujii, Toshiaki
    Nagahara, Hajime
    2019 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2019, : 1064 - 1068
  • [36] Assessing radiation and light field congruence with a video based electronic portal imaging device
    Luchka, K
    Chen, D
    Shalev, S
    Gluhchev, G
    Rajapakshe, R
    MEDICAL PHYSICS, 1996, 23 (07) : 1245 - 1252
  • [37] High-resolution image generation from video image sequence by light field
    Kobayashi, K
    Saito, H
    VIDEOMETRICS AND OPTICAL METHODS FOR 3D SHAPE MEASUREMENT, 2001, 4309 : 318 - 327
  • [38] Light Field Video Capture Using a Learning-Based Hybrid Imaging System
    Wang, Ting-Chun
    Zhu, Jun-Yan
    Kalantari, Nima Khademi
    Efros, Alexei A.
    Ramamoorthi, Ravi
    ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04):
  • [39] PVBLiF: A Pseudo Video-Based Blind Quality Assessment Metric for Light Field Image
    Zhang, Zhengyu
    Tian, Shishun
    Zou, Wenbin
    Morin, Luce
    Zhang, Lu
    IEEE JOURNAL OF SELECTED TOPICS IN SIGNAL PROCESSING, 2023, 17 (06) : 1193 - 1207
  • [40] Boundary handling for video-based light field coding with a new hybrid scan order
    Thuong Nguyen Canh
    Vinh Van Duong
    Jeon, Byeungwoo
    INTERNATIONAL WORKSHOP ON ADVANCED IMAGE TECHNOLOGY (IWAIT) 2019, 2019, 11049