No-Reference Light Field Image Quality Assessment Exploiting Saliency

被引:14
作者
Lamichhane, Kamal [1 ]
Neri, Michael [1 ]
Battisti, Federica [2 ]
Paudyal, Pradip [3 ]
Carli, Marco [1 ]
机构
[1] Roma Tre Univ, Dept Ind Elect & Mech Engn, I-00154 Rome, Italy
[2] Univ Padua, Dept Informat Engn, I-35122 Padua, Italy
[3] Nepal Telecommun Author, Kathmandu 44600, Nepal
关键词
Measurement; Feature extraction; Distortion; Light fields; Three-dimensional displays; Image quality; Multimedia communication; No-reference image quality assessment; quality of experience; immersive media; light field imaging; multimedia broadcasting; STATISTICS; SCALE;
D O I
10.1109/TBC.2023.3242150
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
In the near future, the broadcasting scenario will be characterized by immersive content. One of the systems for capturing the 3D content of a scene is the Light Field imaging. The huge amount of data and the specific transmission scenario impose strong constraints on services and applications. Among others, the evaluation of the quality of the received media cannot rely on the original signal but should be based only on the received data. In this direction, we propose a no-reference quality metric for light field images which is based on spatial and angular characteristics. In more details, the estimated saliency and cyclopean maps of light field images are exploited to extract the spatial features. The angular consistency features are, instead, measured with the use of the Global Luminance Distribution knowledge and the Weighted Local Binary Patterns operator on Epipolar Plane Images. The effectiveness of the proposed metric is assessed by comparing its performance with state-of-the-art quality metrics using 4 datasets: SMART, Win5-LID, VALID 10-bit, and VALID 8-bit. Furthermore, the performance is analyzed in cross-datasets, with different distortions, and for different saliency maps. The achieved results show that the performance of the proposed model outperforms state-of-the-art approaches and perform well for different distortion types and with various saliency models.
引用
收藏
页码:790 / 800
页数:11
相关论文
共 81 条
  • [1] Adelson E. H., 1984, RCA ENG, V29, P33
  • [2] Towards a quality metric for dense light fields
    Adhikarla, Vamsi Kiran
    Vinkler, Marek
    Sumin, Denis
    Mantiuk, Rafal K.
    Myszkowski, Karol
    Seidel, Hans-Peter
    Didyk, Piotr
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 3720 - 3729
  • [3] Ahmad W, 2017, IEEE IMAGE PROC, P4557, DOI 10.1109/ICIP.2017.8297145
  • [4] Face description with local binary patterns:: Application to face recognition
    Ahonen, Timo
    Hadid, Abdenour
    Pietikainen, Matti
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2006, 28 (12) : 2037 - 2041
  • [5] A two-stream cnn based visual quality assessment method for light field images
    Alamgeer, Sana
    Farias, Mylene C. Q.
    [J]. MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (04) : 5743 - 5762
  • [6] [Anonymous], Cisco annual Internet report (2018-2023)
  • [7] Arru G., 2019, Electron. Imaging, V2019
  • [8] Bergstra J, 2012, J MACH LEARN RES, V13, P281
  • [9] Bob Fisher, 1997, EPIPOLAR GEOMETRY
  • [10] EPIPOLAR-PLANE IMAGE-ANALYSIS - AN APPROACH TO DETERMINING STRUCTURE FROM MOTION
    BOLLES, RC
    BAKER, HH
    MARIMONT, DH
    [J]. INTERNATIONAL JOURNAL OF COMPUTER VISION, 1987, 1 (01) : 7 - 55