Study of 3D Virtual Reality Picture Quality

被引:46
作者
Chen, Meixu [1 ]
Jin, Yize [1 ]
Goodall, Todd [2 ]
Yu, Xiangxu [1 ]
Bovik, Alan Conrad [1 ]
机构
[1] Univ Texas Austin, Dept Elect & Comp Engn, Austin, TX 78705 USA
[2] Facebook, Facebook Real Labs, Menlo Pk, CA 94025 USA
关键词
Databases; Distortion; Image coding; Three-dimensional displays; Image quality; Image resolution; Quality assessment; Image quality assessment; immersive image database; virtual reality; human perception; full reference; STRUCTURAL SIMILARITY; IMAGE; INDEX; EFFICIENT; DEVIATION;
D O I
10.1109/JSTSP.2019.2956408
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Virtual Reality (VR) and its applications have attracted significant and increasing attention. However, the requirements of much larger file sizes, different storage formats, and immersive viewing conditions pose significant challenges to the goals of acquiring, transmitting, compressing and displaying high quality VR content. Towards meeting these challenges, it is important to be able to understand the distortions that arise and that can affect the perceived quality of displayed VR content. It is also important to develop ways to automatically predict VR picture quality. Meeting these challenges requires basic tools in the form of large, representative subjective VR quality databases on which VR quality models can be developed and which can be used to benchmark VR quality prediction algorithms. Towards making progress in this direction, here we present the results of an immersive 3D subjective image quality assessment study. In the study, 450 distorted images obtained from 15 pristine 3D VR images modified by 6 types of distortion of varying severities were evaluated by 42 subjects in a controlled VR setting. Both the subject ratings as well as eye tracking data were recorded and made available as part of the new database, in hopes that the relationships between gaze direction and perceived quality might be better understood. We also evaluated several publicly available IQA models on the new database, and also report a statistical evaluation of the performances of the compared IQA models.
引用
收藏
页码:89 / 102
页数:14
相关论文
共 50 条
[1]   Subjective and Objective Quality Assessment of 2D and 3D Foveated Video Compression in Virtual Reality [J].
Jin, Yize ;
Chen, Meixu ;
Goodall, Todd ;
Patney, Anjul ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 (30) :5905-5919
[2]   Visual Quality of 3D Meshes With Diffuse Colors in Virtual Reality: Subjective and Objective Evaluation [J].
Nehme, Yana ;
Dupont, Florent ;
Farrugia, Jean-Philippe ;
Le Callet, Patrick ;
Lavoue, Guillaume .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2021, 27 (03) :2202-2219
[3]   Instant Reality: Gaze-Contingent Perceptual Optimization for 3D Virtual Reality Streaming [J].
Chen, Shaoyu ;
Duinkharjav, Budmonde ;
Sun, Xin ;
Wei, Li-Yi ;
Petrangeli, Stefano ;
Echevarria, Jose ;
Silva, Claudio ;
Sun, Qi .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2022, 28 (05) :2157-2167
[4]   Study on 3D Virtual Reality Modeling [J].
Yue, Xuejun ;
Hong, Tiansheng ;
Xu, Xing ;
Wu, Weibin .
MATERIALS AND MANUFACTURING TECHNOLOGY, PTS 1 AND 2, 2010, 129-131 :1296-+
[5]   Study of 2D Foveated Video Quality in Virtual Reality [J].
Jin, Yize ;
Chen, Meixu ;
Goodall, Todd ;
Wan, Zhaolin ;
Bovik, Alan C. .
APPLICATIONS OF DIGITAL IMAGE PROCESSING XLIII, 2020, 11510
[6]   Evaluating 3D Visual Comparison Techniques for Change Detection in Virtual Reality [J].
Zhu, Changrui ;
Kruijff, Ernst ;
Pawar, Vijay M. ;
Julier, Simon .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2025, 31 (05) :3245-3255
[7]   Distribution of Landscape Architecture Based on 3D Images and Virtual Reality Rationality Study [J].
Li, Ruiyi ;
Xu, Dawei .
IEEE ACCESS, 2020, 8 :140161-140170
[8]   The Virtual Reality 3D City of Ningbo [J].
Chen, Weimin ;
Wu, Dun .
SIXTH INTERNATIONAL SYMPOSIUM ON DIGITAL EARTH: MODELS, ALGORITHMS, AND VIRTUAL REALITY, 2010, 7840
[9]   Benchmarking of 3D Modelling in Virtual Reality [J].
Tran T.T.H. ;
Foucault G. ;
Pinquié R. .
Computer-Aided Design and Applications, 2022, 19 (06) :1184-1190
[10]   3D User Interface in Virtual Reality [J].
Yue, Gu .
HCI INTERNATIONAL 2021 - LATE BREAKING POSTERS, HCII 2021, PT I, 2021, 1498 :418-423