Subjective and Objective Quality Assessment of Stitched Images for Virtual Reality

被引:67
作者
Madhusudana, Pavan Chennagiri [1 ]
Soundararajan, Rajiv [1 ]
机构
[1] Indian Inst Sci, Dept Elect Commun Engn, Bengaluru 560012, Karnataka, India
关键词
Image quality assessment; virtual reality; image panorama; generalized Gaussian distribution; steerable pyramids; image stitching; Gaussian mixture model; COLOR TRANSFER; STATISTICS; FEATURES;
D O I
10.1109/TIP.2019.2921858
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
We consider the problem of quality assessment (QA) of image stitching algorithms used to generate panoramic images for virtual reality applications. Our contributions are twofold. We design the Indian Institute of Science Stitched Image QA (ISIQA) database consisting of 264 stitched images and 6600 human quality ratings. The database consists of a variety of artifacts clue to stitching such as blur, ghosting, photometric, and geometric distortions. We then devise an objective QA model called the stitched image quality evaluator (SIQE) using the statistics of steerable pyramid decompositions. In particular, we propose a Gaussian mixture model to capture the bivariate statistics of neighboring coefficients of steerable pyramid decompositions and show this to he effective in modeling the increased spatial correlation due to ghosting artifacts. We show through extensive experiments that our quality model correlates very well with subjective scores in the ISIQA database. The ISIQA database as well as the software release of SIQE has been made available online for public use and evaluation purposes.
引用
收藏
页码:5620 / 5635
页数:16
相关论文
共 68 条
[1]  
[Anonymous], P PCS 16
[2]  
[Anonymous], IISC STITCHED IMAGE
[3]  
[Anonymous], 2011, BAYESIAN INFERENCE S
[4]   SURF: Speeded up robust features [J].
Bay, Herbert ;
Tuytelaars, Tinne ;
Van Gool, Luc .
COMPUTER VISION - ECCV 2006 , PT 1, PROCEEDINGS, 2006, 3951 :404-417
[5]   Dissecting and Reassembling Color Correction Algorithms for Image Stitching [J].
Bellavia, Fabio ;
Colombo, Carlo .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (02) :735-748
[6]  
Brown M, 2003, NINTH IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION, VOLS I AND II, PROCEEDINGS, P1218
[7]   Automatic panoramic image stitching using invariant features [J].
Brown, Matthew ;
Lowe, David G. .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 2007, 74 (01) :59-73
[8]   A MULTIRESOLUTION SPLINE WITH APPLICATION TO IMAGE MOSAICS [J].
BURT, PJ ;
ADELSON, EH .
ACM TRANSACTIONS ON GRAPHICS, 1983, 2 (04) :217-236
[9]  
Chang C. C., 2011, ACM T INTEL SYST TEC, V2, P1, DOI DOI 10.1145/1961189.1961199
[10]   Shape-Preserving Half-Projective Warps for Image Stitching [J].
Chang, Che-Han ;
Sato, Yoichi ;
Chuang, Yung-Yu .
2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :3254-3261