No-reference stereoscopic image quality assessment on both complex contourlet and spatial domain via Kernel ELM

被引:5
作者
Guan, Tuxin [1 ]
Li, Chaofeng [1 ]
Zheng, Yuhui [2 ]
Zhao, Shenghu [3 ]
Wu, Xiaojun [4 ]
机构
[1] Shanghai Maritime Univ, Inst Logist Sci & Engn, Shanghai 201306, Peoples R China
[2] Nanjing Univ Informat Sci & Technol, Coll Comp & Software, Nanjing 210044, Peoples R China
[3] Anhui Longquan Silicon Mat Co Ltd, Huaiyuan 233400, Anhui, Peoples R China
[4] Jiangnan Univ, Sch Artificial Intelligence & Comp Sci, Wuxi 214122, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
No reference stereoscopic image quality  assessment; Complex contourlet transform; Visual discomfort; CIELAB color space; Kernel extreme learning machine; STATISTICS; EVALUATOR;
D O I
10.1016/j.image.2021.116547
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Stereoscopic imaging is widely used in many fields. To guarantee the best quality of experience, it is necessary to design a robust and accurate quality assessment model for stereoscopic content. In this paper, we proposed a no-reference stereoscopic image quality assessment (NR-SIQA) model using both complex contourlet and spatial domain features of monocular and binocular images. Monocular features extracted from the CIELAB color space are exploited to characterize quality degradation, including the across-scale and across-orientation correlation in complex contourlet domain and natural scene statistics-based (NSS) features in spatial domain. Then, the binocular features consist of energy along with energy difference and structural correlation in complex contourlet domain, and statistics distribution in spatial domain extracted from the synthesized cyclopean image and the 3D visual discomfort measure based on the statistics of disparity map. Finally, the above features are mapped into the predicted quality scores by the Kernel ELM (KELM) regression model. Experimental results on four public datasets show that the proposed model is highly consistent with human subjective perception in terms of accuracy and generalization.
引用
收藏
页数:15
相关论文
共 60 条
[1]   Quality Assessment of Stereoscopic Images [J].
Benoit, Alexandre ;
Le Callet, Patrick ;
Campisi, Patrizio ;
Cousseau, Romain .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2008, 2008 (1)
[2]   Extending CIELAB: Vividness, Vab*, Depth, Dab*, and Clarity, Tab* [J].
Berns, Roy S. .
COLOR RESEARCH AND APPLICATION, 2014, 39 (04) :322-330
[3]   Full-reference quality assessment of stereopairs accounting for rivalry [J].
Chen, Ming-Jun ;
Su, Che-Chun ;
Kwon, Do-Kyoung ;
Cormack, Lawrence K. ;
Bovik, Alan C. .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2013, 28 (09) :1143-1155
[4]   The nonsubsampled contourlet transform: Theory, design, and applications [J].
da Cunha, Arthur L. ;
Zhou, Jianping ;
Do, Minh N. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (10) :3089-3101
[5]   No-reference video quality assessment method based on spatio-temporal features using the ELM algorithm [J].
da Silva, Wyllian Bezerra ;
Mikowski, Alexandre ;
Casali, Rafael Machado .
IET IMAGE PROCESSING, 2020, 14 (07) :1316-1326
[6]   Blind Noisy Image Quality Assessment Using Sub-Band Kurtosis [J].
Deng, Chenwei ;
Wang, Shuigen ;
Bovik, Alan C. ;
Huang, Guang-Bin ;
Zhao, Baojun .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (03) :1146-1156
[7]   Stereoscopic image quality assessment by analysing visual hierarchical structures and binocular effects [J].
Ding, Yong ;
Zhao, Yang ;
Chen, Xiaodong ;
Zhu, Xiaolei ;
Andrey, Krylov .
IET IMAGE PROCESSING, 2019, 13 (10) :1608-1615
[8]   No-Reference Stereoscopic Image Quality Assessment Using Convolutional Neural Network for Adaptive Feature Extraction [J].
Ding, Yong ;
Deng, Ruizhe ;
Xie, Xin ;
Xu, Xiaogang ;
Zhao, Yang ;
Chen, Xiaodong ;
Krylov, Andrey S. .
IEEE ACCESS, 2018, 6 :37595-37603
[9]   No-reference quality assessment for stereoscopic images considering visual discomfort and binocular rivalry [J].
Ding, Yong ;
Zhao, Yang .
ELECTRONICS LETTERS, 2017, 53 (25) :1646-1647
[10]   Stereoscopic image quality assessment by deep convolutional neural network [J].
Fang, Yuming ;
Yan, Jiebin ;
Liu, Xuelin ;
Wang, Jiheng .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 :400-406