DACNN: Blind Image Quality Assessment via a Distortion-Aware Convolutional Neural Network

被引:50
作者
Pan, Zhaoqing [1 ]
Zhang, Hao [1 ]
Lei, Jianjun [1 ]
Fang, Yuming [2 ]
Shao, Xiao [3 ]
Ling, Nam [4 ]
Kwong, Sam [5 ]
机构
[1] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
[2] Jiangxi Univ Finance & Econ, Sch Informat Technol, Nanchang 330032, Jiangxi, Peoples R China
[3] Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China
[4] Santa Clara Univ, Dept Comp Sci & Engn, Santa Clara, CA 95053 USA
[5] City Univ Hong Kong, Dept Comp Sci, Hong Kong, Peoples R China
关键词
Distortion; Feature extraction; Image quality; Databases; Fuses; Semantics; Knowledge engineering; Blind image quality assessment; distortion-aware network; Siamese network; fusion network; DATABASE;
D O I
10.1109/TCSVT.2022.3188991
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Deep neural networks have achieved great performance on blind Image Quality Assessment (IQA), but it is still challenging for using one network to accurately predict the quality of images with different distortions. In this paper, a Distortion-Aware Convolutional Neural Network (DACNN) is proposed for blind IQA, which works effectively for not only synthetically distorted images but also authentically distorted images. The proposed DACNN consists of a distortion aware module, a distortion fusion module, and a quality prediction module. In the distortion aware module, a Siamese network-based pretraining strategy is proposed to design a synthetic distortion-aware network for full learning the synthetic distortions, and an authentic distortion-aware network is used for extracting the authentic distortions. To efficiently fuse the learned distortion features, and make the network pay more attention to the essential features, a weight-adaptive fusion network is proposed to adaptively adjust the weight of each distortion. Finally, the quality prediction module is adopted to map the fused features to a quality score. Extensive experiments on four authentic IQA databases and four synthetic IQA databases have proved the effectiveness of the proposed DACNN.
引用
收藏
页码:7518 / 7531
页数:14
相关论文
共 52 条
[31]   No-Reference Image Quality Assessment via Multibranch Convolutional Neural Networks [J].
Pan Z. ;
Yuan F. ;
Wang X. ;
Xu L. ;
Shao X. ;
Kwong S. .
IEEE Transactions on Artificial Intelligence, 2023, 4 (01) :148-160
[32]   VCRNet: Visual Compensation Restoration Network for No-Reference Image Quality Assessment [J].
Pan, Zhaoqing ;
Yuan, Feng ;
Lei, Jianjun ;
Fang, Yuming ;
Shao, Xiao ;
Kwong, Sam .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 :1613-1627
[33]   A Novel Patch Variance Biased Convolutional Neural Network for No-Reference Image Quality Assessment [J].
Po, Lai-Man ;
Liu, Mengyang ;
Yuen, Wilson Y. F. ;
Li, Yuming ;
Xu, Xuyuan ;
Zhou, Chang ;
Wong, Peter H. W. ;
Lau, Kin Wai ;
Luk, Hon-Tung .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (04) :1223-1229
[34]   Image database TID2013: Peculiarities, results and perspectives [J].
Ponomarenko, Nikolay ;
Jin, Lina ;
Ieremeiev, Oleg ;
Lukin, Vladimir ;
Egiazarian, Karen ;
Astola, Jaakko ;
Vozel, Benoit ;
Chehdi, Kacem ;
Carli, Marco ;
Battisti, Federica ;
Kuo, C. -C. Jay .
SIGNAL PROCESSING-IMAGE COMMUNICATION, 2015, 30 :57-77
[35]   PieAPP: Perceptual Image-Error Assessment through Pairwise Preference [J].
Prashnani, Ekta ;
Cai, Hong ;
Mostofi, Yasamin ;
Sen, Pradeep .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :1808-1817
[36]  
Ren HY, 2018, AAAI CONF ARTIF INTE, P7308
[37]  
Ross A., 2017, Basic and Advanced Statistical Tests, P13, DOI [DOI 10.1007/978-94-6351-086-83, DOI 10.1007/978-94-6351-086-8_3]
[38]   A statistical evaluation of recent full reference image quality assessment algorithms [J].
Sheikh, Hamid Rahim ;
Sabir, Muhammad Farooq ;
Bovik, Alan Conrad .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2006, 15 (11) :3440-3451
[39]   Blindly Assess Image Quality in the Wild Guided by A Self-Adaptive Hyper Network [J].
Su, Shaolin ;
Yan, Qingsen ;
Zhu, Yu ;
Zhang, Cheng ;
Ge, Xin ;
Sun, Jinqiu ;
Zhang, Yanning .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3664-3673
[40]   NIMA: Neural Image Assessment [J].
Talebi, Hossein ;
Milanfar, Peyman .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (08) :3998-4011