Blind Image Quality Assessment via Adaptive Graph Attention

被引:10
作者
Wang, Huasheng [1 ]
Liu, Jiang [1 ]
Tan, Hongchen [2 ]
Lou, Jianxun [1 ]
Liu, Xiaochang [3 ]
Zhou, Wei [1 ]
Liu, Hantao [1 ]
机构
[1] Cardiff Univ, Sch Comp Sci Informat, Cardiff CF10 3AT, Wales
[2] Dalian Univ Technol, Coll Future Technol, Dalian 116024, Peoples R China
[3] Sun Yat Sen Univ, Sch Math, Guangzhou 510275, Peoples R China
关键词
Transformers; Image quality; Feature extraction; Adaptation models; Predictive models; Deep learning; Task analysis; Image quality assessment; no-reference; graph; convolutional neural networks; deep learning; NATURAL SCENE STATISTICS;
D O I
10.1109/TCSVT.2024.3405789
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
Recent advancements in blind image quality assessment (BIQA) are primarily propelled by deep learning technologies. While leveraging transformers can effectively capture long-range dependencies and contextual details in images, the significance of local information in image quality assessment can be undervalued. To address this challenging problem, we propose a novel feature enhancement framework tailored for BIQA. Specifically, we devise an Adaptive Graph Attention (AGA) module to simultaneously augment both local and contextual information. It not only refines the post-transformer features into an adaptive graph, facilitating local information enhancement, but also exploits interactions amongst diverse feature channels. The proposed technique can better reduce redundant information introduced during feature updates compared to traditional convolution layers, streamlining the self-updating process for feature maps. Experimental results show that our proposed model outperforms state-of-the-art BIQA models in predicting the perceived quality of images. The code is available at https://github.com/sky-whs/AGAIQA.
引用
收藏
页码:10299 / 10309
页数:11
相关论文
共 50 条
[1]   The 2018 PIRM Challenge on Perceptual Image Super-Resolution [J].
Blau, Yochai ;
Mechrez, Roey ;
Timofte, Radu ;
Michaeli, Tomer ;
Zelnik-Manor, Lihi .
COMPUTER VISION - ECCV 2018 WORKSHOPS, PT V, 2019, 11133 :334-355
[2]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[3]   VDTR: Video Deblurring With Transformer [J].
Cao, Mingdeng ;
Fan, Yanbo ;
Zhang, Yong ;
Wang, Jue ;
Yang, Yujiu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (01) :160-171
[4]  
Dosovitskiy A, 2021, Arxiv, DOI arXiv:2010.11929
[5]   Perceptual Quality Assessment of Smartphone Photography [J].
Fang, Yuming ;
Zhu, Hanwei ;
Zeng, Yan ;
Ma, Kede ;
Wang, Zhou .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, :3674-3683
[6]   Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning [J].
Gao, Xinbo ;
Gao, Fei ;
Tao, Dacheng ;
Li, Xuelong .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2013, 24 (12) :2013-2026
[7]   Blind Image Quality Assessment: A Fuzzy Neural Network for Opinion Score Distribution Prediction [J].
Gao, Yixuan ;
Min, Xiongkuo ;
Zhu, Yucheng ;
Zhang, Xiao-Ping ;
Zhai, Guangtao .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2024, 34 (03) :1641-1655
[8]   Massive Online Crowdsourced Study of Subjective and Objective Picture Quality [J].
Ghadiyaram, Deepti ;
Bovik, Alan C. .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2016, 25 (01) :372-387
[9]   No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency [J].
Golestaneh, S. Alireza ;
Dadsetan, Saba ;
Kitani, Kris M. .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :3989-3999
[10]  
Gu Jinjin, 2020, Computer Vision - ECCV 2020 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12356), P633, DOI 10.1007/978-3-030-58621-8_37