SISC: A Feature Interaction-Based Metric for Underwater Image Quality Assessment

被引:6
作者
Chu, Xiaohui [1 ]
Hu, Runze [1 ]
Liu, Yutao [2 ]
Cao, Jingchao [2 ]
Xu, Lijun [1 ]
机构
[1] Beijing Inst Technol, Sch Informat & Elect, Beijing 100086, Peoples R China
[2] Ocean Univ China, Sch Comp Sci & Technol, Qingdao 266100, Peoples R China
基金
美国国家科学基金会;
关键词
Attention mechanism; blind/no-reference (NR); deep learning; image quality assessment (IQA); underwater image; FREE-ENERGY PRINCIPLE;
D O I
10.1109/JOE.2023.3329202
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Underwater images are important in a range of image-driven applications, such as marine biology and underwater surveillance. However, underwater imaging is subject to several factors that can severely degrade image quality, i.e., light absorption and scattering within the water column. An effective underwater image quality assessment (UIQA) metric is therefore needed to accurately quantify image quality, subsequently facilitating the follow-up of underwater vision tasks. In this article, we propose a novel feature-interaction-based UIQA framework, namely, SISC, which addresses the challenges of training data scarcity and complex underwater degradation conditions. A feature refinement module is dedicatedly designed based on self-attention to implement local and nonlocal cross-spatial feature interactions. In addition, we enhance the refined features in a cross-scale fashion using upsampling and downsampling strategies based on cross-attention. With the two stages of feature refinement and feature enhancement, the proposed SISC achieves data-efficient learning and superior performance compared to existing state-of-the-art UIQA and natural IQA (images captured in air) methods, indicating its effectiveness in extracting quality-aware features from underwater images.
引用
收藏
页码:637 / 648
页数:12
相关论文
共 55 条
[1]   Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].
Bosse, Sebastian ;
Maniry, Dominique ;
Mueller, Klaus-Robert ;
Wiegand, Thomas ;
Samek, Wojciech .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2018, 27 (01) :206-219
[2]  
Bosse S, 2016, IEEE IMAGE PROC, P3773, DOI 10.1109/ICIP.2016.7533065
[3]   Semi-Reference Sonar Image Quality Assessment Based on Task and Visual Perception [J].
Chen, Weiling ;
Gu, Ke ;
Zhao, Tiesong ;
Jiang, Gangyi ;
Le Callet, Patrick .
IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 :1008-1020
[4]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848
[5]   MobileXNet: An Efficient Convolutional Neural Network for Monocular Depth Estimation [J].
Dong, Xingshuai ;
Garratt, Matthew A. ;
Anavatti, Sreenatha G. ;
Abbass, Hussein A. .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (11) :20134-20147
[6]  
Dosovitskiy Alexey., 2021, PROC INT C LEARN REP, P2021, DOI [10.48550/arXiv.2010.11929, DOI 10.48550/ARXIV.2010.11929]
[7]   3Global Second-order Pooling Convolutional Networks [J].
Gao, Zilin ;
Xie, Jiangtao ;
Wang, Qilong ;
Li, Peihua .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :3019-3028
[8]   No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency [J].
Golestaneh, S. Alireza ;
Dadsetan, Saba ;
Kitani, Kris M. .
2022 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2022), 2022, :3989-3999
[9]   Learning a blind quality evaluation engine of screen content images [J].
Gu, Ke ;
Zhai, Guangtao ;
Lin, Weisi ;
Yang, Xiaokang ;
Zhang, Wenjun .
NEUROCOMPUTING, 2016, 196 :140-149
[10]   Using Free Energy Principle For Blind Image Quality Assessment [J].
Gu, Ke ;
Zhai, Guangtao ;
Yang, Xiaokang ;
Zhang, Wenjun .
IEEE TRANSACTIONS ON MULTIMEDIA, 2015, 17 (01) :50-63