Boths: Super Lightweight Network-Enabled Underwater Image Enhancement

被引:17
作者
Liu, Xu [1 ]
Lin, Sen [2 ]
Chi, Kaichen [3 ]
Tao, Zhiyong [4 ]
Zhao, Yang [1 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230601, Peoples R China
[2] Shenyang Ligong Univ, Sch Automat & Elect Engn, Shenyang 110159, Peoples R China
[3] Northwestern Polytech Univ, Sch Artificial Intelligence Opt & Elect, Xian 710072, Peoples R China
[4] Liaoning Tech Univ, Sch Elect & Informat Engn, Huludao 125105, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D attention learning; high- and low-frequency loss functions; structure and detail interaction; underwater image enhancement; QUALITY;
D O I
10.1109/LGRS.2022.3230049
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Since light is scattered and absorbed by water, underwater images have inherent degradation (e.g., hazing, color shift), consequently impeding the development of remotely operated vehicles (ROVs). Toward this end, we propose a novel method, referred to as Best of Both Worlds (Boths). With parameters of only 0.0064 M, Boths can be considered a super lightweight neural network for underwater image enhancement. On the whole, it has three levels: structure and detail features; pixel and channel dimensions; high-and low-frequency information. Each of these three levels represents "Best of Both Worlds." Initially, by interacting with structure and detail features, Boths can focus on these two aspects at the same time. Further, our network can simultaneously consider channel and pixel dimensions through 3-D attention learning, which is more similar to human visual perception. Lastly, the proposed model can focus on high-and low-frequency information, through a novel loss function based on the wavelet transforms. Upon subsequent analysis and evaluation, Boths has shown superior performance compared with state-of-the-art (SOTA) methods. Our models and datasets are publicly available at: https://github.com/perseveranceLX/Boths.
引用
收藏
页数:5
相关论文
共 26 条
[1]  
Ashford E., 2021, PROC OCEANS SAN DIEG, P1
[2]   Visual attention: The past 25 years [J].
Carrasco, Marisa .
VISION RESEARCH, 2011, 51 (13) :1484-1525
[3]   Towards Real-Time Advancement of Underwater Visual Quality With GAN [J].
Chen, Xingyu ;
Yu, Junzhi ;
Kong, Shihan ;
Wu, Zhengxing ;
Fang, Xi ;
Wen, Li .
IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS, 2019, 66 (12) :9350-9359
[4]   Model-Assisted Multiband Fusion for Single Image Enhancement and Applications to Robot Vision [J].
Cho, Younggun ;
Jeong, Jinyong ;
Kim, Ayoung .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2018, 3 (04) :2822-2829
[5]   Ocean Color Remote Sensing of Atypical Marine Optical Cases [J].
D'Alimonte, Davide ;
Kajiyama, Tamito ;
Saptawijaya, Ari .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (11) :6574-6586
[6]  
Danielson SL, 2017, OCEANS-IEEE
[7]   Fast Underwater Image Enhancement for Improved Visual Perception [J].
Islam, Md Jahidul ;
Xia, Youya ;
Sattar, Junaed .
IEEE ROBOTICS AND AUTOMATION LETTERS, 2020, 5 (02) :3227-3234
[8]   Underwater Image Enhancement With Lightweight Cascaded Network [J].
Jiang, Nanfeng ;
Chen, Weiling ;
Lin, Yuting ;
Zhao, Tiesong ;
Lin, Chia-Wen .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :4301-4313
[9]  
Kurbiel T., 2017, ARXIV
[10]   Underwater Image Enhancement via Medium Transmission-Guided Multi-Color Space Embedding [J].
Li, Chongyi ;
Anwar, Saeed ;
Hou, Junhui ;
Cong, Runmin ;
Guo, Chunle ;
Ren, Wenqi .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 :4985-5000