UnitModule: A lightweight joint image enhancement module for underwater object detection

被引:23
作者
Liu, Zhuoyan [1 ]
Wang, Bo [1 ]
Li, Ye [1 ]
He, Jiaxian [1 ]
Li, Yunfeng [1 ]
机构
[1] Harbin Engn Univ, Natl Key Lab Autonomous Marine Vehicle Technol, Harbin 150001, Peoples R China
基金
中国国家自然科学基金;
关键词
Underwater object detection; Image enhancement; Unsupervised learning; Joint training;
D O I
10.1016/j.patcog.2024.110435
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection faces the problem of underwater image degradation, which affects the performance of the detector. Underwater object detection methods based on noise reduction and image enhancement usually do not provide images preferred by the detector or require additional datasets. In this paper, we propose a plug-and-play U nderwater joint n t i mage enhancement t Module (UnitModule) that provides the input image preferred by the detector. We design an unsupervised learning loss for the joint training of UnitModule with the detector without additional datasets to improve the interaction between UnitModule and the detector. Furthermore, a color cast predictor with the assisting color cast loss and a data augmentation called Underwater Color Random Transfer (UCRT) are designed to improve the performance of UnitModule on underwater images with different color casts. Extensive experiments are conducted on DUO for different object detection models, where UnitModule achieves the highest performance improvement of 2.6 AP for YOLOv5-S and gains the improvement of 3.3 AP on the brand-new test set (URPCtest). t est ). And UnitModule significantly improves the performance of all object detection models we test, especially for models with a small number of parameters. In addition, UnitModule with a small number of parameters of 31K has little effect on the inference speed of the original object detection model. Our quantitative and visual analysis also demonstrates the effectiveness of UnitModule in enhancing the input image and improving the perception ability of the detector for object features. The code is available at https://github.com/LEFTeyex/UnitModule.
引用
收藏
页数:11
相关论文
共 47 条
[1]   A Revised Underwater Image Formation Model [J].
Akkaynak, Derya ;
Treibitz, Tali .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :6723-6732
[2]  
Bubeck Sebastien, 2021, Advances in Neural Information Processing Systems (NeurIPS), V34, P3
[3]   Cascade R-CNN: High Quality Object Detection and Instance Segmentation [J].
Cai, Zhaowei ;
Vasconcelos, Nuno .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (05) :1483-1498
[4]   End-to-End Object Detection with Transformers [J].
Carion, Nicolas ;
Massa, Francisco ;
Synnaeve, Gabriel ;
Usunier, Nicolas ;
Kirillov, Alexander ;
Zagoruyko, Sergey .
COMPUTER VISION - ECCV 2020, PT I, 2020, 12346 :213-229
[5]  
Chen K, 2019, Arxiv, DOI [arXiv:1906.07155, DOI 10.48550/ARXIV.1906.07155]
[6]   SWIPENET: Object detection in noisy underwater scenes [J].
Chen, Long ;
Zhou, Feixiang ;
Wang, Shengke ;
Dong, Junyu ;
Li, Ning ;
Ma, Haiping ;
Wang, Xin ;
Zhou, Huiyu .
PATTERN RECOGNITION, 2022, 132
[7]   Perceptual Underwater Image Enhancement With Deep Learning and Physical Priors [J].
Chen, Long ;
Jiang, Zheheng ;
Tong, Lei ;
Liu, Zhihua ;
Zhao, Aite ;
Zhang, Qianni ;
Dong, Junyu ;
Zhou, Huiyu .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2021, 31 (08) :3078-3092
[8]   Achieving domain generalization for underwater object detection by domain mixup and contrastive learning [J].
Chen, Yang ;
Song, Pinhao ;
Liu, Hong ;
Dai, Linhui ;
Zhang, Xiaochuan ;
Ding, Runwei ;
Li, Shengquan .
NEUROCOMPUTING, 2023, 528 :20-34
[9]   A gated cross-domain collaborative network for underwater object detection [J].
Dai, Linhui ;
Liu, Hong ;
Song, Pinhao ;
Liu, Mengyuan .
PATTERN RECOGNITION, 2024, 149
[10]  
Deng J, 2009, PROC CVPR IEEE, P248, DOI 10.1109/CVPRW.2009.5206848