A dual-branch joint learning network for underwater object detection

被引:16
作者
Wang, Bowen [1 ]
Wang, Zhi [1 ]
Guo, Wenhui [1 ]
Wang, Yanjiang [1 ]
机构
[1] China Univ Petr East China, Coll Control Sci & Engn, Qingdao 266580, Shandong, Peoples R China
关键词
Underwater object detection; Underwater image processing; Joint learning; Edge enhancement; Feature fusion; IMAGE-ENHANCEMENT;
D O I
10.1016/j.knosys.2024.111672
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Underwater object detection (UOD) is crucial for developing marine resources, environmental monitoring, and ecological protection. However, the degradation of underwater images limits the performance of object detectors. Most existing schemes treat underwater image enhancement (UIE) and UOD as two independent tasks, which take UIE as a preprocessing step to reduce the degradation problem, thus being unable to improve the detection accuracy effectively. Therefore, in this paper, we propose a dual -branch joint learning network (DJL-Net) that combines image processing and object detection through multi -task joint learning to construct an end -to -end model for underwater detection. With the dual -branch structure, DJL-Net can use the enhanced images generated by the image -processing module to supplement the features lost due to the degradation of the original underwater images. Specifically, DJL-Net first employs an image decolorization module governed by the detection loss, generating gray images to eliminate color disturbances stemming from underwater light absorption and scattering effects. An improved edge enhancement module is utilized to enhance the shape and texture expression in gray images and improve the recognition of object boundary features. Then, the generated edge -enhanced gray images and their original underwater images are input into the two branches to learn different types of features. Finally, a tridimensional adaptive gated feature fusion module is proposed to effectively fuse the complementary features learned from the two branches. Comprehensive experiments on four UOD datasets, including some scenes with challenging underwater environments, demonstrate the effectiveness and robustness of the proposed DJL-Net.
引用
收藏
页数:16
相关论文
共 50 条
[41]   Low-Visibility Scene Enhancement by Isomorphic Dual-Branch Framework With Attention Learning [J].
Li, Zhan ;
Kuang, Wenqing ;
Bhanu, Bir ;
Deng, Yifan ;
Chen, Yihang ;
Xu, Kangkang .
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2025, 26 (05) :7127-7141
[42]   Multi-branch attention mechanism and path enhancement for underwater object detection [J].
Wang, Haibo ;
Zhou, Zhiyu .
ENGINEERING RESEARCH EXPRESS, 2025, 7 (02)
[43]   A novel image enhancement method via dual-branch coupled Transformer network for underground coalmine [J].
Cheng, Jian ;
Song, Zelong ;
Li, Hao ;
Ma, Yongzhuang ;
Li, Heping ;
Sun, Dazhi .
Meitan Xuebao/Journal of the China Coal Society, 2024, 49 (09) :4027-4037
[44]   DBENet: Dual-Branch Brightness Enhancement Fusion Network for Low-Light Image Enhancement [J].
Chen, Yongqiang ;
Wen, Chenglin ;
Liu, Weifeng ;
He, Wei .
ELECTRONICS, 2023, 12 (18)
[45]   A dual-branch feature fusion neural network for fish image fine-grained recognition [J].
Geng, Xu ;
Gao, Jinxiong ;
Zhang, Yonghui ;
Wang, Rong .
VISUAL COMPUTER, 2024, 40 (10) :6883-6896
[46]   A Dual-Branch Attention fusion deep network for multiresolution remote-Sensing image classification [J].
Zhu, Hao ;
Ma, Wenping ;
Li, Lingling ;
Jiao, Licheng ;
Yang, Shuyuan ;
Hou, Biao .
INFORMATION FUSION, 2020, 58 (58) :116-131
[47]   A systematic review and analysis of deep learning-based underwater object detection [J].
Xu, Shubo ;
Zhang, Minghua ;
Song, Wei ;
Mei, Haibin ;
He, Qi ;
Liotta, Antonio .
NEUROCOMPUTING, 2023, 527 :204-232
[48]   A CNN- and Transformer-Based Dual-Branch Network for Change Detection with Cross-Layer Feature Fusion and Edge Constraints [J].
Wang, Xiaofeng ;
Guo, Zhongyu ;
Feng, Ruyi .
REMOTE SENSING, 2024, 16 (14)
[49]   Collaborative Framework for Underwater Object Detection via Joint Image Enhancement and Super-Resolution [J].
Ji, Xun ;
Liu, Guo-Peng ;
Cai, Cheng-Tao .
JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2023, 11 (09)
[50]   MFDNN: multi-scale feature-weighted dual-neck network for underwater object detection [J].
Xu, Huipu ;
Zhang, Meixiang ;
Tong, Pengfei .
JOURNAL OF ELECTRONIC IMAGING, 2024, 33 (02)