UW-DETR: Feature Fusion Enhanced RT-DETR for Improving Underwater Object Detection

被引:0
|
作者
Li, Xingkun [1 ]
Wang, Yugang [1 ]
Zhao, Yuhao [2 ]
Chen, Guodong [1 ]
机构
[1] Shandong Jiaotong Univ, Naval Architecture & Port Engn Coll, Weihai 264200, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Beijing 100190, Peoples R China
来源
IEEE ACCESS | 2024年 / 12卷
关键词
Feature extraction; Object detection; Semantics; Convolution; Standards; Encoding; Detectors; Transformers; Decoding; Training; Features fusion; underwater object detection; UW-DETR; TRACKING; VISION;
D O I
10.1109/ACCESS.2024.3515960
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Deep learning models for object detection have shown favorable results in controlled environments. However, owing to the complexity of underwater environments, these models suffer from target blurring caused by noise, as well as visual disturbances caused by the protective coloration of underwater organisms. These methods are not sufficiently equipped to effectively address the challenge of underwater object detection. To address the challenges in detection caused by underwater blurriness and the camouflage of objects. In this study, a method called Spatial Semantic Encoding Fusion(SSEF) is proposed. Pooling and bilinear interpolation are utilized by SSEF to standardize features across different scales. The standardized features are then fused using the Hadamard product. The fused features are encoded separately for spatial information and channel semantic information through a dual-branch structure. Finally, the dual-branch features are combined by point-wise addition. SSEF is utilized to enhance the multi-scale feature fusion approach of RT-DETR-r18, proposing an underwater object detection framework named Underwater-DETR(UW-DETR). The experiments are conducted using the UTDAC2020 and Brackish datasets. The experimental results show that UW-DETR outperforms other underwater object detection methods and UW-DETR meets the requirements for underwater applications.
引用
收藏
页码:191967 / 191979
页数:13
相关论文
共 50 条
  • [1] Drone-DETR: Efficient Small Object Detection for Remote Sensing Image Using Enhanced RT-DETR Model
    Kong, Yaning
    Shang, Xiangfeng
    Jia, Shijie
    SENSORS, 2024, 24 (17)
  • [2] RS-DETR: An Improved Remote Sensing Object Detection Model Based on RT-DETR
    Zhang, Hao
    Ma, Zheng
    Li, Xiang
    APPLIED SCIENCES-BASEL, 2024, 14 (22):
  • [3] MSRT-DETR: A novel RT-DETR model with multi-scale feature sequence for cell detection
    Zhou, Chuncheng
    He, Haiyang
    Zhou, Hao
    Ge, Fuhua
    Yu, Pengfei
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2025, 103
  • [4] Optimized RT-DETR for accurate and efficient video object detection via decoupled feature aggregation
    Chen, Hao
    Huang, Wu
    Zhang, Tao
    INTERNATIONAL JOURNAL OF MULTIMEDIA INFORMATION RETRIEVAL, 2025, 14 (01)
  • [5] Improved RT-DETR for Infrared Ship Detection Based on Multi-Attention and Feature Fusion
    Liu, Chun
    Zhang, Yuanliang
    Shen, Jingfu
    Liu, Feiyue
    JOURNAL OF MARINE SCIENCE AND ENGINEERING, 2024, 12 (12)
  • [6] Vehicle detection algorithm based on improved RT-DETR
    Wang, Yuhai
    Xu, Shuobo
    Wang, Peng
    Liu, Lele
    Li, Yanshun
    Song, Ze
    JOURNAL OF SUPERCOMPUTING, 2025, 81 (01):
  • [7] Object Detection in UAV Images Based on RT-DETR with CG Downsampling and CCFMP
    Yu, Chushi
    Shin, Yoan
    2024 IEEE VTS ASIA PACIFIC WIRELESS COMMUNICATIONS SYMPOSIUM, APWCS 2024, 2024,
  • [8] DST-DETR: Image Dehazing RT-DETR for Safety Helmet Detection in Foggy Weather
    Liu, Ziyuan
    Sun, Chunxia
    Wang, Xiaopeng
    SENSORS, 2024, 24 (14)
  • [9] Eye Landmarks Detection using RT-DETR with Rules
    Boonnithititikul, Chatree
    Jaknamon, Teetouch
    Chawuthai, Rathachai
    2024 21ST INTERNATIONAL CONFERENCE ON ELECTRICAL ENGINEERING/ELECTRONICS, COMPUTER, TELECOMMUNICATIONS AND INFORMATION TECHNOLOGY, ECTI-CON 2024, 2024,
  • [10] Enhanced real-time detection transformer (RT-DETR) for robotic inspection of underwater bridge pier cracks
    Lv, Zhenming
    Dong, Shaojiang
    Xia, Zongyou
    He, Jingyao
    Zhang, Jiawei
    AUTOMATION IN CONSTRUCTION, 2025, 170