Enhancing Object Detection in Remote Sensing: A Hybrid YOLOv7 and Transformer Approach with Automatic Model Selection

被引:3
|
作者
Ahmed, Mahmoud [1 ]
El-Sheimy, Naser [2 ]
Leung, Henry [1 ]
Moussa, Adel [2 ,3 ]
机构
[1] Univ Calgary, Dept Elect & Software Engn, Calgary, AB T2N 1N4, Canada
[2] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[3] Port Said Univ, Dept Elect & Comp Engn, Port Said 42523, Egypt
关键词
object detection; detection transformer; YOLOv7; multimodalities; NETWORKS;
D O I
10.3390/rs16010051
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the remote sensing field, object detection holds immense value for applications such as land use classification, disaster monitoring, and infrastructure planning, where accurate and efficient identification of objects within images is essential for informed decision making. However, achieving object localization with high precision can be challenging even if minor errors exist at the pixel level, which can significantly impact the ground distance measurements. To address this critical challenge, our research introduces an innovative hybrid approach that combines the capabilities of the You Only Look Once version 7 (YOLOv7) and DEtection TRansformer (DETR) algorithms. By bridging the gap between local receptive field and global context, our approach not only enhances overall object detection accuracy, but also promotes precise object localization, a key requirement in the field of remote sensing. Furthermore, a key advantage of our approach is the introduction of an automatic selection module which serves as an intelligent decision-making component. This module optimizes the selection process between YOLOv7 and DETR, and further improves object detection accuracy. Finally, we validate the improved performance of our new hybrid approach through empirical experimentation, and thus confirm its contribution to the field of target recognition and detection in remote sensing images.
引用
收藏
页数:17
相关论文
共 50 条
  • [31] GCP-YOLO: a lightweight underwater object detection model based on YOLOv7
    Gao, Yu
    Li, Zhanying
    Zhang, Kangye
    Kong, Lingyan
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2025, 22 (01)
  • [32] YOLOv7 Model for Small Object Handling in Maritime Images
    Pobar, Miran
    CENTRAL EUROPEAN CONFERENCE ON INFORMATION AND INTELLIGENT SYSTEMS, CECIIS, 2023, : 391 - 397
  • [33] Improved YOLOv7 models based on modulated deformable convolution and swin transformer for object detection in fisheye images
    Zhou, Jie
    Yang, Degang
    Song, Tingting
    Ye, Yichen
    Zhang, Xin
    Song, Yingze
    IMAGE AND VISION COMPUTING, 2024, 144
  • [34] YOLOv7-sea: Object Detection of Maritime UAV Images based on Improved YOLOv7
    Zhao, Hangyue
    Zhang, Hongpu
    Zhao, Yanyun
    2023 IEEE/CVF WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION WORKSHOPS (WACVW), 2023, : 233 - 238
  • [35] Improved YOLOv7 Underwater Object Detection Based on Attention Mechanism
    Fu, Junshang
    Tian, Ying
    ENGINEERING LETTERS, 2024, 32 (07) : 1377 - 1384
  • [36] Improved YOLOv7 model for insulator defect detection
    Wang, Zhenyue
    Yuan, Guowu
    Zhou, Hao
    Ma, Yi
    Ma, Yutang
    Chen, Dong
    ELECTRONIC RESEARCH ARCHIVE, 2024, 32 (04): : 2880 - 2896
  • [37] Underwater optical image object detection based on YOLOv7 algorithm
    Wang, Shaojie
    Wu, Weichao
    Wang, Xinyuan
    Han, Yongchen
    Ma, Yuwei
    OCEANS 2023 - LIMERICK, 2023,
  • [38] Improved Complex Road Scene Object Detection Algorithm of YOLOv7
    Du, Juan
    Cui, Shaohua
    Jin, Meijuan
    Ru, Chen
    Computer Engineering and Applications, 2024, 60 (01) : 96 - 103
  • [39] Object Detection Based on Improved YOLOv7 for UAV Aerial Image
    Cui, Liqun
    Cao, Huawei
    Computer Engineering and Applications, 60 (20): : 189 - 197
  • [40] Image-Fused-Guided Underwater Object Detection Model Based on Improved YOLOv7
    Wang, Zhenhua
    Zhang, Guangshi
    Luan, Kuifeng
    Yi, Congqin
    Li, Mingjie
    ELECTRONICS, 2023, 12 (19)