Enhancing Object Detection in Remote Sensing: A Hybrid YOLOv7 and Transformer Approach with Automatic Model Selection

被引:3
|
作者
Ahmed, Mahmoud [1 ]
El-Sheimy, Naser [2 ]
Leung, Henry [1 ]
Moussa, Adel [2 ,3 ]
机构
[1] Univ Calgary, Dept Elect & Software Engn, Calgary, AB T2N 1N4, Canada
[2] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[3] Port Said Univ, Dept Elect & Comp Engn, Port Said 42523, Egypt
关键词
object detection; detection transformer; YOLOv7; multimodalities; NETWORKS;
D O I
10.3390/rs16010051
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the remote sensing field, object detection holds immense value for applications such as land use classification, disaster monitoring, and infrastructure planning, where accurate and efficient identification of objects within images is essential for informed decision making. However, achieving object localization with high precision can be challenging even if minor errors exist at the pixel level, which can significantly impact the ground distance measurements. To address this critical challenge, our research introduces an innovative hybrid approach that combines the capabilities of the You Only Look Once version 7 (YOLOv7) and DEtection TRansformer (DETR) algorithms. By bridging the gap between local receptive field and global context, our approach not only enhances overall object detection accuracy, but also promotes precise object localization, a key requirement in the field of remote sensing. Furthermore, a key advantage of our approach is the introduction of an automatic selection module which serves as an intelligent decision-making component. This module optimizes the selection process between YOLOv7 and DETR, and further improves object detection accuracy. Finally, we validate the improved performance of our new hybrid approach through empirical experimentation, and thus confirm its contribution to the field of target recognition and detection in remote sensing images.
引用
收藏
页数:17
相关论文
共 50 条
  • [41] An improved YOLOv7 model based on Swin Transformer and Trident Pyramid Networks for accurate tomato detection
    Liu, Guoxu
    Zhang, Yonghui
    Liu, Jun
    Liu, Deyong
    Chen, Chunlei
    Li, Yujie
    Zhang, Xiujie
    Mbouembe, Philippe Lyonel Touko
    FRONTIERS IN PLANT SCIENCE, 2024, 15
  • [42] Coupling the Power of YOLOv9 with Transformer for Small Object Detection in Remote-Sensing Images
    Barr, Mohammad
    CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2025,
  • [43] MoL-YOLOv7: Streamlining Industrial Defect Detection With an Optimized YOLOv7 Approach
    Raj, G. Deepti
    Prabadevi, B.
    IEEE ACCESS, 2024, 12 : 117090 - 117101
  • [44] HB-YOLO: An Improved YOLOv7 Algorithm for Dim-Object Tracking in Satellite Remote Sensing Videos
    Yu, Chaoran
    Feng, Zhejun
    Wu, Zengyan
    Wei, Runxi
    Song, Baoming
    Cao, Changqing
    REMOTE SENSING, 2023, 15 (14)
  • [45] FR-YOLOv7: feature enhanced YOLOv7 for rotated small object detection in aerial images
    Tang, Xue
    Deng, Hao
    Liu, Guihua
    Li, Guilin
    Li, Qiuheng
    Zhao, Junqin
    Zhou, Yuan
    MEASUREMENT SCIENCE AND TECHNOLOGY, 2024, 35 (11)
  • [46] An Improved Remote Sensing Object Detection Model Based on YOLOv8s
    Gong, Shuilin
    Li, Xiang
    2024 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS, IJCNN 2024, 2024,
  • [47] Improved YOLOv7 Small Object Detection Algorithm for Seaside Aerial Images
    Yu, Miao
    Jia, YinShan
    ARTIFICIAL INTELLIGENCE AND ROBOTICS, ISAIR 2023, 2024, 1998 : 483 - 491
  • [48] Defect detection of small object solder joints based on improved YOLOv7
    Liu, Zhaolong
    Cao, Wei
    Gao, Junwei
    CHINESE JOURNAL OF LIQUID CRYSTALS AND DISPLAYS, 2024, 39 (10)
  • [49] A Small Object Detection Algorithm for Traffic Signs Based on Improved YOLOv7
    Li, Songjiang
    Wang, Shilong
    Wang, Peng
    SENSORS, 2023, 23 (16)
  • [50] Lightweight Low-Light Object Detection Algorithm Based on YOLOv7
    Li Changyu
    Ge Lei
    LASER & OPTOELECTRONICS PROGRESS, 2024, 61 (14)