Enhancing Object Detection in Remote Sensing: A Hybrid YOLOv7 and Transformer Approach with Automatic Model Selection

被引:3
|
作者
Ahmed, Mahmoud [1 ]
El-Sheimy, Naser [2 ]
Leung, Henry [1 ]
Moussa, Adel [2 ,3 ]
机构
[1] Univ Calgary, Dept Elect & Software Engn, Calgary, AB T2N 1N4, Canada
[2] Univ Calgary, Dept Geomat Engn, Calgary, AB T2N 1N4, Canada
[3] Port Said Univ, Dept Elect & Comp Engn, Port Said 42523, Egypt
关键词
object detection; detection transformer; YOLOv7; multimodalities; NETWORKS;
D O I
10.3390/rs16010051
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In the remote sensing field, object detection holds immense value for applications such as land use classification, disaster monitoring, and infrastructure planning, where accurate and efficient identification of objects within images is essential for informed decision making. However, achieving object localization with high precision can be challenging even if minor errors exist at the pixel level, which can significantly impact the ground distance measurements. To address this critical challenge, our research introduces an innovative hybrid approach that combines the capabilities of the You Only Look Once version 7 (YOLOv7) and DEtection TRansformer (DETR) algorithms. By bridging the gap between local receptive field and global context, our approach not only enhances overall object detection accuracy, but also promotes precise object localization, a key requirement in the field of remote sensing. Furthermore, a key advantage of our approach is the introduction of an automatic selection module which serves as an intelligent decision-making component. This module optimizes the selection process between YOLOv7 and DETR, and further improves object detection accuracy. Finally, we validate the improved performance of our new hybrid approach through empirical experimentation, and thus confirm its contribution to the field of target recognition and detection in remote sensing images.
引用
收藏
页数:17
相关论文
共 50 条
  • [21] Study on Lightweight Model of Maize Seedling Object Detection Based on YOLOv7
    Zhao, Kai
    Zhao, Lulu
    Zhao, Yanan
    Deng, Hanbing
    APPLIED SCIENCES-BASEL, 2023, 13 (13):
  • [22] Small object detection model for UAV aerial image based on YOLOv7
    Jinguang Chen
    Ronghui Wen
    Lili Ma
    Signal, Image and Video Processing, 2024, 18 : 2695 - 2707
  • [23] Small object detection model for UAV aerial image based on YOLOv7
    Chen, Jinguang
    Wen, Ronghui
    Ma, Lili
    SIGNAL IMAGE AND VIDEO PROCESSING, 2024, 18 (03) : 2695 - 2707
  • [24] A Trash Detection Model Based on YOLOv7
    Liang, Hu
    Xu, Chao
    He, Tao
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024, 2024, : 300 - 303
  • [25] Research on YOLOv7 Remote Sensing Small Target Detection Algorithm Integrating Attention Mechanism
    Yu, Junyu
    Liu, Sunjun
    Xu, Tao
    Computer Engineering and Applications, 2023, 59 (20) : 167 - 175
  • [26] Research on Underwater Object Detection Algorithm Based on YOLOv7
    Shi, Biying
    Zhang, Lianbo
    Tang, Jialin
    Yan Jinghui
    2024 CROSS STRAIT RADIO SCIENCE AND WIRELESS TECHNOLOGY CONFERENCE, CSRSWTC 2024, 2024, : 501 - 506
  • [27] Enhancing Caries Detection in Bitewing Radiographs Using YOLOv7
    Panyarak, Wannakamon
    Wantanajittikul, Kittichai
    Charuakkra, Arnon
    Prapayasatok, Sangsom
    Suttapak, Wattanapong
    JOURNAL OF DIGITAL IMAGING, 2023, 36 (06) : 2635 - 2647
  • [28] PBA-YOLOv7: An Object Detection Method Based on an Improved YOLOv7 Network
    Sun, Yang
    Li, Yi
    Li, Song
    Duan, Zehao
    Ning, Haonan
    Zhang, Yuhang
    APPLIED SCIENCES-BASEL, 2023, 13 (18):
  • [29] Improved YOLOv7 Object Detection Algorithm for Fisheye Images
    Wu, Zhaodong
    Xu, Cheng
    Liu, Hongzhe
    Fu, Ying
    Jian, Muwei
    Computer Engineering and Applications, 2024, 60 (14) : 250 - 256
  • [30] Enhancing Caries Detection in Bitewing Radiographs Using YOLOv7
    Wannakamon Panyarak
    Kittichai Wantanajittikul
    Arnon Charuakkra
    Sangsom Prapayasatok
    Wattanapong Suttapak
    Journal of Digital Imaging, 2023, 36 : 2635 - 2647