CABDet: context-and-attention-based detector for small object detection in remote sensing images

被引:0
作者
Zhang, Mingzhi [1 ]
He, Xiaohai [1 ]
Teng, Qizhi [1 ]
Niu, Tong [1 ]
Chen, Honggang [1 ]
机构
[1] Sichuan Univ, Coll Elect & Informat Engn, Chengdu, Peoples R China
基金
中国国家自然科学基金;
关键词
remote sensing images; small object; object detection; deep learning; context; attention mechanism; anchor-free detector; NETWORK;
D O I
10.1117/1.JRS.17.044515
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
Detecting small objects in remote sensing images is a challenging task. Existing object detectors for remote sensing images suffer from two issues: (1) insufficient feature extraction for small objects in the backbone network and (2) feature misalignment and information loss for small objects in the neck network, leading to poor detection performance on small objects. To address these challenges, a small object detector named CABDet for remote sensing images that combines context and attention mechanisms is proposed. Specifically, an enhanced ResNet50 is designed as a novel backbone network that adaptively adjusts the size of receptive fields to fully extract feature information of small objects. Additionally, an adaptive multiscale feature pyramid network (AM-FPN) is proposed. To alleviate the problem of feature misalignment for small objects, AM-FPN leverages self-attention mechanisms to establish semantic and spatial dependencies between adjacent feature layers. Then to mitigate the issue of information loss for small objects, AM-FPN captures semantic dependencies between subregions of current layer features through self-attention mechanisms to preserve channel information. Extensive experiments were conducted on two demanding remote sensing datasets, namely dataset for object detection in aerial images and UCAS-high resolution aerial object detection dataset, to demonstrate the effectiveness of the proposed methodology in achieving superior detection performance when compared with contemporary state-of-the-art approaches.
引用
收藏
页数:20
相关论文
共 73 条
[1]  
Bochkovskiy A, 2020, Arxiv, DOI [arXiv:2004.10934, 10.48550/arXiv.2004.10934, DOI 10.48550/ARXIV.2004.10934]
[2]  
Cao JX, 2020, Arxiv, DOI arXiv:2005.11475
[3]   RRNet: A Hybrid Detector for Object Detection in Drone-captured Images [J].
Chen, Changrui ;
Zhang, Yu ;
Lv, Qingxuan ;
Wei, Shuo ;
Wang, Xiaorui ;
Sun, Xin ;
Dong, Junyu .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION WORKSHOPS (ICCVW), 2019, :100-108
[4]   PIoU Loss: Towards Accurate Oriented Object Detection in Complex Environments [J].
Chen, Zhiming ;
Chen, Kean ;
Lin, Weiyao ;
See, John ;
Yu, Hui ;
Ke, Yan ;
Yang, Cong .
COMPUTER VISION - ECCV 2020, PT V, 2020, 12350 :195-211
[5]  
Cheng G, 2023, Arxiv, DOI arXiv:2207.14096
[6]   Anchor-Free Oriented Proposal Generator for Object Detection [J].
Cheng, Gong ;
Wang, Jiabao ;
Li, Ke ;
Xie, Xingxing ;
Lang, Chunbo ;
Yao, Yanqing ;
Han, Junwei .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[7]   Learning RoI Transformer for Oriented Object Detection in Aerial Images [J].
Ding, Jian ;
Xue, Nan ;
Long, Yang ;
Xia, Gui-Song ;
Lu, Qikai .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :2844-2853
[8]   CenterNet: Keypoint Triplets for Object Detection [J].
Duan, Kaiwen ;
Bai, Song ;
Xie, Lingxi ;
Qi, Honggang ;
Huang, Qingming ;
Tian, Qi .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :6568-6577
[9]   Small object detection in remote sensing images based on super-resolution [J].
Fang Xiaolin ;
Hu Fan ;
Yang Ming ;
Zhu Tongxin ;
Bi Ran ;
Zhang Zenghui ;
Gao Zhiyuan .
PATTERN RECOGNITION LETTERS, 2022, 153 :107-112
[10]   An Anchor-Free Method Based on Feature Balancing and Refinement Network for Multiscale Ship Detection in SAR Images [J].
Fu, Jiamei ;
Sun, Xian ;
Wang, Zhirui ;
Fu, Kun .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2021, 59 (02) :1331-1344