Real-Time Object Detection in Remote Sensing Images Based on Visual Perception and Memory Reasoning

被引:9
作者
Hua, Xia [1 ]
Wang, Xinqing [1 ]
Rui, Ting [1 ]
Wang, Dong [1 ,2 ]
Shao, Faming [1 ]
机构
[1] PLA Army Engn Univ, Coll Field Engn, Nanjing 210007, Jiangsu, Peoples R China
[2] Southern Theatre Command, Inst Engn Res & Design 2, Kunming 650222, Yunnan, Peoples R China
基金
中国国家自然科学基金; 中国博士后科学基金;
关键词
remote sensing images; deep learning; neural network; visual perception; object detection; HIERARCHICAL SALIENCY;
D O I
10.3390/electronics8101151
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Aiming at the real-time detection of multiple objects and micro-objects in large-scene remote sensing images, a cascaded convolutional neural network real-time object-detection framework for remote sensing images is proposed, which integrates visual perception and convolutional memory network reasoning. The detection framework is composed of two fully convolutional networks, namely, the strengthened object self-attention pre-screening fully convolutional network (SOSA-FCN) and the object accurate detection fully convolutional network (AD-FCN). SOSA-FCN introduces a self-attention module to extract attention feature maps and constructs a depth feature pyramid to optimize the attention feature maps by combining convolutional long-term and short-term memory networks. It guides the acquisition of potential sub-regions of the object in the scene, reduces the computational complexity, and enhances the network's ability to extract multi-scale object features. It adapts to the complex background and small object characteristics of a large-scene remote sensing image. In AD-FCN, the object mask and object orientation estimation layer are designed to achieve fine positioning of candidate frames. The performance of the proposed algorithm is compared with that of other advanced methods on NWPU_VHR-10, DOTA, UCAS-AOD, and other open datasets. The experimental results show that the proposed algorithm significantly improves the efficiency of object detection while ensuring detection accuracy and has high adaptability. It has extensive engineering application prospects.
引用
收藏
页数:19
相关论文
共 50 条
[21]   A Low-Cost and Lightweight Real-Time Object-Detection Method Based on UAV Remote Sensing in Transportation Systems [J].
Liu, Ziye ;
Chen, Chen ;
Huang, Ziqin ;
Chang, Yoong Choon ;
Liu, Lei ;
Pei, Qingqi .
REMOTE SENSING, 2024, 16 (19)
[22]   MEMORY-BASED CODEBOOK MODEL FOR REAL-TIME OBJECT DETECTION [J].
Niu Xiaoran ;
Wang Yanjiang ;
Qi Yujuan .
2014 12TH INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING (ICSP), 2014, :913-917
[23]   Memory-based codebook modeling for real-time object detection [J].
Qi, Yujuan ;
Niu, Xiaoran ;
Wang, Yanjiang .
Zhongguo Shiyou Daxue Xuebao (Ziran Kexue Ban)/Journal of China University of Petroleum (Edition of Natural Science), 2015, 39 (04) :178-184
[24]   Few shot object detection in remote sensing images [J].
Zhang, Xingyu ;
Zhang, Haopeng ;
Jiang, Zhiguo .
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXVII, 2021, 11862
[25]   A Survey of Object Detection in Optical Remote Sensing Images [J].
Nie G.-T. ;
Huang H. .
Huang, Hua (huahuang@bnu.edu.cn), 1749, Science Press (47) :1749-1768
[26]   A Lightweight Object Detection Framework for Remote Sensing Images [J].
Huyan, Lang ;
Bai, Yunpeng ;
Li, Ying ;
Jiang, Dongmei ;
Zhang, Yanning ;
Zhou, Quan ;
Wei, Jiayuan ;
Liu, Juanni ;
Zhang, Yi ;
Cui, Tao .
REMOTE SENSING, 2021, 13 (04) :1-24
[27]   A survey on object detection in optical remote sensing images [J].
Cheng, Gong ;
Han, Junwei .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2016, 117 :11-28
[28]   Exploring Lightweight Structures for Tiny Object Detection in Remote Sensing Images [J].
Liu, Dongyang ;
Zhang, Junping ;
Qi, Yunxiao ;
Xi, Yunqiao ;
Jin, Jing .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2025, 63
[29]   DRBOX FAMILY: A GROUP OF OBJECT DETECTION TECHNIQUES FOR REMOTE SENSING IMAGES [J].
Liu, Lei ;
Pan, Zongxu ;
Chen, Guowei ;
Gao, Yizhao .
2019 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM (IGARSS 2019), 2019, :1446-1449
[30]   MKLM: a multiknowledge learning module for object detection in remote sensing images [J].
Zhang, Sanxing ;
Song, Fei ;
Lei, Tao ;
Jiang, Ping ;
Liu, Gang .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2022, 43 (06) :2244-2267