Info-FPN: An Informative Feature Pyramid Network for object detection in remote sensing images

被引:54
作者
Chen, Silin [1 ,2 ]
Zhao, Jiaqi [1 ,2 ,3 ]
Zhou, Yong [1 ,2 ]
Wang, Hanzheng [1 ,2 ]
Yao, Rui [1 ,2 ]
Zhang, Lixu [4 ]
Xue, Yong [5 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Jiangsu, Peoples R China
[3] Disaster Intelligent Prevent & Control & Emergenc, Xuzhou 221116, Jiangsu, Peoples R China
[4] Jiangsu Junsheng Wanbang Holding Grp Co Ltd, Res & Dev Ctr, Xuzhou 221116, Jiangsu, Peoples R China
[5] China Univ Min & Technol, Sch Environm Sci & Spatial Informat, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Feature Pyramid Network; Feature alignment; Aliasing effect; Remote sensing images;
D O I
10.1016/j.eswa.2022.119132
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature pyramid networks are widely applied in remote sensing images for object detection to deal with the challenge of large scale variation in objects. However, the feature pyramid-based object detector for remote sensing images ignores the channel information loss, feature misalignment, and additional computational overhead to eliminate the aliasing effect, leading to inadequate feature extraction for multi-scale objects in remote sensing images. To address these challenges, an Informative Feature Pyramid Network (Info-FPN) is proposed. Specifically, we propose a Pixel Shuffle-based lateral connection Module (PSM) for the complete preservation of channel information in the feature pyramid. Then, to alleviate the problem of confusion caused by feature misalignment, a Feature Alignment Module (FAM) is proposed to achieve aligned feature fusion by template matching and learning feature offsets in the feature fusion stage. To eliminate the aliasing effect, we design a Semantic Encoder Module (SEM), which reduces the parameters and computation of model with the desirable detection accuracy. Extensive experiments on two challenging remote sensing datasets, namely DOTA and HRSC2016, prove the effectiveness of the proposed method which achieves comparable detection performance with the state-of-the-art FPN-based method.
引用
收藏
页数:14
相关论文
共 50 条
[41]   Feature Enhancement and Feedback Network for Change Detection in Remote Sensing Images [J].
Jiang, Zhenghao ;
Wang, Biao ;
Xu, Xiao ;
Zhang, Yaobo ;
Zhang, Peng ;
Wu, Yanlan ;
Yang, Hui .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2025, 22
[42]   Chimney and Condensing Tower Detection Based on FPN in High Resolution Remote Sensing Images [J].
Deng, Qin ;
Zhang, Haopeng .
IMAGE AND SIGNAL PROCESSING FOR REMOTE SENSING XXV, 2019, 11155
[43]   Attentional feature pyramid network for small object detection [J].
Min, Kyungseo ;
Lee, Gun-Hee ;
Lee, Seong-Whan .
NEURAL NETWORKS, 2022, 155 :439-450
[44]   Bidirectional Parallel Feature Pyramid Network for Object Detection [J].
Zhang, Zhengning ;
Zhang, Lin ;
Wang, Yue ;
Feng, Pengming ;
Sun, Baochen .
IEEE ACCESS, 2022, 10 :49422-49432
[45]   Object detection in aerial remote sensing images using bidirectional enhancement FPN and attention module with data augmentation [J].
Yang, Peng ;
Yu, Dashuai ;
Yang, Guowei .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (13) :38635-38656
[46]   Object detection in aerial remote sensing images using bidirectional enhancement FPN and attention module with data augmentation [J].
Peng Yang ;
Dashuai Yu ;
Guowei Yang .
Multimedia Tools and Applications, 2024, 83 :38635-38656
[47]   Extended Feature Pyramid Network for Small Object Detection [J].
Deng, Chunfang ;
Wang, Mengmeng ;
Liu, Liang ;
Liu, Yong ;
Jiang, Yunliang .
IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 :1968-1979
[48]   Annular Feature Pyramid Network for Salient Object Detection [J].
Zheng, Tao ;
Li, Bo ;
Liu, Jiajia .
2019 ELEVENTH INTERNATIONAL CONFERENCE ON ADVANCED COMPUTATIONAL INTELLIGENCE (ICACI 2019), 2019, :1-6
[49]   Improved Model Integrating FPN with Refined IoU for Efficient Object Detection Algorithm in Remote Sensing Satellite Images [J].
Abd Elhamied, Essam M. ;
Youssef, Sherin M. ;
El Shenawy, Marwa .
2024 INTERNATIONAL CONFERENCE ON MACHINE INTELLIGENCE AND SMART INNOVATION, ICMISI 2024, 2024, :244-250
[50]   A Multi-Feature Fusion and Attention Network for Multi-Scale Object Detection in Remote Sensing Images [J].
Cheng, Yong ;
Wang, Wei ;
Zhang, Wenjie ;
Yang, Ling ;
Wang, Jun ;
Ni, Huan ;
Guan, Tingzhao ;
He, Jiaxin ;
Gu, Yakang ;
Tran, Ngoc Nguyen .
REMOTE SENSING, 2023, 15 (08)