Info-FPN: An Informative Feature Pyramid Network for object detection in remote sensing images

被引:37
|
作者
Chen, Silin [1 ,2 ]
Zhao, Jiaqi [1 ,2 ,3 ]
Zhou, Yong [1 ,2 ]
Wang, Hanzheng [1 ,2 ]
Yao, Rui [1 ,2 ]
Zhang, Lixu [4 ]
Xue, Yong [5 ]
机构
[1] China Univ Min & Technol, Sch Comp Sci & Technol, Xuzhou 221116, Jiangsu, Peoples R China
[2] Minist Educ Peoples Republ China, Engn Res Ctr Mine Digitizat, Xuzhou 221116, Jiangsu, Peoples R China
[3] Disaster Intelligent Prevent & Control & Emergenc, Xuzhou 221116, Jiangsu, Peoples R China
[4] Jiangsu Junsheng Wanbang Holding Grp Co Ltd, Res & Dev Ctr, Xuzhou 221116, Jiangsu, Peoples R China
[5] China Univ Min & Technol, Sch Environm Sci & Spatial Informat, Xuzhou 221116, Jiangsu, Peoples R China
基金
中国国家自然科学基金;
关键词
Deep learning; Feature Pyramid Network; Feature alignment; Aliasing effect; Remote sensing images;
D O I
10.1016/j.eswa.2022.119132
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature pyramid networks are widely applied in remote sensing images for object detection to deal with the challenge of large scale variation in objects. However, the feature pyramid-based object detector for remote sensing images ignores the channel information loss, feature misalignment, and additional computational overhead to eliminate the aliasing effect, leading to inadequate feature extraction for multi-scale objects in remote sensing images. To address these challenges, an Informative Feature Pyramid Network (Info-FPN) is proposed. Specifically, we propose a Pixel Shuffle-based lateral connection Module (PSM) for the complete preservation of channel information in the feature pyramid. Then, to alleviate the problem of confusion caused by feature misalignment, a Feature Alignment Module (FAM) is proposed to achieve aligned feature fusion by template matching and learning feature offsets in the feature fusion stage. To eliminate the aliasing effect, we design a Semantic Encoder Module (SEM), which reduces the parameters and computation of model with the desirable detection accuracy. Extensive experiments on two challenging remote sensing datasets, namely DOTA and HRSC2016, prove the effectiveness of the proposed method which achieves comparable detection performance with the state-of-the-art FPN-based method.
引用
收藏
页数:14
相关论文
共 50 条
  • [1] Discriminative Feature Pyramid Network For Object Detection In Remote Sensing Images
    Zhu, Xiaoqian
    Zhang, Xiangrong
    Zhang, Tianyang
    Zhu, Peng
    Tang, Xu
    Li, Chen
    2020 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2020,
  • [2] Feature Alignment FPN for Oriented Object Detection in Remote Sensing Images
    Li, Zhiqing
    Li, Erzhu
    Xu, Tianyu
    Samat, Alim
    Liu, Wei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [3] Feature Alignment FPN for Oriented Object Detection in Remote Sensing Images
    Li, Zhiqing
    Li, Erzhu
    Xu, Tianyu
    Samat, Alim
    Liu, Wei
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [4] Semantics reused context feature pyramid network for object detection in remote sensing images
    Zhang, Li
    Guo, Yong
    Wang, Xinyue
    JOURNAL OF APPLIED REMOTE SENSING, 2022, 16 (03)
  • [5] FRPNet: A Feature-Reflowing Pyramid Network for Object Detection of Remote Sensing Images
    Wang, Jingyu
    Wang, Yezi
    Wu, Yulin
    Zhang, Ke
    Wang, Qi
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [6] Laplacian Feature Pyramid Network for Object Detection in VHR Optical Remote Sensing Images
    Zhang, Wenhua
    Jiao, Licheng
    Li, Yuxuan
    Huang, Zhongjian
    Wang, Haoran
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [7] Gated Path Aggregation Feature Pyramid Network for Object Detection in Remote Sensing Images
    Zheng, Yuchao
    Zhang, Xinxin
    Zhang, Rui
    Wang, Dahan
    REMOTE SENSING, 2022, 14 (18)
  • [8] A Dense Feature Pyramid Network for Remote Sensing Object Detection
    Sun, Yu
    Liu, Wenkai
    Gao, Yangte
    Hou, Xinghai
    Bi, Fukun
    APPLIED SCIENCES-BASEL, 2022, 12 (10):
  • [9] Multipatch Feature Pyramid Network for Weakly Supervised Object Detection in Optical Remote Sensing Images
    Shamsolmoali, Pourya
    Chanussot, Jocelyn
    Zareapoor, Masoumeh
    Zhou, Huiyu
    Yang, Jie
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [10] Object Detection in Remote Sensing Images Based on a Scene-Contextual Feature Pyramid Network
    Chen, Chaoyue
    Gong, Weiguo
    Chen, Yongliang
    Li, Weihong
    REMOTE SENSING, 2019, 11 (03)