FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [1] FAR-Net: Fast Anchor Refining for Arbitrary-Oriented Object Detection
    Deng, Chenwei
    Jing, Donglin
    Han, Yuqi
    Wang, Shuliang
    Wang, Hongshuo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [2] Composite Perception and Multiscale Fusion Network for Arbitrary-Oriented Object Detection in Remote Sensing Imagery
    Bai, Peng
    Xia, Ying
    Feng, Jiangfan
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62
  • [3] CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote-Sensing Images
    Ming, Qi
    Miao, Lingjuan
    Zhou, Zhiqiang
    Dong, Yunpeng
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Optimization for Arbitrary-Oriented Object Detection via Representation Invariance Loss
    Ming, Qi
    Miao, Lingjuan
    Zhou, Zhiqiang
    Yang, Xue
    Dong, Yunpeng
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [5] Arbitrary-Oriented Object Detection in Remote Sensing Images Based on Polar Coordinates
    Zhou, Lin
    Wei, Haoran
    Li, Hao
    Zhao, Wenzhe
    Zhang, Yi
    Zhang, Yue
    IEEE ACCESS, 2020, 8 (08): : 223373 - 223384
  • [6] Task-Wise Sampling Convolutions for Arbitrary-Oriented Object Detection in Aerial Images
    Huang, Zhanchao
    Li, Wei
    Xia, Xiang-Gen
    Wang, Hao
    Tao, Ran
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2024, : 1 - 15
  • [7] A General Gaussian Heatmap Label Assignment for Arbitrary-Oriented Object Detection
    Huang, Zhanchao
    Li, Wei
    Xia, Xiang-Gen
    Tao, Ran
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 1895 - 1910
  • [8] AO2-DETR: Arbitrary-Oriented Object Detection Transformer
    Dai, Linhui
    Liu, Hong
    Tang, Hao
    Wu, Zhiwei
    Song, Pinhao
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (05) : 2342 - 2356
  • [9] Performance releaser with smart anchor learning for arbitrary-oriented object detection
    Zhang, Tianwei W.
    Dong, Xiaoyu Y.
    Sun, Xu
    Gao, Lianru R.
    Qu, Ying
    Zhang, Bing
    Zheng, Ke
    CAAI TRANSACTIONS ON INTELLIGENCE TECHNOLOGY, 2023, 8 (04) : 1213 - 1225
  • [10] Anchor-Free Arbitrary-Oriented Object Detector Using Box Boundary-Aware Vectors
    Yu, Donghang
    Xu, Qing
    Guo, Haitao
    Xu, Junfeng
    Lu, Jun
    Lin, Yuzhun
    Liu, Xiangyun
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 2535 - 2545