FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [41] Contour Modeling Arbitrary-Oriented Ship Detection From Very High-Resolution Optical Remote Sensing Imagery
    Zhuang, Yin
    Liu, Yuqun
    Zhang, Tong
    Chen, He
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
  • [42] Weakly Aligned Feature Fusion for Multimodal Object Detection
    Zhang, Lu
    Liu, Zhiyong
    Zhu, Xiangyu
    Song, Zhan
    Yang, Xu
    Lei, Zhen
    Qiao, Hong
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2021,
  • [43] Free3Net: Gliding Free, Orientation Free, and Anchor Free Network for Oriented Object Detection
    Ou, Zhonghong
    Chen, Zhongjie
    Shen, Shengyi
    Fan, Lina
    Yao, Siyuan
    Song, Meina
    Hui, Pan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2023, 25 : 7089 - 7100
  • [44] A Dual-Path Multihead Feature Enhancement Detector for Oriented Object Detection in Remote Sensing Images
    Li, Yibing
    Li, Zifan
    Ye, Fang
    Li, Yingsong
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [45] Align Deep Features for Oriented Object Detection
    Han, Jiaming
    Ding, Jian
    Li, Jie
    Xia, Gui-Song
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [46] Centric Probability-Based Sample Selection for Oriented Object Detection
    Yao, Yanqing
    Cheng, Gong
    Lang, Chunbo
    Xie, Xingxing
    Han, Junwei
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2025, 35 (04) : 3290 - 3302
  • [47] ARBITRARY-ORIENTED SHIP DETECTION METHOD BASED ON IMPROVED REGRESSION MODEL FOR TARGET DIRECTION DETECTION NETWORK
    Ran, Bohao
    You, Yanan
    Li, Zezhong
    Liu, Fang
    IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, : 964 - 967
  • [48] Surround-Net: A Multi-Branch Arbitrary-Oriented Detector for Remote Sensing
    Luo, Junkun
    Hu, Yimin
    Li, Jiadong
    REMOTE SENSING, 2022, 14 (07)
  • [49] Feature Rescaling and Fusion for Tiny Object Detection
    Liu, Jingwei
    Gu, Yi
    Han, Shumin
    Zhang, Zhibin
    Guo, Jiafeng
    Cheng, Xueqi
    IEEE ACCESS, 2021, 9 : 62946 - 62955
  • [50] LO-Det: Lightweight Oriented Object Detection in Remote Sensing Images
    Huang, Zhanchao
    Li, Wei
    Xia, Xiang-Gen
    Wang, Hao
    Jie, Feiran
    Tao, Ran
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60