FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [21] RMFENet: Refined Multiscale Feature Enhancement Network for Arbitrary-Oriented Sonar Object Detection
    Zhao, Zhengyang
    Wang, Zhen
    Wang, Buhong
    Guo, Jianxin
    IEEE SENSORS JOURNAL, 2023, 23 (23) : 29211 - 29226
  • [22] Finding Arbitrary-Oriented Ships From Remote Sensing Images Using Corner Detection
    Chen, Jiajie
    Xie, Fengying
    Lu, Yuanyao
    Jiang, Zhiguo
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2020, 17 (10) : 1712 - 1716
  • [23] A Single-Stage Arbitrary-Oriented Detector Based on Multiscale Feature Fusion and Calibration for SAR Ship Detection
    Zhao, Shuang
    Liu, Qi
    Yu, Weidong
    Lv, Jiyu
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 8179 - 8198
  • [24] Center Based Model for Arbitrary-oriented Ship Detection in Remote Sensing Images
    Zhang Xiao-han
    Yao Li-bo
    Lu Ya-fei
    Han Peng
    Li Jian-wei
    ACTA PHOTONICA SINICA, 2020, 49 (04)
  • [25] Arbitrary-Oriented Detection of Insulators in Thermal Imagery via Rotation Region Network
    Zheng, Hanbo
    Liu, Yang
    Sun, Yonghui
    Li, Jinheng
    Shi, Zhen
    Zhang, Chaohai
    Lai, Chun Sing
    Lai, Loi Lei
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (08) : 5242 - 5252
  • [26] Instance-Aware Spatial-Frequency Feature Fusion Detector for Oriented Object Detection in Remote-Sensing Images
    Zheng, Shangdong
    Wu, Zebin
    Xu, Yang
    Wei, Zhihui
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [27] Dual Appearance-Aware Enhancement for Oriented Object Detection
    Gong, Maoguo
    Zhao, Hongyu
    Wu, Yue
    Tang, Zedong
    Feng, Kai-Yuan
    Sheng, Kai
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62 : 1 - 14
  • [28] Lightweight Detection Network for Arbitrary-Oriented Vehicles in UAV Imagery via Global Attentive Relation and Multi-Path Fusion
    Feng, Jiangfan
    Yi, Chengjie
    DRONES, 2022, 6 (05)
  • [29] Lightweight detection network for arbitrary-oriented vehicles in UAV imagery via precise positional information encoding and bidirectional feature fusion
    Feng, Jiangfan
    Wang, Jiaxin
    Qin, Rui
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 2023, 44 (15) : 4529 - 4558
  • [30] Arbitrary-oriented object detection via dense feature fusion and attention model for remote sensing super-resolution image
    Zou, Fuhao
    Xiao, Wei
    Ji, Wanting
    He, Kunkun
    Yang, Zhixiang
    Song, Jingkuan
    Zhou, Helen
    Li, Kai
    NEURAL COMPUTING & APPLICATIONS, 2020, 32 (18) : 14549 - 14562