FFN: Fountain Fusion Net for Arbitrary-Oriented Object Detection

被引:7
|
作者
Zhang, Tianwei [1 ,2 ,3 ]
Sun, Xu [1 ]
Zhuang, Lina [1 ]
Dong, Xiaoyu [4 ,5 ]
Gao, Lianru [1 ]
Zhang, Bing [3 ,6 ]
Zheng, Ke [7 ]
机构
[1] Chinese Acad Sci, Aerosp Informat Res Inst, Key Lab Digital Earth Sci, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[2] Chinese Acad Sci, Int Res Ctr Big Data Sustainable Dev Goals, Key Lab Computat Opt Imaging Technol, Beijing 100094, Peoples R China
[3] Univ Chinese Acad Sci, Coll Resources & Environm, Beijing 100049, Peoples R China
[4] Univ Tokyo, Dept Complex Sci & Engn, Chuo, Tokyo 1030027, Japan
[5] RIKEN AIP, Chuo, Tokyo 1030027, Japan
[6] Chinese Acad Sci, Aerosp Informat Res Inst, Beijing 100094, Peoples R China
[7] Liaocheng Univ, Coll Geog & Environm, Liaocheng 252059, Peoples R China
来源
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING | 2023年 / 61卷
关键词
Feature extraction; Detectors; Object detection; Task analysis; Training; Sun; Remote sensing; Deep learning; feature fusion; object detection; remote sensing;
D O I
10.1109/TGRS.2023.3276995
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
Arbitrary-oriented object detection (AOOD) is widely used in aerial images because of its efficient object representation. However, current detectors use the over-standardized feature extraction structure, resulting in detectors having no ability to adaptively readjust feature representations of detection units. Meanwhile, we observe that many detection units could not focus on the objects of interest in their receptive field and are easily affected by the background information and interference targets, leading to the weakening of feature expression ability. We call them suboptimal detection units. To address this issue, we propose a novel feature enhancement module called the fountain feature enhancement module (FFEM). FFEM ingeniously uses the fountain-like structure to reconstruct the features of suboptimal detection units, generating fountain features that can automatically condense spatial regional features, which effectively enhance the detectors' overall representation ability. Then, a high-performance AOOD detector called the fountain fusion net (FFN) is proposed with FFEM embedded, and many novel AOOD components are tested for their progressiveness. We validated our FFN and FFEM using three remote sensing datasets DOTA, HRSC2016, and UCAS-AOD as well as one scene text dataset ICDAR 2015. Extensive experiments demonstrate the effectiveness of our proposed method on improving current detectors to achieve state-of-the-art performance based on this novel idea.
引用
收藏
页数:13
相关论文
共 50 条
  • [31] Arbitrary-oriented object detection via dense feature fusion and attention model for remote sensing super-resolution image
    Fuhao Zou
    Wei Xiao
    Wanting Ji
    Kunkun He
    Zhixiang Yang
    Jingkuan Song
    Helen Zhou
    Kai Li
    Neural Computing and Applications, 2020, 32 : 14549 - 14562
  • [32] Arbitrarily Oriented Object Detection in Remote Sensing Images Based on Improved YOLOv4-CSP
    Zheng, Ziyang
    Zhang, Ting
    Liu, Zhaoying
    Liu, Bo
    Li, Yujian
    Sun, Changming
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9355 - 9368
  • [33] Vector Decomposition-Based Arbitrary-Oriented Object Detection for Optical Remote Sensing Images
    Zhou, Kexue
    Zhang, Min
    Dong, Youqiang
    Tan, Jinlin
    Zhao, Shaobo
    Wang, Hai
    REMOTE SENSING, 2023, 15 (19)
  • [34] CASCADE DETECTOR WITH FEATURE FUSION FOR ARBITRARY-ORIENTED OBJECTS IN REMOTE SENSING IMAGES
    Hou, Liping
    Lu, Ke
    Xue, Jian
    Hao, Li
    2020 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2020,
  • [35] Detect Larger at Once: Large-Area Remote-Sensing Image Arbitrary-Oriented Ship Detection
    Su, Nan
    Huang, Zhibo
    Yan, Yiming
    Zhao, Chunhui
    Zhou, Shuyuan
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [36] FADL-Net: Frequency-Assisted Dynamic Learning Network for Oriented Object Detection in Remote Sensing Images
    Fu, Ronghao
    Chen, Chengcheng
    Yan, Shuang
    Zhang, Rui
    Wang, Xianchang
    Chen, Huiling
    IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2024, 20 (08) : 9939 - 9951
  • [37] Efficient Vertex Coordinate Prediction-Based CSP-Hourglass Net for Object OBB Detection in Remote Sensing
    Li, Wen Tao
    Li, Liang Wei
    Li, Shi Yu
    Mou, Jin Chao
    Hei, Yong Qiang
    IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
  • [38] Adaptively Attentional Feature Fusion Oriented to Multiscale Object Detection in Remote Sensing Images
    Zhao, Wenqing
    Kang, Yijin
    Chen, Hao
    Zhao, Zhenhuan
    Zhao, Zhenbing
    Zhai, Yongjie
    IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
  • [39] On Improving Bounding Box Representations for Oriented Object Detection
    Yao, Yanqing
    Cheng, Gong
    Wang, Guangxing
    Li, Shengyang
    Zhou, Peicheng
    Xie, Xingxing
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [40] On Improving Bounding Box Representations for Oriented Object Detection
    Yao, Yanqing
    Cheng, Gong
    Wang, Guangxing
    Li, Shengyang
    Zhou, Peicheng
    Xie, Xingxing
    Han, Junwei
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61