Exploring Data and Models in SAR Ship Image Captioning

被引:2
|
作者
Zhao, Kai [1 ]
Xiong, Wei [1 ]
机构
[1] Space Engn Univ, Sci & Technol Complex Elect Syst Simulat Lab, Beijing 101400, Peoples R China
关键词
Marine vehicles; Synthetic aperture radar; Radar polarimetry; Remote sensing; Seaports; Feature extraction; Decoding; Encoding; Recurrent neural networks; SAR image; image captioning; encoder-decoder; recurrent neural network; long short-term memory network;
D O I
10.1109/ACCESS.2022.3202193
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In recent years, considerable progress has been made in ship detection in synthetic aperture radar (SAR) images; however, no research has been conducted on translating SAR ship images into flexible and accurate sentences. To explore image captions in SAR ship images, we conduct the following work: first, to better describe SAR ship images, we propose certain principles for SAR image annotation based on the characteristics of SAR images. Second, to make better use of SAR ship images, a large-scale SAR ship image captioning dataset is carefully constructed. Finally, we explore encoder-decoder models and the attention mechanism and apply these methods to the SAR ship image captioning task. We conduct detailed experiments on the proposed dataset and find that the encoder-decoder model and attention mechanism can obtain good results in the SAR ship image captioning task. The experiments also reveal that the generated sentences can accurately describe SAR ship images. This dataset has already been published on https://github.com/5132210/SSIC.git.
引用
收藏
页码:91150 / 91159
页数:10
相关论文
共 50 条
  • [41] Ship Target Detection in SAR Image Based on RetinaNet
    Liu J.
    Zhao T.
    Liu M.
    Hunan Daxue Xuebao/Journal of Hunan University Natural Sciences, 2020, 47 (02): : 85 - 91
  • [42] Speckle-Free SAR Image Ship Detection
    Chen, Si-Wei
    Cui, Xing-Chao
    Wang, Xue-Song
    Xiao, Shun-Ping
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2021, 30 : 5969 - 5983
  • [43] Finsler Metric Method for Ship Detection in SAR Image
    Zhao H.
    Yang M.
    Progress in Electromagnetics Research Letters, 2022, 105 : 63 - 69
  • [44] Calibrated polarimetric SAR data for ship detection
    Touzi, R
    IGARSS 2000: IEEE 2000 INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, VOL I - VI, PROCEEDINGS, 2000, : 144 - 146
  • [45] Ship detection using polarimetric SAR data
    Ringrose, R
    Harris, N
    CEOS SAR WORKSHOP, 2000, 450 : 687 - 691
  • [46] SARGAN: A Novel SAR Image Generation Method for SAR Ship Detection Task
    Ju, Moran
    Niu, Buniu
    Hu, Qing
    IEEE SENSORS JOURNAL, 2023, 23 (22) : 28500 - 28512
  • [47] The compression of raw SAR and SAR image data
    Parkes, SM
    Clifton, HL
    INTERNATIONAL JOURNAL OF REMOTE SENSING, 1999, 20 (18) : 3563 - 3581
  • [48] Exploring Models and Data for Remote Sensing Image Caption Generation
    Lu, Xiaoqiang
    Wang, Binqiang
    Zheng, Xiangtao
    Li, Xuelong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2018, 56 (04): : 2183 - 2195
  • [49] Leveraging unpaired out -of -domain data for image captioning
    Chen, Xinghan
    Zhang, Mingxing
    Wang, Zheng
    Zuo, Lin
    Li, Bo
    Yang, Yang
    PATTERN RECOGNITION LETTERS, 2020, 132 : 132 - 140
  • [50] Image Captioning with Multi-Context Synthetic Data
    Ma, Feipeng
    Zhou, Yizhou
    Rao, Fengyun
    Zhang, Yueyi
    Sun, Xiaoyan
    THIRTY-EIGHTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 38 NO 5, 2024, : 4089 - 4097