Application of deep generative networks for SAR/ISAR: a review

被引:17
作者
Zhang, Jiawei [1 ]
Liu, Zhen [1 ]
Jiang, Weidong [1 ]
Liu, Yongxiang [1 ]
Zhou, Xiaolin [1 ]
Li, Xiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Sci & Technol, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Synthetic aperture radar image; Deep learning; Generative adversarial network; Image generation; Artificial intelligence; CONVOLUTIONAL NEURAL-NETWORK; OPTICAL IMAGE TRANSLATION; SAR IMAGES; ADVERSARIAL NETWORK; POLARIZATION; SIMULATION; GAN;
D O I
10.1007/s10462-023-10469-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Military, agricultural, and urban planning have all made extensive use of SAR/ISAR in the realm of remote sensing. SAR/ISAR images are more capable of identifying the details of the targets than optical images and can be taken in any condition. Due to the challenges associated with SAR/ISAR imaging, the lack of data causes many jobs relying on data-driven deep learning algorithms to perform less than satisfactorily. Cropping, rotation, and other procedures are examples of classic data augmentation techniques now in use, although they do not fundamentally differ from basic replication and cannot increase the model's stability and robustness. Deep generative models are used to generate SAR/ISAR images, which is a more efficient way than the conventional ones. The generation techniques are outlined and organized depending on the application fields in this review, including SAR/ISAR data augmentation (26 papers), SAR/ISAR image translation (29 papers), SAR/ISAR image enhancement (22 papers), azimuth interpolation (9 papers), and deceptive jamming (1 paper). The connected works are then summarized based on several deep generative models. 87 linked studies and 5 associated survey papers from 2017 to 2022 are compiled in this review. Finally, the summarized works are systematically analyzed. There are 27 papers using MSTAR for image generation, which is the mostly applied dataset. For evaluation, the combination of SSIM and PSNR is applied most widely (32.19%). In conclusion, this review offers fresh perspectives on the direction in which deep generative models for SAR/ISAR image generation are headed. The cutting-edge methods outlined in this paper are also available to researchers in other domains.
引用
收藏
页码:11905 / 11983
页数:79
相关论文
共 165 条
  • [1] Ai J., 2021, IEEE GEOSCI REMOTE S, V19, P1
  • [2] Arjovsky M, 2017, PR MACH LEARN RES, V70
  • [3] Synthesizing Optical and SAR Imagery From Land Cover Maps and Auxiliary Raster Data
    Baier, Gerald
    Deschemps, Antonin
    Schmitt, Michael
    Yokoya, Naoto
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [4] Bank D., 2020, arXiv
  • [5] Bao XJ, 2019, INT GEOSCI REMOTE SE, P9995, DOI [10.1109/IGARSS.2019.8899286, 10.1109/igarss.2019.8899286]
  • [6] Barratt ST, 2018, ARXIV, DOI arXivpreprint
  • [7] Synthesis of Multispectral Optical Images From SAR/Optical Multitemporal Data Using Conditional Generative Adversarial Networks
    Bermudez, Jose D.
    Happ, Patrick N.
    Feitosa, Raul Q.
    Oliveira, Dario A. B.
    [J]. IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (08) : 1220 - 1224
  • [8] Automatic Description Generation from Images: A Survey of Models, Datasets, and Evaluation Measures
    Bernardi, Raffaella
    Cakici, Ruket
    Elliott, Desmond
    Erdem, Aykut
    Erdem, Erkut
    Ikizler-Cinbis, Nazli
    Keller, Frank
    Muscat, Adrian
    Plank, Barbara
    [J]. JOURNAL OF ARTIFICIAL INTELLIGENCE RESEARCH, 2016, 55 : 409 - 442
  • [9] Bhamidipati S. R. M., 2020, Social Netw. Comput. Sci., V1, P355
  • [10] From Theory to Application: Real-Time Sparse SAR Imaging
    Bi, Hui
    Bi, Guoan
    Zhang, Bingchen
    Hong, Wen
    Wu, Yirong
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2020, 58 (04): : 2928 - 2936