Differentiable SAR Renderer and Image-Based Target Reconstruction

被引:12
作者
Fu, Shilei [1 ]
Xu, Feng [1 ]
机构
[1] Fudan Univ, Key Lab Informat Sci Electromagnet Waves, Minist Educ, Shanghai 200433, Peoples R China
基金
中国国家自然科学基金;
关键词
Radar polarimetry; Synthetic aperture radar; Radar imaging; Three-dimensional displays; Image reconstruction; Scattering; Radar; Synthetic aperture radar (SAR); 3D reconstruction; differentiable SAR renderer; probability maps; mapping and projection algorithm; inverse SAR (ISAR);
D O I
10.1109/TIP.2022.3215069
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Forward modeling of wave scattering and radar imaging mechanisms is the key to information extraction from synthetic aperture radar (SAR) images. Like inverse graphics in the optical domain, an inherently-integrated forward-inverse approach would be promising for SAR advanced information retrieval and target reconstruction. This paper presents such an attempt at inverse graphics for SAR imagery. A differentiable SAR renderer (DSR) is developed, which reformulates the mapping and projection algorithm of the SAR imaging mechanism in the differentiable form of probability maps. First-order gradients of the proposed DSR are then analytically derived, which can be back-propagated from rendered image/silhouette to the target geometry and scattering attributes. A 3D inverse target reconstruction algorithm from SAR images is devised. Several simulation and reconstruction experiments are conducted, including targets with and without background, using synthesized data or real measured inverse SAR (ISAR) data by ground radar. Results demonstrate the efficacy of the proposed DSR and its inverse approach.
引用
收藏
页码:6679 / 6693
页数:15
相关论文
共 24 条
  • [1] [陈健堃 Chen Jiankun], 2019, [中国科学. 信息科学, Scientia Sinica Informationis], V49, P1606
  • [2] [丁赤飚 Ding Chibiao], 2019, [雷达学报, Journal of Radars], V8, P693
  • [3] Fraunhofer Lab, FORSCH FRAUNH FHR BE
  • [4] Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks
    Fu, Shilei
    Xu, Feng
    Jin, Ya-Qiu
    [J]. SCIENCE CHINA-INFORMATION SCIENCES, 2021, 64 (02)
  • [5] Neural 3D Mesh Renderer
    Kato, Hiroharu
    Ushiku, Yoshitaka
    Harada, Tatsuya
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 3907 - 3916
  • [6] Kulkarni T. D, 2014, ARXIV
  • [7] Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning
    Liu, Shichen
    Li, Tianye
    Chen, Weikai
    Li, Hao
    [J]. 2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, : 7707 - 7716
  • [8] OpenDR: An Approximate Differentiable Renderer
    Loper, Matthew M.
    Black, Michael J.
    [J]. COMPUTER VISION - ECCV 2014, PT VII, 2014, 8695 : 154 - 169
  • [9] Moving and Stationary Target Acquisition and Recognition (MSTAR), PUBL REL DAT
  • [10] Peng LX, 2019, INT GEOSCI REMOTE SE, P3685, DOI [10.1109/IGARSS.2019.8900449, 10.1109/igarss.2019.8900449]