Meta-Learning Based Domain Prior With Application to Optical-ISAR Image Translation

被引:3
作者
Liao, Huaizhang [1 ]
Xia, Jingyuan [1 ]
Yang, Zhixiong [1 ]
Pan, Fulin [1 ]
Liu, Zhen [1 ]
Liu, Yongxiang [1 ]
机构
[1] Natl Univ Def Technol, Coll Elect Engn, Changsha 410073, Peoples R China
基金
中国国家自然科学基金;
关键词
Training; Optical imaging; Optical scattering; Metalearning; Feature extraction; Task analysis; Scattering; Image translation; meta-learning; generative model; ISAR image processing;
D O I
10.1109/TCSVT.2023.3318401
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper focuses on generating Inverse Synthetic Aperture Radar (ISAR) images from optical images, in particular, for orbit space targets. ISAR images are widely applied in space target observation and classification tasks, whereas, limited to the expensive cost of ISAR sample collection, training deep learning-based ISAR image classifiers with insufficient samples and generating ISAR samples from emulation optical images via image translation techniques have attracted increasing attention. Image translation has highlighted significant success and popularity in computer vision, remote sensing and data generation societies. However, most of the existing methods are implemented under the discipline of extracting the explicit pixel-level features and do not perform effectively while entailing translation to domains with specific implicit features, such as ISAR image does. We propose a meta-learning based domain prior to implicit feature modelling and apply it to CycleGAN and UNIT models to realize effective translations between the ISAR and optical domains. Two representative implicit features, ISAR scattering distribution feature from the physical domain and the classification identifying feature from the task domain, are elaborately formulated with explicit modelling in statistic form. A meta-learning based training scheme is introduced to leverage the mutual knowledge of domain priors across different samples, and thus allows few-shot learning capacity with dramatically reduced training samples. Extensive simulations validate that the obtained ISAR images have better visible-authenticity and training-effectiveness than the existing image translation approaches on various synthetic datasets. Source codes are available at https://github.com/XYLGroup/MLDP.
引用
收藏
页码:7041 / 7056
页数:16
相关论文
共 63 条
[51]   Real-World ISAR Object Recognition Using Deep Multimodal Relation Learning [J].
Xue, Bin ;
Tong, Ningning .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (10) :4256-4267
[52]   SAISAR-Net: A Robust Sequential Adjustment ISAR Image Classification Network [J].
Xue, Ruihang ;
Bai, Xueru ;
Zhou, Feng .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
[53]   A Learning-Aided Flexible Gradient Descent Approach to MISO Beamforming [J].
Yang, Zhixiong ;
Xia, Jing-Yuan ;
Luo, Junshan ;
Zhang, Shuanghui ;
Gunduz, Deniz .
IEEE WIRELESS COMMUNICATIONS LETTERS, 2022, 11 (09) :1895-1899
[54]   DualGAN: Unsupervised Dual Learning for Image-to-Image Translation [J].
Yi, Zili ;
Zhang, Hao ;
Tan, Ping ;
Gong, Minglun .
2017 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2017, :2868-2876
[55]   SR-ISTA-Net: Sparse Representation-Based Deep Learning Approach for SAR Imaging [J].
Zhang, Hongwei ;
Ni, Jiacheng ;
Xiong, Shichao ;
Luo, Ying ;
Zhang, Qun .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[56]   Feature-Guided SAR-to-Optical Image Translation [J].
Zhang, Jiexin ;
Zhou, Jianjiang ;
Lu, Xiwen .
IEEE ACCESS, 2020, 8 (08) :70925-70937
[57]  
Zhang RX, 2018, ADV NEUR IN, V31
[58]   Emotional Semantics-Preserved and Feature-Aligned CycleGAN for Visual Emotion Adaptation [J].
Zhao, Sicheng ;
Chen, Xuanbai ;
Yue, Xiangyu ;
Lin, Chuang ;
Xu, Pengfei ;
Krishna, Ravi ;
Yang, Jufeng ;
Ding, Guiguang ;
Sangiovanni-Vincentelli, Alberto L. ;
Keutzer, Kurt .
IEEE TRANSACTIONS ON CYBERNETICS, 2022, 52 (10) :10000-10013
[59]   Active Learning SAR Image Classification Method Crossing Different Imaging Platforms [J].
Zhao, Siyuan ;
Luo, Ying ;
Zhang, Tao ;
Guo, Weiwei ;
Zhang, Zenghui .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2022, 19
[60]   A Feature Decomposition-Based Method for Automatic Ship Detection Crossing Different Satellite SAR Images [J].
Zhao, Siyuan ;
Luo, Ying ;
Zhang, Tao ;
Guo, Weiwei ;
Zhang, Zenghui .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60