Side-Scan Sonar Image Synthesis Based on Generative Adversarial Network for Images in Multiple Frequencies

被引:26
作者
Jiang, Yifan [1 ]
Ku, Bonhwa [1 ]
Kim, Wanjin [2 ]
Ko, Hanseok [1 ]
机构
[1] Korea Univ, Sch Elect Engn, Seoul 02841, South Korea
[2] Agcy Def Dev, Jinhae 51678, South Korea
关键词
Image segmentation; Semantics; Generators; Image synthesis; Feature extraction; Sonar; Measurement; Generative adversarial network (GAN); image translation; semantic image synthesis; side-scan sonar (SSS);
D O I
10.1109/LGRS.2020.3005679
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The side-scan sonar (SSS) is a critical sensor device used to explore underwater environments in the deep sea. Gathering SSS data, however, is an expensive and time-consuming task because it requires sensor towing and involves complicated field operations. Recently, deep learning has been making advances rapidly in the field of computer vision. Benefiting from this development, generative adversarial networks (GANs) have been demonstrated to produce realistic synthetic data of various types, including images and acoustics signals. In this letter, we propose a GAN-based semantic image synthesis model based on GAN that can generate high-quality SSS images at a low cost in less time. We evaluate the proposed model using both shallow and deep water SSS data sets that include a diverse range of imaging conditions. such as high and low sonar operating frequencies and different landscapes. The experimental results show that the proposed method can effectively generate synthesized SSS data characterized by the shape and style of real data, thereby demonstrating its promising potential for SSS data augmentation in diverse SSS relevant machine learning tasks.
引用
收藏
页码:1505 / 1509
页数:5
相关论文
共 16 条
[1]  
[Anonymous], DATA RELEASE SEARCH
[2]  
Chen J. L., 2016, Proc. Meet. Acoust. Acoust. Soc. Am, V29, DOI [10.1121/2.0000458, DOI 10.1121/2.0000458]
[3]  
Goodfellow IJ, 2014, ADV NEUR IN, V27, P2672
[4]  
Heusel M, 2017, MATION PROCESSING SY
[5]   Globally and Locally Consistent Image Completion [J].
Iizuka, Satoshi ;
Simo-Serra, Edgar ;
Ishikawa, Hiroshi .
ACM TRANSACTIONS ON GRAPHICS, 2017, 36 (04)
[6]   Image-to-Image Translation with Conditional Adversarial Networks [J].
Isola, Phillip ;
Zhu, Jun-Yan ;
Zhou, Tinghui ;
Efros, Alexei A. .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :5967-5976
[7]   Nonhomogeneous Noise Removal From Side-Scan Sonar Images Using Structural Sparsity [J].
Jin, Youngsaeng ;
Ku, Bonhwa ;
Ahn, Jaekyun ;
Kim, Seongil ;
Ko, Hanseok .
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2019, 16 (08) :1215-1219
[8]   Training and Validation of Automatic Target Recognition Systems using Generative Adversarial Networks [J].
Karjalainen, Antti Ilari ;
Mitchell, Roshenac ;
Vazquez, Jose .
2019 SENSOR SIGNAL PROCESSING FOR DEFENCE CONFERENCE (SSPD), 2019,
[9]  
Kingma D. P., 2013, Auto-encoding variational Bayes
[10]  
Lee S., 2018, ARXIV181007990