SACuP: Sonar Image Augmentation with Cut and Paste Based DataBank for Semantic Segmentation

被引:1
作者
Park, Sundong [1 ]
Choi, Yoonyoung [1 ]
Hwang, Hyoseok [1 ]
机构
[1] Kyung Hee Univ, Dept Software Convergence, Yongin 17104, South Korea
基金
新加坡国家研究基金会;
关键词
forward-looking sonar image; data augmentation; semantic segmentation; deep learning;
D O I
10.3390/rs15215185
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
In this paper, we introduce Sonar image Augmentation with Cut and Paste based DataBank for semantic segmentation (SACuP), a novel data augmentation framework specifically designed for sonar imagery. Unlike traditional methods that often overlook the distinctive traits of sonar images, SACuP effectively harnesses these unique characteristics, including shadows and noise. SACuP operates on an object-unit level, differentiating it from conventional augmentation methods applied to entire images or object groups. Improving semantic segmentation performance while carefully preserving the unique properties of acoustic images is differentiated from others. Importantly, this augmentation process requires no additional manual work, as it leverages existing images and masks seamlessly. Our extensive evaluations contrasting SACuP against established augmentation methods unveil its superior performance, registering an impressive 1.10% gain in mean intersection over union (mIoU) over the baseline. Furthermore, our ablation study elucidates the nuanced contributions of individual and combined augmentation methods, such as cut and paste, brightness adjustment, and shadow generation, to model enhancement. We anticipate SACuP's versatility in augmenting scarce sonar data across a spectrum of tasks, particularly within the domain of semantic segmentation. Its potential extends to bolstering the effectiveness of underwater exploration by providing high-quality sonar data for training machine learning models.
引用
收藏
页数:22
相关论文
共 56 条
  • [1] Bengio, 2014, ARXIV14062661
  • [2] Brown TB, 2020, ADV NEUR IN, V33
  • [3] A rasterized ray-tracer pipeline for real-time, multi-device sonar simulation
    Cerqueira, Romulo
    Trocoli, Tiago
    Albiez, Jan
    Oliveira, Luciano
    [J]. GRAPHICAL MODELS, 2020, 111
  • [4] A novel GPU-based sonar simulator for real-time applications
    Cerqueira, Romulo
    Trocoli, Tiago
    Neves, Gustavo
    Joyeux, Sylvain
    Albiez, Jan
    Oliveira, Luciano
    [J]. COMPUTERS & GRAPHICS-UK, 2017, 68 : 66 - 76
  • [5] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [6] Chen LB, 2017, IEEE INT SYMP NANO, P1, DOI 10.1109/NANOARCH.2017.8053709
  • [7] Physics-Based Modelling and Simulation of Multibeam Echosounder Perception for Autonomous Underwater Manipulation
    Choi, Woen-Sug
    Olson, Derek R.
    Davis, Duane
    Zhang, Mabel
    Racson, Andy
    Bingham, Brian
    McCarrin, Michael
    Vogt, Carson
    Herman, Jessica
    [J]. FRONTIERS IN ROBOTICS AND AI, 2021, 8
  • [8] The Cityscapes Dataset for Semantic Urban Scene Understanding
    Cordts, Marius
    Omran, Mohamed
    Ramos, Sebastian
    Rehfeld, Timo
    Enzweiler, Markus
    Benenson, Rodrigo
    Franke, Uwe
    Roth, Stefan
    Schiele, Bernt
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3213 - 3223
  • [9] DeMarco KJ, 2015, OCEANS-IEEE
  • [10] Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171