Semantic Segmentation of Marine Remote Sensing Based on a Cross Direction Attention Mechanism

被引:10
作者
Gao, Hao [1 ,2 ]
Cao, Lin [1 ]
Yu, Dingfeng [1 ]
Xiong, Xuejun [3 ]
Cao, Maoyong [1 ]
机构
[1] Qilu Univ Technol, Inst Oceanog Instrumentat, Shandong Acad Sci, Qingdao 266061, Peoples R China
[2] Shandong Univ Sci & Technol, Coll Geodesy & Geomat, Qingdao 266590, Peoples R China
[3] Minist Nat Resources, Inst Oceanog 1, Qingdao 266061, Peoples R China
基金
中国国家自然科学基金;
关键词
Remote sensing; Feature extraction; Convolution; Image segmentation; Semantics; Data mining; Oceans; Cross direction attention mechanism; marine remote sensing; multi-access convolutional; deep learning; convolution and dilated convolution; IMAGES; FEATURES;
D O I
10.1109/ACCESS.2020.3013898
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
With the development of remote sensing technology, the semantic segmentation and recognition of various things in the ocean have become more and more frequent. Due to the wide variety of marine things and the large differences in morphology, it has brought greater difficulties to the recognition of marine remote sensing images. In order to obtain better segmentation results of ocean remote sensing images, this paper proposes an cross attention mechanism(Horizontal and Vertical) of exponential operation combined with multi-scale convolution algorithm. Among them, the cross attention mechanism and expanded distribution weight coefficient mentioned in this paper are first proposed. First, Input the marine remote sensing image features into an cross attention mechanism algorithm of exponential operation to obtain feature weight coefficients and joint weight coefficients in multiple directions; Then, the features with weight coefficients are input into the multi-access convolutional layer and the multi-scale dilated convolutional layer respectively for deep feature mining; Then the above steps are repeated twice, and finally the semantic segmentation of marine remote sensing images is achieved by fusing multiple deep-level features afterwards. Experiments were conducted on three public marine remote sensing data sets, and the results proved the effectiveness of our proposed cross attention mechanism of extended operation algorithm. The F values of the MAMC model on Beach, Island and Sea ice data sets have reached 99.4%, 91.25%, 87.08% respectively. Compared with other models, the effect is significantly improved, and proved the powerful performance of the algorithm in the semantic segmentation of marine remote sensing images.
引用
收藏
页码:142483 / 142494
页数:12
相关论文
共 39 条
  • [1] [Anonymous], 2019, I S BIOMED IMAGING
  • [2] [Anonymous], 2019, IEEE J STARS, DOI DOI 10.1109/JSTARS.2019.2914715
  • [3] [Anonymous], 2015, 2015 12 INT COMP C
  • [4] [Anonymous], 2017, ARXIV PREPRINT ARXIV
  • [5] [Anonymous], 2015, LECT NOTES COMPUT SC, DOI DOI 10.1007/978-3-319-24574-4_28
  • [6] PiiGAN: Generative Adversarial Networks for Pluralistic Image Inpainting
    Cai, Weiwei
    Wei, Zhanguo
    [J]. IEEE ACCESS, 2020, 8 (08): : 48451 - 48463
  • [7] Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation
    Chen, Liang-Chieh
    Zhu, Yukun
    Papandreou, George
    Schroff, Florian
    Adam, Hartwig
    [J]. COMPUTER VISION - ECCV 2018, PT VII, 2018, 11211 : 833 - 851
  • [8] DenseU-Net-Based Semantic Segmentation of Objects in Urban Remote Sensing Images
    Dong, Rongsheng
    Pan, Xiaoquan
    Li, Fengying
    [J]. IEEE ACCESS, 2019, 7 : 65347 - 65356
  • [9] Dual Attention Network for Scene Segmentation
    Fu, Jun
    Liu, Jing
    Tian, Haijie
    Li, Yong
    Bao, Yongjun
    Fang, Zhiwei
    Lu, Hanqing
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 3141 - 3149
  • [10] Semantic Segmentation of SLAR Imagery with Convolutional LSTM Selectional AutoEncoders
    Gallego, Antonio-Javier
    Gil, Pablo
    Pertusa, Antonio
    Fisher, Robert B.
    [J]. REMOTE SENSING, 2019, 11 (12)