Research of Self-Attention in Image Segmentation

被引:1
|
作者
Cao, Fude [1 ]
Zheng, Chunguang [1 ]
Huang, Limin [1 ]
Wang, Aihua [1 ]
Zhang, Jiong [1 ]
Zhou, Feng [1 ]
Ju, Haoxue [1 ]
Guo, Haitao [1 ]
Du, Yuxia [1 ]
机构
[1] Shandong Inst Commerce & Technol, Jinan, Shandong, Peoples R China
关键词
Convolutional Neural Networks; Image Segmentation; Self-Attention;
D O I
10.4018/JITR.298619
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Although the traditional convolutional neural network is applied to image segmentation successfully, it has some limitations. That's the context information of the long-range on the image is not well captured. With the success of the introduction of self-attentional mechanisms in the field of natural language processing (NLP), people have tried to introduce the attention mechanism in the field of computer vision. It turns out that self-attention can really solve this long-range dependency problem. This paper is a summary on the application of self-attention to image segmentation in the past two years.
引用
收藏
页数:12
相关论文
共 50 条
  • [1] Self-Attention Technology in Image Segmentation
    Cao, Fude
    Lu, Xueyun
    INTERNATIONAL CONFERENCE ON INTELLIGENT TRAFFIC SYSTEMS AND SMART CITY (ITSSC 2021), 2022, 12165
  • [2] Weakly supervised histopathology image segmentation with self-attention
    Li, Kailu
    Qian, Ziniu
    Han, Yingnan
    Chang, Eric I-Chao
    Wei, Bingzheng
    Lai, Maode
    Liao, Jing
    Fan, Yubo
    Xu, Yan
    MEDICAL IMAGE ANALYSIS, 2023, 86
  • [3] Image Editing via Segmentation Guided Self-Attention Network
    Zhang, Jianfu
    Yang, Peiming
    Wang, Wentao
    Hong, Yan
    Zhang, Liqing
    IEEE SIGNAL PROCESSING LETTERS, 2020, 27 : 1605 - 1609
  • [4] Self-attention neural architecture search for semantic image segmentation
    Fan, Zhenkun
    Hu, Guosheng
    Sun, Xin
    Wang, Gaige
    Dong, Junyu
    Su, Chi
    KNOWLEDGE-BASED SYSTEMS, 2022, 239
  • [5] Cross-Modal Self-Attention Network for Referring Image Segmentation
    Ye, Linwei
    Rochan, Mrigank
    Liu, Zhi
    Wang, Yang
    2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10494 - 10503
  • [6] Lymphoma Ultrasound Image Segmentation with Self-Attention Mechanism and Stable Learning
    Han, Yingkang
    Chen, Dehua
    Luo, Yishu
    Dong, Yijie
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING - ICANN 2022, PT I, 2022, 13529 : 207 - 218
  • [7] Pyramid Self-attention for Semantic Segmentation
    Qi, Jiyang
    Wang, Xinggang
    Hu, Yao
    Tang, Xu
    Liu, Wenyu
    PATTERN RECOGNITION AND COMPUTER VISION, PT I, 2021, 13019 : 480 - 492
  • [8] Sparse Coding Inspired LSTM and Self-Attention Integration for Medical Image Segmentation
    Ji, Zexuan
    Ye, Shunlong
    Ma, Xiao
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 6098 - 6113
  • [9] Multiple GANs Guided by Self-Attention Mechanism for Automatic Cardiac Image Segmentation
    Chang Yuwen
    Lei Jiang
    Cui, Hengfei
    THIRTEENTH INTERNATIONAL CONFERENCE ON GRAPHICS AND IMAGE PROCESSING (ICGIP 2021), 2022, 12083
  • [10] DI-Unet: Dimensional interaction self-attention for medical image segmentation
    Wu, Yanlin
    Wang, Guanglei
    Wang, Zhongyang
    Wang, Hongrui
    Li, Yan
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2022, 78