Research of Self-Attention in Image Segmentation

被引：1

作者：

Cao, Fude ^{[1
]}

Zheng, Chunguang ^{[1
]}

Huang, Limin ^{[1
]}

Wang, Aihua ^{[1
]}

Zhang, Jiong ^{[1
]}

Zhou, Feng ^{[1
]}

Ju, Haoxue ^{[1
]}

Guo, Haitao ^{[1
]}

Du, Yuxia ^{[1
]}

机构：

[1] Shandong Inst Commerce & Technol, Jinan, Shandong, Peoples R China

来源：

JOURNAL OF INFORMATION TECHNOLOGY RESEARCH | 2022年 / 15卷 / 01期

关键词：

Convolutional Neural Networks; Image Segmentation; Self-Attention;

D O I：

10.4018/JITR.298619

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

Although the traditional convolutional neural network is applied to image segmentation successfully, it has some limitations. That's the context information of the long-range on the image is not well captured. With the success of the introduction of self-attentional mechanisms in the field of natural language processing (NLP), people have tried to introduce the attention mechanism in the field of computer vision. It turns out that self-attention can really solve this long-range dependency problem. This paper is a summary on the application of self-attention to image segmentation in the past two years.

引用

页数：12

共 50 条

[31] Self-Attention Driven Decoder for SAR Image-based Semantic Flood Zone Segmentation
Girisha, S.
Yadav, Hrishikesh Singh
Manawat, Divyanshu
Savitha, G.
Shreesha, S.
PROCEEDINGS OF THE 6TH ACM SIGSPATIAL INTERNATIONAL WORKSHOP ON AI FOR GEOGRAPHIC KNOWLEDGE DISCOVERY, GEOAI 2023, 2023, : 14 - 19
[32] ISC-TRANSUNET: MEDICAL IMAGE SEGMENTATION NETWORK BASED ON THE INTEGRATION OF SELF-ATTENTION AND CONVOLUTION
Li, Fang
Pei, Siyu
Zhang, Ziqun
Yang, Fuming
JOURNAL OF MECHANICS IN MEDICINE AND BIOLOGY, 2023, 23 (09)
[33] Borehole image detection of aero-engine based on self-attention semantic segmentation model
Cao S.
Liu J.
Song G.
Zuo H.
Beijing Hangkong Hangtian Daxue Xuebao/Journal of Beijing University of Aeronautics and Astronautics, 2023, 49 (06): : 1504 - 1515
[34] PAC-UNet: Parallel Dual Self-Attention with Convolution for Meniscal MRI Image Segmentation
Zhang, Weijian
Feng, Meiling
Xia, Chengyi
INTERNATIONAL JOURNAL ON ARTIFICIAL INTELLIGENCE TOOLS, 2024, 33 (04)
[35] MCI Net: Mamba- Convolutional lightweight self-attention medical image segmentation network
Zhang, Yelin
Wang, Guanglei
Ma, Pengchong
Li, Yan
BIOMEDICAL PHYSICS & ENGINEERING EXPRESS, 2025, 11 (01):
[36] Permutation invariant self-attention infused U-shaped transformer for medical image segmentation
Patil, Sanjeet S.
Ramteke, Manojkumar
Rathore, Anurag S.
NEUROCOMPUTING, 2025, 625
[37] Brain MR Image Segmentation Based on Spatial Self-attention Mechanism and Depth Feature Reconstruction
Wei Y.
Lin Z.-H.
Qi L.
Li B.-Q.
Dongbei Daxue Xuebao/Journal of Northeastern University, 2023, 44 (02): : 177 - 185
[38] GLSANet: Global-Local Self-Attention Network for Remote Sensing Image Semantic Segmentation
Hu, Xudong
Zhang, Penglin
Zhang, Qi
Yuan, Feng
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[39] GLSANet: Global-Local Self-Attention Network for Remote Sensing Image Semantic Segmentation
Hu, Xudong
Zhang, Penglin
Zhang, Qi
Yuan, Feng
IEEE GEOSCIENCE AND REMOTE SENSING LETTERS, 2023, 20
[40] Efficient Semantic Segmentation via Self-Attention and Self-Distillation
An, Shumin
Liao, Qingmin
Lu, Zongqing
Xue, Jing-Hao
IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (09) : 15256 - 15266

← 1 2 3 4 5 →