Research of Self-Attention in Image Segmentation

被引：1

作者：

Cao, Fude ^{[1
]}

Zheng, Chunguang ^{[1
]}

Huang, Limin ^{[1
]}

Wang, Aihua ^{[1
]}

Zhang, Jiong ^{[1
]}

Zhou, Feng ^{[1
]}

Ju, Haoxue ^{[1
]}

Guo, Haitao ^{[1
]}

Du, Yuxia ^{[1
]}

机构：

[1] Shandong Inst Commerce & Technol, Jinan, Shandong, Peoples R China

来源：

JOURNAL OF INFORMATION TECHNOLOGY RESEARCH | 2022年 / 15卷 / 01期

关键词：

Convolutional Neural Networks; Image Segmentation; Self-Attention;

D O I：

10.4018/JITR.298619

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

Although the traditional convolutional neural network is applied to image segmentation successfully, it has some limitations. That's the context information of the long-range on the image is not well captured. With the success of the introduction of self-attentional mechanisms in the field of natural language processing (NLP), people have tried to introduce the attention mechanism in the field of computer vision. It turns out that self-attention can really solve this long-range dependency problem. This paper is a summary on the application of self-attention to image segmentation in the past two years.

引用

页数：12

共 50 条

[31] Self-Attention Network With Joint Loss for Remote Sensing Image Scene Classification
Wu, Honglin
Zhao, Shuzhen
Li, Liang
Lu, Chaoquan
Chen, Wen
IEEE ACCESS, 2020, 8 : 210347 - 210359
[32] Underwater image imbalance attenuation compensation based on attention and self-attention mechanism
Wang, Danxu
Wei, Yanhui
Liu, Junnan
Ouyang, Wenjia
Zhou, Xilin
2022 OCEANS HAMPTON ROADS, 2022,
[33] High-Resolution Remote Sensing Image Semantic Segmentation via Multiscale Context and Linear Self-Attention
Yin, Peng
Zhang, Dongmei
Han, Wei
Li, Jiang
Cheng, Jianmei
IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2022, 15 : 9174 - 9185
[34] The Contrastive Network With Convolution and Self-Attention Mechanisms for Unsupervised Cell Segmentation
Zhao, Yuhang
Shao, Xianhao
Chen, Cai
Song, Junlin
Tian, Chongxuan
Li, Wei
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2023, 27 (12) : 5837 - 5847
[35] Deep Quasi-Recurrent Self-Attention With Dual Encoder-Decoder in Biomedical CT Image Segmentation
Agarwal, Rohit
Chowdhury, Arindam
Chatterjee, Rajib Kumar
Chel, Haradhan
Murmu, Chiranjib
Murmu, Narayan
Nandi, Debashis
IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2024, 28 (12) : 7195 - 7205
[36] GSAC-UFormer: Groupwise Self-Attention Convolutional Transformer-Based UNet for Medical Image Segmentation
Garbaz, Anass
Oukdach, Yassine
Charfi, Said
El Ansari, Mohamed
Koutti, Lahcen
Salihoun, Mouna
COGNITIVE COMPUTATION, 2025, 17 (02)
[37] Self-attention random forest for breast cancer image classification
Li, Jia
Shi, Jingwen
Chen, Jianrong
Du, Ziqi
Huang, Li
FRONTIERS IN ONCOLOGY, 2023, 13
[38] Unsupervised Infrared and Visible Image Fusion with Pixel Self-attention
Cui, Saijia
Zhou, Zhiqiang
Li, Linhao
Fei, Erfang
PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, : 437 - 441
[39] SSD image target detection algorithm based on self-attention
Chu Y.
Huang Y.
Zhang X.
Liu H.
1600, Huazhong University of Science and Technology (48): : 70 - 75
[40] Fast Global Self-Attention for Seismic Image Fault Identification
Wang, Shenghou
Si, Xu
Cai, Zhongxian
Sun, Leiming
Wang, Wei
Jiang, Zirun
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2024, 62

← 1 2 3 4 5 →