AAR:Attention Remodulation for Weakly Supervised Semantic Segmentation

被引:0
作者
Yu-e Lin
Houguo Li
Xingzhu Liang
Mengfan Li
Huilin Liu
机构
[1] Anhui University of Science and Technology,School of Computer Science and Engineering
[2] Anhui University of Science and Technology,Institute of Environment
来源
The Journal of Supercomputing | 2024年 / 80卷
关键词
Weakly supervised semantic segmentation; Attention activation; Feature pixels;
D O I
暂无
中图分类号
学科分类号
摘要
Weakly Supervised Semantic Segmentation is a crucial task in computer vision. However, existing methods that utilize Class Activation Maps (CAMs) with classification tasks can only identify a small part of the region. To address this limitation, we propose a novel Attention Activation Remodulation (AAR) scheme that leverages traditional CAMs and the remodulation branch to obtain weighted CAMs for recalibrated supervision. The AAR scheme re-arranges important features’ distribution from the channel and space perspectives, which regulates segmentation-oriented activation responses. In addition, we propose a Feature Pixel Extraction Module (FPEM) that utilizes contextual information to improve pixel prediction. Furthermore, the proposed scheme can be combined with other methods to improve overall performance. Extensive experiments on the PASCAL VOC 2012 dataset demonstrate the effectiveness of the AAR mechanism and FPEM module.
引用
收藏
页码:9096 / 9114
页数:18
相关论文
共 50 条
[21]   Multi-Granular Semantic Mining for Weakly Supervised Semantic Segmentation [J].
Zhang, Meijie ;
Li, Jianwu ;
Zhou, Tianfei .
PROCEEDINGS OF THE 30TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2022, 2022, :6019-6028
[22]   Multiscale Superpixel Affinity for Improved Weakly Supervised Semantic Segmentation [J].
Fu, Yun ;
Wang, Wenwu ;
Zhu, Lei .
PROCEEDINGS OF THE 36TH CHINESE CONTROL AND DECISION CONFERENCE, CCDC 2024, 2024, :6210-6215
[23]   Weakly Supervised Semantic Segmentation via Mamba Image Restoration [J].
Zhang, Congwei ;
Zhang, Xian ;
Yao, Yuncong ;
Yang, Wankou .
PROCEEDINGS OF THE 8TH INTERNATIONAL CONFERENCE ON ALGORITHMS, COMPUTING AND SYSTEMS, ICACS 2024, 2024, :88-94
[24]   Contrastive Patch Comparison Transformer for Weakly Supervised Semantic Segmentation [J].
Cai, Wentian ;
Yang, Weixian ;
Lin, Jing ;
Gao, Ying .
2024 IEEE INTERNATIONAL CONFERENCE ON SMART INTERNET OF THINGS, SMARTIOT 2024, 2024, :496-501
[25]   Atrous convolutional feature network for weakly supervised semantic segmentation [J].
Xu, Lian ;
Xue, Hao ;
Bennamoun, Mohammed ;
Boussaid, Farid ;
Sohel, Ferdous .
NEUROCOMPUTING, 2021, 421 :115-126
[26]   Phase Concentration and Shortcut Suppression for Weakly Supervised Semantic Segmentation [J].
Kwon, Hoyong ;
Jeong, Jaeseok ;
Yoon, Sung-Hoon ;
Yoon, Kuk-Jin .
COMPUTER VISION - ECCV 2024, PT XXXII, 2025, 15090 :293-312
[27]   Weakly Supervised Semantic Segmentation Using Constrained Dominant Sets [J].
Aslan, Sinem ;
Pelillo, Marcello .
IMAGE ANALYSIS AND PROCESSING - ICIAP 2019, PT II, 2019, 11752 :425-436
[28]   Weakly Supervised Semantic Segmentation Using Color Adjacency Loss [J].
Kim, Youngeun ;
Kim, Taekyung ;
Kim, Seunghyeon ;
Kim, Changick .
2018 IEEE INTERNATIONAL CONFERENCE ON VISUAL COMMUNICATIONS AND IMAGE PROCESSING (IEEE VCIP), 2018,
[29]   Segmentation from localization: a weakly supervised semantic segmentation method for resegmenting CAM [J].
Jiang, Jingjing ;
Wang, Hongxia ;
Wu, Jiali ;
Liu, Chun .
MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 83 (19) :57785-57810
[30]   DDAug: Differentiable Data Augmentation for Weakly Supervised Semantic Segmentation [J].
Li, Boyang ;
Zhang, Fei ;
Wang, Longguang ;
Wang, Yingqian ;
Liu, Ting ;
Lin, Zaiping ;
An, Wei ;
Guo, Yulan .
IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 :4764-4775