Semantic Segmentation and Depth Estimation Based on Residual Attention Mechanism

被引:3
作者
Ji, Naihua [1 ]
Dong, Huiqian [1 ]
Meng, Fanyun [1 ]
Pang, Liping [2 ]
机构
[1] Qingdao Univ Technol, Sch Informat & Control Engn, Qingdao 266033, Peoples R China
[2] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Peoples R China
关键词
Semantic segmentation; depth estimation; residual attention; gradient balance;
D O I
10.3390/s23177466
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Semantic segmentation and depth estimation are crucial components in the field of autonomous driving for scene understanding. Jointly learning these tasks can lead to a better understanding of scenarios. However, using task-specific networks to extract global features from task-shared networks can be inadequate. To address this issue, we propose a multi-task residual attention network (MTRAN) that consists of a global shared network and two attention networks dedicated to semantic segmentation and depth estimation. The convolutional block attention module is used to highlight the global feature map, and residual connections are added to prevent network degradation problems. To ensure manageable task loss and prevent specific tasks from dominating the training process, we introduce a random-weighted strategy into the impartial multi-task learning method. We conduct experiments to demonstrate the effectiveness of the proposed method.
引用
收藏
页数:15
相关论文
共 50 条
[41]   DILATED RESIDUAL NETWORK BASED ON DUAL EXPECTATION MAXIMIZATION ATTENTION FOR SEMANTIC SEGMENTATION OF REMOTE SENSING IMAGES [J].
Liu, Jiachao ;
Xiong, Xinyue ;
Li, Jiaojiao ;
Wu, Chaoxiong ;
Song, Rui .
IGARSS 2020 - 2020 IEEE INTERNATIONAL GEOSCIENCE AND REMOTE SENSING SYMPOSIUM, 2020, :1825-1828
[42]   Depth Guidance and Intradomain Adaptation for Semantic Segmentation [J].
Lu, Jiawen ;
Shi, Jinlong ;
Zhu, Haowei ;
Ni, Jun ;
Shu, Xin ;
Sun, Yunhan ;
Cheng, Zhigang .
IEEE TRANSACTIONS ON INSTRUMENTATION AND MEASUREMENT, 2023, 72
[43]   Cross-supervision-based equilibrated fusion mechanism of local and global attention for semantic segmentation [J].
Yuan, Wenhao ;
Lu, Xiaoyan ;
Zhang, Rongfen ;
Liu, Yuhong .
APPLIED INTELLIGENCE, 2023, 53 (10) :11918-11933
[44]   Event-Based Semantic Segmentation With Posterior Attention [J].
Jia, Zexi ;
You, Kaichao ;
He, Weihua ;
Tian, Yang ;
Feng, Yongxiang ;
Wang, Yaoyuan ;
Jia, Xu ;
Lou, Yihang ;
Zhang, Jingyi ;
Li, Guoqi ;
Zhang, Ziyang .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2023, 32 :1829-1842
[45]   Lightweight Semantic Segmentation Network Based on Attention Coding [J].
Chen Xiaolong ;
Zhao Ji ;
Chen Siyi .
LASER & OPTOELECTRONICS PROGRESS, 2021, 58 (14)
[46]   Research on Image Semantic Segmentation Based on Hybrid Cascade Feature Fusion and Detailed Attention Mechanism [J].
Du, Zuoqiang ;
Liang, Yuan .
IEEE ACCESS, 2024, 12 :62365-62377
[47]   Semantic segmentation of autonomous driving scenes based on multi-scale adaptive attention mechanism [J].
Liu, Danping ;
Zhang, Dong ;
Wang, Lei ;
Wang, Jun .
FRONTIERS IN NEUROSCIENCE, 2023, 17
[48]   Real-Time Semantic Segmentation of Point Clouds Based on an Attention Mechanism and a Sparse Tensor [J].
Wang, Fei ;
Yang, Yujie ;
Wu, Zhao ;
Zhou, Jingchun ;
Zhang, Weishi .
APPLIED SCIENCES-BASEL, 2023, 13 (05)
[49]   Cross-supervision-based equilibrated fusion mechanism of local and global attention for semantic segmentation [J].
Wenhao Yuan ;
Xiaoyan Lu ;
Rongfen Zhang ;
Yuhong Liu .
Applied Intelligence, 2023, 53 :11918-11933
[50]   Based on cross-scale fusion attention mechanism network for semantic segmentation for street scenes [J].
Ye, Xin ;
Gao, Lang ;
Chen, Jichen ;
Lei, Mingyue .
FRONTIERS IN NEUROROBOTICS, 2023, 17