Semantic Segmentation and Depth Estimation Based on Residual Attention Mechanism

被引:3
作者
Ji, Naihua [1 ]
Dong, Huiqian [1 ]
Meng, Fanyun [1 ]
Pang, Liping [2 ]
机构
[1] Qingdao Univ Technol, Sch Informat & Control Engn, Qingdao 266033, Peoples R China
[2] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Peoples R China
关键词
Semantic segmentation; depth estimation; residual attention; gradient balance;
D O I
10.3390/s23177466
中图分类号
O65 [分析化学];
学科分类号
070302 ; 081704 ;
摘要
Semantic segmentation and depth estimation are crucial components in the field of autonomous driving for scene understanding. Jointly learning these tasks can lead to a better understanding of scenarios. However, using task-specific networks to extract global features from task-shared networks can be inadequate. To address this issue, we propose a multi-task residual attention network (MTRAN) that consists of a global shared network and two attention networks dedicated to semantic segmentation and depth estimation. The convolutional block attention module is used to highlight the global feature map, and residual connections are added to prevent network degradation problems. To ensure manageable task loss and prevent specific tasks from dominating the training process, we introduce a random-weighted strategy into the impartial multi-task learning method. We conduct experiments to demonstrate the effectiveness of the proposed method.
引用
收藏
页数:15
相关论文
共 50 条
  • [21] Semantic segmentation based on double pyramid network with improved global attention mechanism
    Ou, Xianfeng
    Wang, Hanpu
    Zhang, Guoyun
    Li, Wujing
    Yu, Shuixiang
    APPLIED INTELLIGENCE, 2023, 53 (15) : 18898 - 18909
  • [22] Semantic Segmentation of Plant Leaves Based on Generative Adversarial Network and Attention Mechanism
    Cao, Liying
    Li, Hongda
    Liu, Xuerui
    Chen, Guifen
    Yu, Helong
    IEEE ACCESS, 2022, 10 : 76310 - 76317
  • [23] Semantic Segmentation With Attention Mechanism for Remote Sensing Images
    Zhao, Qi
    Liu, Jiahui
    Li, Yuewen
    Zhang, Hong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [24] Self-Supervised Monocular Depth Estimation Method for Joint Semantic Segmentation
    Song X.
    Hu H.
    Ning J.
    Liang L.
    Lu X.
    Hei X.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2024, 61 (05): : 1336 - 1347
  • [25] Semantic Segmentation Based on Depth Background Blur
    Li, Hao
    Liu, Changjiang
    Basu, Anup
    APPLIED SCIENCES-BASEL, 2022, 12 (03):
  • [26] An Attention based Method for Video Semantic Segmentation
    Huang, Yuan
    Huang, Qian
    Huang, Shuai
    Li, Yanping
    TWELFTH INTERNATIONAL CONFERENCE ON DIGITAL IMAGE PROCESSING (ICDIP 2020), 2020, 11519
  • [27] Development of an obstacle avoiding autonomous vehicle by using stereo depth estimation and artificial intelligence based semantic segmentation
    Ulusoy, Utku
    Eren, Ogulcan
    Demirhan, Ayse
    ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2023, 126
  • [28] Semantic Segmentation Network Based on Integral Attention
    Xiong, Siqi
    PROCEEDINGS OF 2024 INTERNATIONAL CONFERENCE ON COMPUTER AND MULTIMEDIA TECHNOLOGY, ICCMT 2024, 2024, : 285 - 288
  • [29] UNSUPERVISED MONOCULAR DEPTH ESTIMATION BASED ON DUAL ATTENTION MECHANISM AND DEPTH-AWARE LOSS
    Ye, Xinchen
    Zhang, Mingliang
    Xu, Rui
    Zhong, Wei
    Fan, Xin
    Liu, Zhu
    Zhang, Jiaao
    2019 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO (ICME), 2019, : 169 - 174
  • [30] An Unmanned Aerial Vehicle Detection Algorithm Based on Semantic Segmentation and Visual Attention Mechanism
    Zhang, Jiaohao
    Zhang, Qiang
    Shi, Chunlei
    PROCEEDINGS OF 2018 THE 2ND INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND ARTIFICIAL INTELLIGENCE (CSAI 2018) / 2018 THE 10TH INTERNATIONAL CONFERENCE ON INFORMATION AND MULTIMEDIA TECHNOLOGY (ICIMT 2018), 2018, : 309 - 313