A fast instance segmentation with one-stage multi-task deep neural network for autonomous driving

被引:15
|
作者
Tseng, Kuo-Kun [1 ]
Lin, Jiangrui [1 ]
Chen, Chien-Ming [2 ]
Hassan, Mohammad Mehedi [3 ]
机构
[1] Harbin Inst Technol Shenzhen, Shenzhen, Peoples R China
[2] Shandong Univ Sci & Technol, Qingdao, Shandong, Peoples R China
[3] King Saud Univ, Coll Comp & Informat Sci, Informat Syst Dept, Res Chair Pervas & Mobile Comp, Riyadh 11543, Saudi Arabia
关键词
Instance segmentation; Autonomous driving; Multi-task neural network; Object detection; Image segmentation;
D O I
10.1016/j.compeleceng.2021.107194
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
An accurate real-time instance segmentation, which can perform both object detection and semantic segmentation at the same time with a multi-task neural network, is important for autonomous driving. This paper proposes a fast one-stage multi-task neural network for instance segmentation, which can meet the requirements of real-time processing with sufficient accuracy and that is more desirable for self-driving applications. With a one-stage strategy, it can perform object detection and segmentation concurrently. This paper conducts the related experiments with two public datasets. The cross-validation was carried out with set of variables to determine the optimal combination of each model and compared with the mainstream instance segmentation algorithms. According to our experiment, the proposed algorithm has five times the performance compared to the previous algorithms, which can meet the real-time requirement for autonomous driving applications.
引用
收藏
页数:10
相关论文
共 50 条
  • [1] Monocular Instance Motion Segmentation for Autonomous Driving: KITTI InstanceMotSeg Dataset and Multi-task Baseline
    Mohamed, Eslam
    Ewaisha, Mahmoud
    Siam, Mennatullah
    Rashed, Hazem
    Yogamani, Senthil
    Hamdy, Waleed
    El-Dakdouky, Mohamed
    El-Sallab, Ahmad
    2021 32ND IEEE INTELLIGENT VEHICLES SYMPOSIUM (IV), 2021, : 114 - 121
  • [2] Multi-task Network for Panoptic Segmentation in Automated Driving
    Petrovai, Andra
    Nedevschi, Sergiu
    2019 IEEE INTELLIGENT TRANSPORTATION SYSTEMS CONFERENCE (ITSC), 2019, : 2394 - 2401
  • [3] Real-Time Multi-task Network for Autonomous Driving
    Dat, Vu Thanh
    Bao, Ngo Viet Hoai
    Hung, Phan Duy
    ADVANCES IN COMPUTING AND DATA SCIENCES (ICACDS 2022), PT I, 2022, 1613 : 207 - 218
  • [4] Joint multi-task cascade for instance segmentation
    Yaole Wen
    Fuyuan Hu
    Jinchang Ren
    Xinru Shang
    Linyan Li
    Xuefeng Xi
    Journal of Real-Time Image Processing, 2020, 17 : 1983 - 1989
  • [5] Joint multi-task cascade for instance segmentation
    Wen, Yaole
    Hu, Fuyuan
    Ren, Jinchang
    Shang, Xinru
    Li, Linyan
    Xi, Xuefeng
    JOURNAL OF REAL-TIME IMAGE PROCESSING, 2020, 17 (06) : 1983 - 1989
  • [6] Deep Convolutional Neural Networks for Multi-Instance Multi-Task Learning
    Zeng, Tao
    Ji, Shuiwang
    2015 IEEE INTERNATIONAL CONFERENCE ON DATA MINING (ICDM), 2015, : 579 - 588
  • [7] Instance-aware Semantic Segmentation via Multi-task Network Cascades
    Dai, Jifeng
    He, Kaiming
    Sun, Jian
    2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 3150 - 3158
  • [8] OSFormer: One-Stage Camouflaged Instance Segmentation with Transformers
    Pei, Jialun
    Cheng, Tianyang
    Fan, Deng-Ping
    Tang, He
    Chen, Chuanbo
    Van Gool, Luc
    COMPUTER VISION - ECCV 2022, PT XVIII, 2022, 13678 : 19 - 37
  • [9] A novel neural network architecture and cross-model transfer learning for multi-task autonomous driving
    Li, Youwei
    Qu, Jian
    DATA TECHNOLOGIES AND APPLICATIONS, 2024, 58 (05) : 693 - 717
  • [10] Multi-Task Y-Shaped Graph Neural Network for Point Cloud Learning in Autonomous Driving
    Zou, Xiaofeng
    Li, Kenli
    Li, Yangfan
    Wei, Wei
    Chen, Cen
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2022, 23 (07) : 9568 - 9579