Self-supervised sub-category exploration for Pseudo label generation

被引:0
|
作者
Chern, Wei-Chih [1 ]
Kim, Taegeon [2 ]
Nguyen, Tam, V [3 ]
Asari, Vijayan K. [1 ]
Kim, Hongjo [2 ]
机构
[1] Univ Dayton, Dept Elect & Comp Engn, Dayton, OH 45469 USA
[2] Yonsei Univ, Dept Civil & Environm Engn, Seoul, South Korea
[3] Univ Dayton, Dept Comp Sci, Dayton, OH 45469 USA
关键词
Self -supervised learning; Weakly supervised learning; Semantic segmentation; Pseudo label generation; Training data preparation; Construction vehicle;
D O I
10.1016/j.autcon.2023.104862
中图分类号
TU [建筑科学];
学科分类号
0813 ;
摘要
Image segmentation-based applications have been actively investigated. However, it is non-trivial to prepare polygon annotations. Previous studies suggested pseudo label generation methods based on weakly supervised learning to lessen the burden of annotation. Nevertheless, the quality of pseudo labels could not be ideal due to target object characteristics and insufficient data size in the construction domain, as identified in this study. This study proposes a fusion architecture, SESC-CAM, to address the challenge, building upon weakly and self -supervised learning methods. The proposed architecture was validated on the AIM dataset, and the generated pseudo labels recorded a mIoU score of 64.99% and 67.65% after the refinement by using a conditional random field, and outperformed its predecessors by 11.29% and 9.14%. The refined pseudo labels were used to train a segmentation model and recorded a 74% mIoU score in semantic segmentation results. The findings of this study provide insights for automated training data preparation.
引用
收藏
页数:9
相关论文
共 50 条
  • [21] Unsupervised object discovery with pseudo label generated using K-means and self-supervised transformer
    Lim, SeongTaek
    Park, JaeEon
    Lee, MinYoung
    Lee, HongChul
    NEUROCOMPUTING, 2023, 545
  • [22] Self-supervised Label Augmentation via Input Transformations
    Lee, Hankook
    Hwang, Sung Ju
    Shin, Jinwoo
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 119, 2020, 119
  • [23] Self-supervised knowledge distillation for complementary label learning
    Liu, Jiabin
    Li, Biao
    Lei, Minglong
    Shi, Yong
    NEURAL NETWORKS, 2022, 155 : 318 - 327
  • [24] Learning Action Representations for Self-supervised Visual Exploration
    Oh, Changjae
    Cavallaro, Andrea
    2019 INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2019, : 5873 - 5879
  • [25] Curiosity-driven Exploration by Self-supervised Prediction
    Pathak, Deepak
    Agrawal, Pulkit
    Efros, Alexei A.
    Darrell, Trevor
    INTERNATIONAL CONFERENCE ON MACHINE LEARNING, VOL 70, 2017, 70
  • [26] SEMI: Self-supervised Exploration via Multisensory Incongruity
    Wang, Jianren
    Zhuang, Ziwen
    Zhao, Hang
    2022 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA 2022), 2022, : 2663 - 2670
  • [27] Curiosity-driven Exploration by Self-supervised Prediction
    Pathak, Deepak
    Agrawal, Pulkit
    Efros, Alexei A.
    Darrell, Trevor
    2017 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW), 2017, : 488 - 489
  • [28] Narrative Plan Generation with Self-Supervised Learning
    Polceanu, Mihai
    Porteous, Julie
    Lindsay, Alan
    Cavazza, Marc
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 5984 - 5992
  • [29] DrapeNet: Garment Generation and Self-Supervised Draping
    De Luigi, Luca
    Li, Ren
    Guillard, Benoit
    Salzmann, Mathieu
    Fua, Pascal
    2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR, 2023, : 1451 - 1460
  • [30] A Weakly Supervised Brain Tumor Segmentation Strategy Based on Multi-level Sub-category and Membership Matrix
    Li, Zi-Wei
    Xuan, Shi-Bin
    Wang, Li
    Wang, Kuan
    CURRENT MEDICAL IMAGING, 2023, 19 (10) : 1196 - 1206