Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
|
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [1] Horizontal Attention Based Generation Module for Unsupervised Domain Adaptive Stereo Matching
    Wang, Sungjun
    Seo, Junghyun
    Jeon, Hyunjae
    Lim, Sungjin
    Park, Sanghyun
    Lim, Yongseob
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2023, 8 (10) : 6779 - 6786
  • [2] Iterative Soft Prompt-Tuning for Unsupervised Domain Adaptation
    Zhu, Yi
    Wang, Shuqin
    Qiang, Jipeng
    Wu, Xindong
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (12) : 8580 - 8592
  • [3] Edge Domain Adaptation for Stereo Matching
    Li, Xing
    Fan, Yangyu
    Guo, Zhe
    Duan, Yu
    Liu, Shiya
    Dianzi Yu Xinxi Xuebao/Journal of Electronics and Information Technology, 2024, 46 (07): : 2970 - 2980
  • [4] Multi-Source Unsupervised Domain Adaptation via Pseudo Target Domain
    Ren, Chuan-Xian
    Liu, Yong-Hui
    Zhang, Xi-Wen
    Huang, Ke-Kun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 2122 - 2135
  • [5] Soft Instance-Level Domain Adaptation With Virtual Classifier for Unsupervised Hyperspectral Image Classification
    Cheng, Yuhu
    Chen, Yang
    Kong, Yi
    Wang, Xuesong
    IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2023, 61
  • [6] Planet Craters Detection Based on Unsupervised Domain Adaptation
    Zhang, Zhaoxiang
    Xu, Yuelei
    Song, Jianing
    Zhou, Qing
    Rasol, Jarhinbek
    Ma, Linhua
    IEEE TRANSACTIONS ON AEROSPACE AND ELECTRONIC SYSTEMS, 2023, 59 (05) : 7140 - 7152
  • [7] Learning Transferable Parameters for Unsupervised Domain Adaptation
    Han, Zhongyi
    Sun, Haoliang
    Yin, Yilong
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2022, 31 : 6424 - 6439
  • [8] Synthetic-to-Real Domain Adaptation Joint Spatial Feature Transform for Stereo Matching
    Li, Xing
    Fan, Yangyu
    Rao, Zhibo
    Lv, Guoyun
    Liu, Shiya
    IEEE SIGNAL PROCESSING LETTERS, 2022, 29 : 60 - 64
  • [9] An improved binocular stereo matching algorithm based on AANet
    Yang, Ge
    Liao, Yuting
    MULTIMEDIA TOOLS AND APPLICATIONS, 2023, 82 (26) : 40987 - 41003
  • [10] Unsupervised Stereo Matching Using Confidential Correspondence Consistency
    Joung, Sunghun
    Kim, Seungryong
    Park, Kihong
    Sohn, Kwanghoon
    IEEE TRANSACTIONS ON INTELLIGENT TRANSPORTATION SYSTEMS, 2020, 21 (05) : 2190 - 2203