Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [41] Transferring Structured Knowledge in Unsupervised Domain Adaptation of a Sleep Staging Network
    Yoo, Chaehwa
    Lee, Hyang Woon
    Kang, Je-Won
    [J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (03) : 1273 - 1284
  • [42] Double Ensemble Soft Transfer Network for Unsupervised Domain Adaptation
    Cao, Manliang
    Zhou, Xiangdong
    Lin, Lan
    Yao, Bo
    [J]. DATABASE SYSTEMS FOR ADVANCED APPLICATIONS (DASFAA 2021), PT II, 2021, 12682 : 516 - 532
  • [43] Adversarial Regressive Domain Adaptation Approach for Infrared Thermography-Based Unsupervised Remaining Useful Life Prediction
    Jiang, Yimin
    Xia, Tangbin
    Wang, Dong
    Fang, Xiaolei
    Xi, Lifeng
    [J]. IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2022, 18 (10) : 7219 - 7229
  • [44] Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision
    Bai, Gui-Rong
    Liu, Qing-Bin
    He, Shi-Zhu
    Liu, Kang
    Zhao, Jun
    [J]. JOURNAL OF COMPUTER SCIENCE AND TECHNOLOGY, 2023, 38 (06) : 1237 - 1249
  • [45] Unsupervised Deep Domain Adaptation Based on Weighted Adversarial Network
    Jia, Xu
    Sun, Fuming
    [J]. IEEE ACCESS, 2020, 8 (08): : 64020 - 64027
  • [46] Unsupervised SAR and Optical Image Matching Using Siamese Domain Adaptation
    Zhang, Zhaoxiang
    Xu, Yuelei
    Cui, Qi
    Zhou, Qing
    Ma, Linhua
    [J]. IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2022, 60
  • [47] VARIATIONAL AUTOENCODER BASED UNSUPERVISED DOMAIN ADAPTATION FOR SEMANTIC SEGMENTATION
    Li, Zongyao
    Togo, Ren
    Ogawa, Takahiro
    Haseyama, Miki
    [J]. 2020 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2020, : 2426 - 2430
  • [48] Unsupervised Domain Adaptation on Sentence Matching Through Self-Supervision
    Gui-Rong Bai
    Qing-Bin Liu
    Shi-Zhu He
    Kang Liu
    Jun Zhao
    [J]. Journal of Computer Science and Technology, 2023, 38 : 1237 - 1249
  • [49] Unsupervised Domain Adaptation for RF-Based Gesture Recognition
    Zhang, Bin-Bin
    Zhang, Dongheng
    Li, Yadong
    Hu, Yang
    Chen, Yan
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2023, 10 (23) : 21026 - 21038
  • [50] Unsupervised Domain Adaptation Using Robust Class-Wise Matching
    Zhang, Lei
    Wang, Peng
    Wei, Wei
    Lu, Hao
    Shen, Chunhua
    van den Hengel, Anton
    Zhang, Yanning
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2019, 29 (05) : 1339 - 1349