Soft Warping Based Unsupervised Domain Adaptation for Stereo Matching

被引:6
作者
Zhang, Haoyuan [1 ]
Chau, Lap-Pui [1 ]
Wang, Danwei [1 ]
机构
[1] Nanyang Technol Univ, Dept Elect & Elect Engn, Singapore 639798, Singapore
关键词
Training; Three-dimensional displays; Task analysis; Pipelines; Neural networks; Adversarial machine learning; Feature extraction; stereo matching; unsupervised domain adaptation; adversarial learning; soft warping loss; ACCURATE;
D O I
10.1109/TMM.2021.3108900
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Stereo matching is a practical method to estimate depth information and retrieve 3D world in robot perception and autonomous driving scenarios. With the development of convolution neural networks (CNNs), deep-learning based stereo matching algorithms have significantly improved the accuracy and dominated most of the online benchmarks. However, limited labels in real world, especially in challenging weather conditions, still hinder the technology from practical usage. In this paper, we propose a new unsupervised learning mechanism for stereo matching, utilizing adversarial iterative learning and novel soft warping loss to promote the effectiveness of the networks in unseen environments. The experiments transferring the stereo matching module from synthetic domain to real-world domain demonstrate the superiority of our proposed method. Extensive experiments in challenging weathers further prove that our method shows great practical potential in strait environments.
引用
收藏
页码:3835 / 3846
页数:12
相关论文
共 50 条
  • [31] Automatic Loss Function Search for Adversarial Unsupervised Domain Adaptation
    Mei, Zhen
    Ye, Peng
    Ye, Hancheng
    Li, Baopu
    Guo, Jinyang
    Chen, Tao
    Ouyang, Wanli
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2023, 33 (10) : 5868 - 5881
  • [32] Style Consistency Unsupervised Domain Adaptation Medical Image Segmentation
    Chen, Lang
    Bian, Yun
    Zeng, Jianbin
    Meng, Qingquan
    Zhu, Weifang
    Shi, Fei
    Shao, Chengwei
    Chen, Xinjian
    Xiang, Dehui
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4882 - 4895
  • [33] An unsupervised stereo matching cost based on sparse representation
    Cheng, Chunbo
    Li, Hong
    Zhang, Liming
    INTERNATIONAL JOURNAL OF WAVELETS MULTIRESOLUTION AND INFORMATION PROCESSING, 2021, 19 (01)
  • [34] Unsupervised Domain Adaptation via Domain-Adaptive Diffusion
    Peng, Duo
    Ke, Qiuhong
    Ambikapathi, ArulMurugan
    Yazici, Yasin
    Lei, Yinjie
    Liu, Jun
    IEEE TRANSACTIONS ON IMAGE PROCESSING, 2024, 33 : 4245 - 4260
  • [35] Unsupervised Domain Adaptation for SAR Target Detection
    Shi, Yu
    Du, Lan
    Guo, Yuchen
    IEEE JOURNAL OF SELECTED TOPICS IN APPLIED EARTH OBSERVATIONS AND REMOTE SENSING, 2021, 14 : 6372 - 6385
  • [36] Discriminative Invariant Alignment for Unsupervised Domain Adaptation
    Lu, Yuwu
    Li, Desheng
    Wang, Wenjing
    Lai, Zhihui
    Zhou, Jie
    Li, Xuelong
    IEEE TRANSACTIONS ON MULTIMEDIA, 2022, 24 : 1871 - 1882
  • [37] Adversarial Entropy Optimization for Unsupervised Domain Adaptation
    Ma, Ao
    Li, Jingjing
    Lu, Ke
    Zhu, Lei
    Shen, Heng Tao
    IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2022, 33 (11) : 6263 - 6274
  • [38] Unsupervised Learning for Stereo Matching Using Single-View Videos
    Phuc Nguyen Hong
    Ahn, Chang Wook
    IEEE ACCESS, 2020, 8 (08): : 73804 - 73815
  • [39] Unsupervised Domain Adaptation Based Image Synthesis and Feature Alignment for Joint Optic Disc and Cup Segmentation
    Lei, Haijun
    Liu, Weixin
    Xie, Hai
    Zhao, Benjian
    Yue, Guanghui
    Lei, Baiying
    IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, 2022, 26 (01) : 90 - 102
  • [40] Domain Prompt Tuning via Meta Relabeling for Unsupervised Adversarial Adaptation
    Jin, Xin
    Lan, Cuiling
    Zeng, Wenjun
    Chen, Zhibo
    IEEE TRANSACTIONS ON MULTIMEDIA, 2024, 26 : 8333 - 8347