3D Convolution Channel Compression for Stereo Matching

被引:0
|
作者
Wang, Tengfei [1 ]
Lu, Yang [1 ,2 ]
Zhang, Zhou [1 ]
Wei, Xing [1 ,3 ]
Wei, Zhen [1 ,3 ]
机构
[1] Hefei Univ Technol, Sch Comp Sci & Informat Engn, Hefei 230009, Peoples R China
[2] Anhui Mine IOT & Secur Monitoring Technol Key Lab, Hefei 230088, Peoples R China
[3] Hefei Univ Technol, Intelligent Mfg Inst, Hefei 230009, Peoples R China
来源
ADVANCED INTELLIGENT COMPUTING TECHNOLOGY AND APPLICATIONS, PT IV, ICIC 2024 | 2024年 / 14865卷
关键词
Stereo Matching; Disparity Estimation; Depth Estimation; Model Compression; Cost Aggregation; SCENE FLOW;
D O I
10.1007/978-981-97-5591-2_5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In recent years, many deep models for stereo matching employ 3D convolutions for cost aggregation to achieve better performance. However, this approach requires substantial computational and memory resources, limiting the deployment of the model on edge devices. In this paper, we analyze the challenges of channel compression in stereo matching models and adopt a straightforward and efficient compression method. Ourmethod focuses on the channel compression of the cost aggregation module, enabling the model to achieve acceleration on existing hardware, reducing significantly computational cost. We set a hyperparameter. that decides the compression rate, and compress the channels of each layer in cost aggregation module according to it. This method ensures the consistency for irregular skip connections. We extensively test our method on GwcNet, PSMNet and CFNet on multiple datasets, achieving promising results. We believe that the proposed compression method allows stereo matching models to better balance computational cost and accuracy during various degrees of channel compression, making them more suitable for deployment on edge devices.
引用
收藏
页码:49 / 61
页数:13
相关论文
共 50 条
  • [31] Deep Video Compression Based on 3D Convolution Artifacts Removal and Attention Compression Module
    Liu, Zhichen
    Luo, Jianping
    ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PART X, 2023, 14263 : 111 - 123
  • [32] 3D LiDAR and Stereo Fusion using Stereo Matching Network with Conditional Cost Volume Normalization
    Wang, Tsun-Hsuan
    Hu, Hou-Ning
    Lin, Chieh Hubert
    Tsai, Yi-Hsuan
    Chiu, Wei-Chen
    Sun, Min
    2019 IEEE/RSJ INTERNATIONAL CONFERENCE ON INTELLIGENT ROBOTS AND SYSTEMS (IROS), 2019, : 5895 - 5902
  • [33] Optimizing small channel 3D convolution on GPU with tensor core
    Jiang, Jiazhi
    Huang, Dan
    Du, Jiangsu
    Lu, Yutong
    Liao, Xiangke
    PARALLEL COMPUTING, 2022, 113
  • [34] An accurate and robust stereo matching algorithm with variable windows for 3D measurements
    Kim, GB
    Chung, SC
    MECHATRONICS, 2004, 14 (06) : 715 - 735
  • [35] A Stereo Matching Model Observer For Stereoscopic Viewing of 3D Medical Images
    Wen, Gezheng
    Markey, Mia K.
    Muralidhar, Gautam S.
    MEDICAL IMAGING 2014: IMAGE PERCEPTION, OBSERVER PERFORMANCE, AND TECHNOLOGY ASSESSMENT, 2014, 9037
  • [36] Improved segment-based 3D surface stereo matching algorithm
    He, K. (hekai626@163.com), 1600, Editorial Board of Jilin University (44):
  • [37] Multimodal gait recognition based on stereo vision and 3D template matching
    Gomatam, ANM
    Sasi, S
    CISST '04: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON IMAGING SCIENCE, SYSTEMS, AND TECHNOLOGY, 2004, : 405 - 410
  • [38] Improvement on Matching Breakage of Multi-View Stereo 3D Reconstruction
    Lin, Hung-Lin
    Lin, Tsung-Yi
    Li, Yi-Xuan
    Tseng, Yu-Sheng
    Li, Xin-Yi
    Cal, Qlan-Wen
    Chen, Zheng
    Shi, Yi-Rou
    PROCEEDINGS OF THE IEEE INTERNATIONAL CONFERENCE ON ADVANCED MATERIALS FOR SCIENCE AND ENGINEERING (IEEE-ICAMSE 2016), 2016, : 423 - 425
  • [39] Real-Time Stereo Matching For 3D Hand Gesture Recognition
    Huang, Po-Kuan
    Lin, Tung-Yang
    Lin, Hsu-Ting
    Wu, Chi-Hao
    Hsiao, Ching-Chun
    Liao, Chao-Kang
    Lemmens, Peter
    2012 INTERNATIONAL SOC DESIGN CONFERENCE (ISOCC), 2012, : 29 - 32
  • [40] An improved Stereo Matching Algorithm applied to 3D Visualization of Plant Leaf
    Liu, Zhi-chao
    Xu, Li-hong
    Lin, Chao-feng
    2015 8TH INTERNATIONAL SYMPOSIUM ON COMPUTATIONAL INTELLIGENCE AND DESIGN (ISCID), VOL 2, 2015, : 354 - 358