Deep Learning for 3D Reconstruction, Augmentation, and Registration: A Review Paper

被引:4
作者
Vinodkumar, Prasoon Kumar [1 ]
Karabulut, Dogus [1 ]
Avots, Egils [1 ]
Ozcinar, Cagri [1 ]
Anbarjafari, Gholamreza [1 ,2 ,3 ,4 ]
机构
[1] Univ Tartu, Inst Technol, iCV Lab, EE-50090 Tartu, Estonia
[2] PwC Advisory, Helsinki 00180, Finland
[3] iVCV OU, EE-51011 Tartu, Estonia
[4] Yildiz Tech Univ, Inst Higher Educ, TR-34349 Istanbul, Turkiye
关键词
deep learning; 3D reconstruction; 3D augmentation; 3D registration; point cloud; voxel; neural networks; convolutional neural networks; graph neural networks; generative adversarial networks; review; POINT; GENERATION; NETWORK;
D O I
10.3390/e26030235
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
The research groups in computer vision, graphics, and machine learning have dedicated a substantial amount of attention to the areas of 3D object reconstruction, augmentation, and registration. Deep learning is the predominant method used in artificial intelligence for addressing computer vision challenges. However, deep learning on three-dimensional data presents distinct obstacles and is now in its nascent phase. There have been significant advancements in deep learning specifically for three-dimensional data, offering a range of ways to address these issues. This study offers a comprehensive examination of the latest advancements in deep learning methodologies. We examine many benchmark models for the tasks of 3D object registration, augmentation, and reconstruction. We thoroughly analyse their architectures, advantages, and constraints. In summary, this report provides a comprehensive overview of recent advancements in three-dimensional deep learning and highlights unresolved research areas that will need to be addressed in the future.
引用
收藏
页数:44
相关论文
共 217 条
[1]   Self-Supervised Learning for Domain Adaptation on Point Clouds [J].
Achituve, Idan ;
Maron, Haggai ;
Chechik, Gal .
2021 IEEE WINTER CONFERENCE ON APPLICATIONS OF COMPUTER VISION (WACV 2021), 2021, :123-133
[2]  
Anciukevicius T., 2022, Advances in Neural Information Processing Systems, V35, P37037
[3]  
Bautista MA, 2020, Arxiv, DOI [arXiv:2006.15427, 10.48550/ARXIV.2006.15427 2006.15427, DOI 10.48550/ARXIV.2006.154272006.15427]
[4]   3D Semantic Parsing of Large-Scale Indoor Spaces [J].
Armeni, Iro ;
Sener, Ozan ;
Zamir, Amir R. ;
Jiang, Helen ;
Brilakis, Ioannis ;
Fischer, Martin ;
Savarese, Silvio .
2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, :1534-1543
[5]   PointDSC: Robust Point Cloud Registration using Deep Spatial Consistency [J].
Bai, Xuyang ;
Luo, Zixin ;
Zhou, Lei ;
Chen, Hongkai ;
Li, Lei ;
Hu, Zeyu ;
Fu, Hongbo ;
Tai, Chiew-Lan .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15854-15864
[6]   Fostering Generalization in Single-view 3D Reconstruction by Learning a Hierarchy of Local and Global Shape Priors [J].
Bechtold, Jan ;
Tatarchenko, Maxim ;
Fischer, Volker ;
Brox, Thomas .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :15875-15884
[7]   GRAMMAR-SUPPORTED 3D INDOOR RECONSTRUCTION FROM POINT CLOUDS FOR "AS-BUILT" BIM [J].
Becker, S. ;
Peter, M. ;
Fritsch, D. .
PIA15+HRIGI15 - JOINT ISPRS CONFERENCE, VOL. II, 2015, 2-3 (W4) :17-24
[8]   Generation and application of rules for quality dependent facade reconstruction [J].
Becker, Susanne .
ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2009, 64 (06) :640-653
[9]   SemanticKITTI: A Dataset for Semantic Scene Understanding of LiDAR Sequences [J].
Behley, Jens ;
Garbade, Martin ;
Milioto, Andres ;
Quenzel, Jan ;
Behnke, Sven ;
Stachniss, Cyrill ;
Gall, Juergen .
2019 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2019), 2019, :9296-9306
[10]   AdaBins: Depth Estimation Using Adaptive Bins [J].
Bhat, Shariq Farooq ;
Alhashim, Ibraheem ;
Wonka, Peter .
2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, :4008-4017