3D Reconstruction and Accuracy Evaluation of Ancient Chinese Architectural Patches Based on Depth Learning from Single Image

被引:0
作者
Hu Lihua [1 ,2 ]
Yin Wenzhuang [1 ,2 ]
Xing Siyuan [2 ]
Zhang Jifu [1 ]
Dong Qiulei [2 ]
Hu Zhanyi [2 ]
机构
[1] Taiyuan Univ Sci & Technol, Coll Comp Sci & Technol, Taiyuan 030024, Shanxi, Peoples R China
[2] Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
关键词
machine vision; ancient Chinese architecture; depth learning; accuracy evaluation; 3D reconstruction;
D O I
10.3788/LOP202259.1415020
中图分类号
TM [电工技术]; TN [电子技术、通信技术];
学科分类号
0808 ; 0809 ;
摘要
This paper primarily explores the depth learning method from a single image under the current unsupervised framework. It investigates whether this method can effectively deal with the repetition of the inherent structure and texture of ancient Chinese architectural images and whether it can meet the centimeter-level reconstruction accuracy required by the Chinese architecture documentation standard. Specifically, the accuracy difference of depth learning based on a single image under the image acquisition mode of fixed binocular cameras and the image acquisition mode of a single moving camera is compared using the data obtained by the structured light depth camera as the ground truth by directly comparing the depth map and the three-dimensional (3D) point cloud. The experimental results show that while 3D reconstruction based on multiple images is challenging due to the existence of repeated structures and textures, the impact of the existence on depth learning based on a single image is generally insignificant. In addition, even though depth learning based on a single image has achieved comparable accuracy with laser scanning on many open indoor and outdoor datasets, it is still difficult to achieve the centimeter-level reconstruction accuracy required by the digital documentation standard of ancient Chinese architectural 3D reconstruction. In the future, the shape of prior information will be exploited to improve the reconstruction accuracy.
引用
收藏
页数:10
相关论文
共 25 条
  • [1] Signal Processing of Spatial Convolutional Neural Network for Laser Ranging
    Bai Yibo
    Pan Kangli
    Geng Lin
    [J]. CHINESE JOURNAL OF LASERS-ZHONGGUO JIGUANG, 2021, 48 (23):
  • [2] Bian J W, UNSUPERVISED SCALE C
  • [3] Estimating Depth From Monocular Images as Classification Using Deep Fully Convolutional Residual Networks
    Cao, Yuanzhouhan
    Wu, Zifeng
    Shen, Chunhua
    [J]. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2018, 28 (11) : 3174 - 3182
  • [4] [陈加 Chen Jia], 2019, [自动化学报, Acta Automatica Sinica], V45, P657
  • [5] Eigen D, 2014, ADV NEUR IN, V27
  • [6] Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecture
    Eigen, David
    Fergus, Rob
    [J]. 2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, : 2650 - 2658
  • [7] RANDOM SAMPLE CONSENSUS - A PARADIGM FOR MODEL-FITTING WITH APPLICATIONS TO IMAGE-ANALYSIS AND AUTOMATED CARTOGRAPHY
    FISCHLER, MA
    BOLLES, RC
    [J]. COMMUNICATIONS OF THE ACM, 1981, 24 (06) : 381 - 395
  • [8] Deep Ordinal Regression Network for Monocular Depth Estimation
    Fu, Huan
    Gong, Mingming
    Wang, Chaohui
    Batmanghelich, Kayhan
    Tao, Dacheng
    [J]. 2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, : 2002 - 2011
  • [9] Monocular Camera-Based Three-Point Laser Pointer Ranging and Pose Estimation Method
    Gao Song
    Bai Lizhuo
    [J]. ACTA OPTICA SINICA, 2021, 41 (09)
  • [10] Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue
    Garg, Ravi
    VijayKumar, B. G.
    Carneiro, Gustavo
    Reid, Ian
    [J]. COMPUTER VISION - ECCV 2016, PT VIII, 2016, 9912 : 740 - 756