Hole-filling framework by combining structural and textural information for the 3D Terracotta Warriors

被引:3
作者
Chu, Tong [1 ]
Yao, Wenmin [1 ]
Liu, Jie [1 ]
Xu, Xueli [1 ]
Nan, Haiyang [1 ]
Cao, Xin [1 ]
Li, Kang [1 ]
Zhou, Mingquan [1 ]
机构
[1] Northwest Univ, Sch Informat & Technol, Natl Local Joint Engn Res Ctr Cultural Heritage D, Xian, Peoples R China
关键词
hole completion; Terracotta Warriors; neural network; point cloud; cultural relic restoration; CULTURAL-HERITAGE; POINT; SHAPE;
D O I
10.1117/1.JRS.15.046503
中图分类号
X [环境科学、安全科学];
学科分类号
08 ; 0830 ;
摘要
As one of the eight wonders in the world, the virtual restoration of Terracotta Warriors is of great significance to archaeology. However, some parts of fragments were corroded for thousands of years, resulting in the existence of several holes in most of the restored cultural heritage artifacts. Based on the structural and textural information, we present a framework for filling the hole. First, a method based on the Poisson equation was employed to fill the hole on the triangular mesh model. Then, to complete the surface color and texture information of the three-dimension (3D) model, make the hole patch, and the original model surface texture natural transition, the 3D problem is converted into two-dimension (2D) image inpaint problem, and a refined network is added into EdgeConnect to generate a higher resolution result. A set of experiments is performed to evaluate the performance of our proposed framework. We hope the proposed framework can provide a useful tool to guide the virtual restoration of other cultural heritage artifacts. (C) 2021 Society of Photo-Optical Instrumentation Engineers (SPIE)
引用
收藏
页数:18
相关论文
共 55 条
  • [1] Achlioptas Panos, 2018, INT C MACH LEARN ICM, P40
  • [2] PatchMatch Stereo - Stereo Matching with Slanted Support Windows
    Bleyer, Michael
    Rhemann, Christoph
    Rother, Carsten
    [J]. PROCEEDINGS OF THE BRITISH MACHINE VISION CONFERENCE 2011, 2011,
  • [3] Data-Driven Suggestions for Creativity Support in 3D Modeling
    Chaudhuri, Siddhartha
    Koltun, Vladlen
    [J]. ACM TRANSACTIONS ON GRAPHICS, 2010, 29 (06):
  • [4] Chen X., 2019, ARXIV00069
  • [5] Shape Completion using 3D-Encoder-Predictor CNNs and Shape Synthesis
    Dai, Angela
    Qi, Charles Ruizhongtai
    Niessner, Matthias
    [J]. 30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, : 6545 - 6554
  • [6] Dellepiane M., 2011, Digital Imaging for Cultural Heritage, P39
  • [7] Dinesh C, 2017, 2017 IEEE VISUAL COMMUNICATIONS AND IMAGE PROCESSING (VCIP)
  • [8] Adaptive Nonrigid Inpainting of Three-Dimensional Point Cloud Geometry
    Dinesh, Chinthaka
    Bajic, Ivan, V
    Cheung, Gene
    [J]. IEEE SIGNAL PROCESSING LETTERS, 2018, 25 (06) : 878 - 882
  • [9] A Field Model for Repairing 3D Shapes
    Duc Thanh Nguyen
    Hua, Binh-Son
    Minh-Khoi Tran
    Quang-Hieu Pham
    Yeung, Sai-Kit
    [J]. 2016 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2016, : 5676 - 5684
  • [10] Filling holes with geometric and volumetric constraints
    Fortes, M. A.
    Gonzalez, P.
    Palomares, A.
    Pasadas, M.
    [J]. COMPUTERS & MATHEMATICS WITH APPLICATIONS, 2017, 74 (04) : 671 - 683