NeRF FOR HERITAGE 3D RECONSTRUCTION

被引:24
作者
Mazzacca, G. [1 ,2 ]
Karami, A. [1 ]
Rigon, S. [1 ]
Farella, E. M. [1 ]
Trybala, P. [1 ]
Remondino, F. [1 ]
机构
[1] Bruno Kessler Fdn FBK, 3D Opt Metrol 3DOM Unit, Trento, Italy
[2] Univ Udine, Dept Math Comp Sci & Phys, Udine, Italy
来源
29TH CIPA SYMPOSIUM DOCUMENTING, UNDERSTANDING, PRESERVING CULTURAL HERITAGE. HUMANITIES AND DIGITAL TECHNOLOGIES FOR SHAPING THE FUTURE, VOL. 48-M-2 | 2023年
关键词
Neural Radiance Field; Heritage; 3D; Photogrammetry; AI;
D O I
10.5194/isprs-archives-XLVIII-M-2-2023-1051-2023
中图分类号
K85 [文物考古];
学科分类号
0601 ;
摘要
Conventional or learning-based 3D reconstruction methods from images have clearly shown their potential for 3D heritage documentation. Nevertheless, Neural Radiance Field (NeRF) approaches are recently revolutionising the way a scene can be rendered or reconstructed in 3D from a set of oriented images. Therefore the paper wants to review some of the last NeRF methods applied to various cultural heritage datasets collected with smartphone videos, touristic approaches or reflex cameras. Firstly several NeRF methods are evaluated. It turned out that Instant-NGP and Nerfacto methods achieved the best outcomes, outperforming all other methods significantly. Successively qualitative and quantitative analyses are performed on various datasets, revealing the good performances of NeRF methods, in particular for areas with uniform texture or shining surfaces, as well as for small datasets of lost artefacts. This is for sure opening new frontiers for 3D documentation, visualization and communication purposes of digital heritage. [GRAPHICS] .
引用
收藏
页码:1051 / 1058
页数:8
相关论文
共 50 条
[41]   Comparative Assessment of Neural Radiance Fields and Photogrammetry in Digital Heritage: Impact of Varying Image Conditions on 3D Reconstruction [J].
Croce, Valeria ;
Billi, Dario ;
Caroti, Gabriella ;
Piemonte, Andrea ;
De Luca, Livio ;
Veron, Philippe .
REMOTE SENSING, 2024, 16 (02)
[42]   An Experimental HBIM Processing: Innovative Tool for 3D Model Reconstruction of Morpho-Typological Phases for the Cultural Heritage [J].
Barrile, Vincenzo ;
Bernardo, Ernesto ;
Bilotta, Giuliana .
REMOTE SENSING, 2022, 14 (05)
[43]   A mixed methodology for detailed 3D modeling of architectural heritage [J].
Arce, D. ;
Retamozo, S. ;
Aguilar, R. ;
Castaneda, B. .
STRUCTURAL ANALYSIS OF HISTORICAL CONSTRUCTIONS: ANAMNESIS, DIAGNOSIS, THERAPY, CONTROLS, 2016, :104-111
[44]   Initial data preparation for 3D modelling of heritage building [J].
Pavlovskis, Miroslavas ;
Migilinskas, Darius ;
Kutut, Vladislavas ;
Antucheviciene, Jurgita .
13TH INTERNATIONAL CONFERENCE MODERN BUILDING MATERIALS, STRUCTURES AND TECHNIQUES (MBMST 2019), 2019, :649-656
[45]   Web Spherical Panorama for Cultural Heritage 3D Modeling [J].
Paris, Leonardo ;
Calvano, Michele ;
Nardinocchi, Carla .
NEW ACTIVITIES FOR CULTURAL HERITAGE, HERITAGEBOT 2017, 2017, :182-189
[46]   An Application of Integrated 3D Technologies for Replicas in Cultural Heritage [J].
Balletti, Caterina ;
Ballarin, Martina .
ISPRS INTERNATIONAL JOURNAL OF GEO-INFORMATION, 2019, 8 (06)
[47]   3D MODELING OF THE CULTURAL HERITAGE: BETWEEN OPPORTUNITY AND NECESSITY [J].
Herman, G., V ;
Caciora, T. ;
Ilies, Dorina Camelia ;
Ilies, A. ;
Deac, Anca ;
Sturza, Amalia ;
Sonko, S. M. ;
Suba, N. S. ;
Nistor, S. .
JOURNAL OF APPLIED ENGINEERING SCIENCES, 2020, 10 (01) :27-30
[48]   Combining 3D technologies for cultural heritage interpretation and entertainment [J].
Beraldin, JA ;
Picard, M ;
El-Hakim, SF ;
Godin, G ;
Valzano, V ;
Bandiera, A .
VIDEOMETRICS VIII, 2005, 5665 :108-118
[49]   3D GAMING FOR YOUNG GENERATIONS IN HERITAGE PROTECTION: A REVIEW [J].
Ishar, S. I. ;
Zlatanova, S. ;
Roberts, J. L. .
17TH 3D GEOINFO CONFERENCE, 2022, 48-4 (W4) :53-60
[50]   SCIENTIFIC RIGOUR OF ONLINE PLATFORMS FOR 3D VISUALISATION OF HERITAGE [J].
Statham, Nataska .
VIRTUAL ARCHAEOLOGY REVIEW, 2019, 10 (20) :1-16