GeoBi-GNN: Geometry-aware Bi-domain Mesh Denoising via Graph Neural Networks

被引:17
作者
Zhang, Yingkui [1 ]
Shen, Guibao [1 ]
Wang, Qiong [2 ]
Qian, Yinling [2 ]
Wei, Mingqiang [3 ]
Qin, Jing [4 ]
机构
[1] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Hong Kong Macao Joint Lab Human Machine, Shenzhen, Peoples R China
[2] Chinese Acad Sci, Shenzhen Inst Adv Technol, Guangdong Prov Key Lab Comp Vis & Virtual Real Te, Shenzhen, Peoples R China
[3] Nanjing Univ Aeronaut & Astronaut, Sch Comp Sci & Technol, Nanjing, Peoples R China
[4] Polytech Univ Hong Kong, Sch Nursing, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
GeoBi-GNN; Mesh denoising; Bi-domain; Graph neural network; Geometric deep learning;
D O I
10.1016/j.cad.2021.103154
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Mesh denoising is an essential geometric processing step for raw meshes generated by 3D scanners and depth cameras. It is intended to remove noise while preserving surface intrinsic features of the underlying model. Existing mesh denoising wisdoms of (1) updating mesh vertices directly (referred to as one-step mesh denoising in the spatial domain) or (2) normal filtering followed by vertex updating (referred to as two-step mesh denoising in the normal domain) seldom consider the correlation between vertex updating and normal filtering. This paper proposes a novel end-to-end geometry-aware dual-graph neural network, called GeoBi-GNN, to perform denoising in spatial and normal domains simultaneously. For the first time, we optimize both positions and normals (i.e., dual domains) in a unified framework of GNN, and show the powerful inter-coordination between the dual domains. GeoBi-GNN fully excavates the native dual-graph structure in the mesh, and creates two graph structures for the spatial noise and the normal noise respectively through the adjacency relationship between vertices and surfaces. We design each GNN as a three-layer U-Net architecture to gradually extract multi-scale features from the input graphs. In addition, a specific graph pooling layer with a cascaded weight estimation strategy is designed to improve the robustness and denoising effect. Due to the intuitive relation between the mesh connectivity and the dual graphs, the proposed method is simple to implement. Comprehensive experiments exhibit that the proposed method is significantly superior to the state-of-the-arts of mesh denoising, especially for the large-scale noise and the complex real scans. Our code is available at https://github.com/zhangyk18/GeoBi-GNN. (c) 2021 Elsevier Ltd. All rights reserved.
引用
收藏
页数:11
相关论文
共 49 条
[1]  
Armando M, 2020, IEEE T VIS COMPUT GR
[2]  
Boscaini D, 2016, ADV NEUR IN, V29
[3]  
Botsch M., 2002, OPENMESH GENERIC EFF
[4]   Shape Structuralizer: Design, Fabrication, and User-driven Iterative Refinement of 3D Mesh Models [J].
Chidambaram, Subramanian ;
Zhang, Yunbo ;
Sundararajan, Venkatraghavan ;
Elmqvist, Niklas ;
Ramani, Karthik .
CHI 2019: PROCEEDINGS OF THE 2019 CHI CONFERENCE ON HUMAN FACTORS IN COMPUTING SYSTEMS, 2019,
[5]   Reactive Mesh Simplification for Augmented Reality Head Mounted Displays [J].
Choi, Jaewon ;
Park, Hyeonjung ;
Paek, Jeongyeup ;
Ko, JeongGil .
MOBISYS'18: PROCEEDINGS OF THE 16TH ACM INTERNATIONAL CONFERENCE ON MOBILE SYSTEMS, APPLICATIONS, AND SERVICES, 2018, :527-527
[6]  
Defferrard M, 2016, ADV NEUR IN, V29
[7]  
Dhillon IS, 2007, IEEE T PATTERN ANAL, V29, P1944, DOI [10.1109/TPAMI.2007.1115, 10.1109/TP'AMI.2007.1115]
[8]   Robust Feature-Preserving Mesh Denoising Based on Consistent Subneighborhoods [J].
Fan, Hanqi ;
Yu, Yizhou ;
Peng, Qunsheng .
IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS, 2010, 16 (02) :312-324
[9]   A Point Set Generation Network for 3D Object Reconstruction from a Single Image [J].
Fan, Haoqiang ;
Su, Hao ;
Guibas, Leonidas .
30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017), 2017, :2463-2471
[10]  
Fanelli Gabriele, 2011, Pattern Recognition. Proceedings 33rd DAGM Symposium, P101, DOI 10.1007/978-3-642-23123-0_11