Topological and geometrical joint learning for 3D graph data

被引:0
|
作者
Han, Li [1 ]
Lan, Pengyan [1 ]
Shi, Xue [1 ]
Wang, Xiaomin [1 ]
He, Jinhai [1 ]
Li, Genyu [1 ]
机构
[1] Liaoning Normal Univ, Sch Comp & Informat Technol, Dalian, Peoples R China
关键词
3D shape analysis; Deep learning; Graph convolution network; Graph-based leaarning;
D O I
10.1007/s11042-022-13806-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional convolutional neural networks (CNNs) are limited to be directly applied to 3D graph data due to their inherent grid structure. And most of graph-based learning methods use local-to-global hierarchical structure learning, and often ignore the global context. To overcome these issues, we propose two strategies: one is topological learning with 3D offset convolution, which provides learnable parameters in local graph construction, effectively expands the sampling space and improves the perception ability of diverse local structures. The other is geometrical learning with an adaptive spec-graph convolution network (AsGCN), which establishes a joint learning mechanism of local geometry in spatial domain and global structure in feature domain, and generates informative deep features through spectral filtering and weighting. Extensive experiments demonstrate that our deep features have strong discerning ability and robustness to non-rigid transformed graph data, incomplete mesh data, and better performance can be obtained compared to state-of-the-art methods.
引用
收藏
页码:15457 / 15474
页数:18
相关论文
共 50 条
  • [21] 2.5D and 3D segmentation of brain metastases with deep learning on multinational MRI data
    Ottesen, Jon Andre
    Yi, Darvin
    Tong, Elizabeth
    Iv, Michael
    Latysheva, Anna
    Saxhaug, Cathrine
    Jacobsen, Kari Dolven
    Helland, Aslaug
    Emblem, Kyrre Eeg
    Rubin, Daniel L.
    Bjornerud, Atle
    Zaharchuk, Greg
    Grovik, Endre
    FRONTIERS IN NEUROINFORMATICS, 2023, 16
  • [22] Retinal OCT Layer Segmentation via Joint Motion Correction and Graph-Assisted 3D Neural Network
    Wang, Yiqian
    Galang, Carlo
    Freeman, William R.
    Warter, Alexandra
    Heinke, Anna
    Bartsch, Dirk-Uwe G.
    Nguyen, Truong Q.
    An, Cheolhong
    IEEE ACCESS, 2023, 11 : 103319 - 103332
  • [23] OBJECT CLASSIFICATION FROM 3D VOLUMETRIC DATA WITH 3D CAPSULE NETWORKS
    Kakillioglu, Burak
    Ahmad, Ayesha
    Velipasalar, Senem
    2018 IEEE GLOBAL CONFERENCE ON SIGNAL AND INFORMATION PROCESSING (GLOBALSIP 2018), 2018, : 385 - 389
  • [24] SIMULATING LIDAR TO CREATE TRAINING DATA FOR MACHINE LEARNING ON 3D POINT CLOUDS
    Hildebrand, J.
    Schulz, S.
    Richter, R.
    Doellner, J.
    17TH 3D GEOINFO CONFERENCE, 2022, 10-4 (W2): : 105 - 112
  • [25] 3D Mesh Deformation Using Graph Convolution Network
    Wang, Zijie
    Chang, Huiyou
    2019 IEEE 4TH INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATION SYSTEMS (ICCCS 2019), 2019, : 375 - 378
  • [26] Automated joint 3D reconstruction and visual inspection for buildings using computer vision and transfer learning
    Wang, Tao
    Gan, Vincent J. L.
    AUTOMATION IN CONSTRUCTION, 2023, 149
  • [27] Joint reconstruction and segmentation in undersampled 3D knee MRI combining shape knowledge and deep learning
    Kofler, A.
    Wald, C.
    Kolbitsch, C.
    Tycowicz, C., V
    Ambellan, F.
    PHYSICS IN MEDICINE AND BIOLOGY, 2024, 69 (09):
  • [28] Deep Volumetric Shape Learning for Semantic Segmentation of the Hip Joint from 3D MR Images
    Zeng, Guodong
    Zheng, Guoyan
    COMPUTATIONAL METHODS AND CLINICAL APPLICATIONS IN MUSCULOSKELETAL IMAGING, MSKI 2018, 2019, 11404 : 35 - 48
  • [29] DEEP LOGISMOS: DEEP LEARNING GRAPH-BASED 3D SEGMENTATION OF PANCREATIC TUMORS ON CT SCANS
    Guo, Zhihui
    Zhang, Ling
    Lu, Le
    Bagheri, Mohammadhadi
    Summers, Ronald M.
    Sonka, Milan
    Yao, Jianhua
    2018 IEEE 15TH INTERNATIONAL SYMPOSIUM ON BIOMEDICAL IMAGING (ISBI 2018), 2018, : 1230 - 1233
  • [30] Transcoding across 3D shape representations for unsupervised learning of 3D shape feature
    Furuya, Takahiko
    Ohbuchi, Ryutarou
    PATTERN RECOGNITION LETTERS, 2020, 138 (138) : 146 - 154