Topological and geometrical joint learning for 3D graph data

被引:0
|
作者
Han, Li [1 ]
Lan, Pengyan [1 ]
Shi, Xue [1 ]
Wang, Xiaomin [1 ]
He, Jinhai [1 ]
Li, Genyu [1 ]
机构
[1] Liaoning Normal Univ, Sch Comp & Informat Technol, Dalian, Peoples R China
关键词
3D shape analysis; Deep learning; Graph convolution network; Graph-based leaarning;
D O I
10.1007/s11042-022-13806-y
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Traditional convolutional neural networks (CNNs) are limited to be directly applied to 3D graph data due to their inherent grid structure. And most of graph-based learning methods use local-to-global hierarchical structure learning, and often ignore the global context. To overcome these issues, we propose two strategies: one is topological learning with 3D offset convolution, which provides learnable parameters in local graph construction, effectively expands the sampling space and improves the perception ability of diverse local structures. The other is geometrical learning with an adaptive spec-graph convolution network (AsGCN), which establishes a joint learning mechanism of local geometry in spatial domain and global structure in feature domain, and generates informative deep features through spectral filtering and weighting. Extensive experiments demonstrate that our deep features have strong discerning ability and robustness to non-rigid transformed graph data, incomplete mesh data, and better performance can be obtained compared to state-of-the-art methods.
引用
收藏
页码:15457 / 15474
页数:18
相关论文
共 50 条
  • [31] Learning Generative Models of 3D Structures
    Chaudhuri, Siddhartha
    Ritchie, Daniel
    Wu, Jiajun
    Xu, Kai
    Zhang, Hao
    COMPUTER GRAPHICS FORUM, 2020, 39 (02) : 643 - 666
  • [32] Towards Learning 3d Object Detection and 6d Pose Estimation from Synthetic Data
    Rudorfer, Martin
    Neumann, Lukas
    Krueger, Joerg
    2019 24TH IEEE INTERNATIONAL CONFERENCE ON EMERGING TECHNOLOGIES AND FACTORY AUTOMATION (ETFA), 2019, : 1540 - 1543
  • [33] Using deep learning to retrieve 3D geometrical characteristics of a particle field from 2D projected images: Application to multiphase flows
    Dia, Kassem
    Lamadie, Fabrice
    Debayle, Johan
    2022 12TH INTERNATIONAL CONFERENCE ON PATTERN RECOGNITION SYSTEMS (ICPRS), 2022,
  • [34] 2.75D: Boosting learning by representing 3D Medical imaging to 2D features for small data
    Wang, Xin
    Su, Ruisheng
    Xie, Weiyi
    Wang, Wenjin
    Xu, Yi
    Mann, Ritse
    Han, Jungong
    Tan, Tao
    BIOMEDICAL SIGNAL PROCESSING AND CONTROL, 2023, 84
  • [35] Recent Advances and Perspectives in Deep Learning Techniques for 3D Point Cloud Data Processing
    Ding, Zifeng
    Sun, Yuxuan
    Xu, Sijin
    Pan, Yan
    Peng, Yanhong
    Mao, Zebing
    ROBOTICS, 2023, 12 (04)
  • [36] 3D object recognition using deep learning for automatically generating semantic BIM data
    Rogage, Kay
    Doukari, Omar
    AUTOMATION IN CONSTRUCTION, 2024, 162
  • [37] Role of Simulated Lidar Data for Training 3D Deep Learning Models: An Exhaustive Analysis
    Lohani, Bharat
    Khan, Parvej
    Kumar, Vaibhav
    Gupta, Siddhartha
    JOURNAL OF THE INDIAN SOCIETY OF REMOTE SENSING, 2024, 52 (09) : 2003 - 2019
  • [38] UAV-aided Joint Radio Map and 3D Environment Reconstruction using Deep Learning Approaches
    Zeng, Pengxi
    Chen, Junting
    IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS (ICC 2022), 2022, : 5341 - 5346
  • [39] A Real-Time Online Learning Framework for Joint 3D Reconstruction and Semantic Segmentation of Indoor Scenes
    Menini, Davide
    Kumar, Suryansh
    Oswald, Martin R.
    Sandstrom, Erik
    Sminchisescu, Cristian
    Van Gool, Luc
    IEEE ROBOTICS AND AUTOMATION LETTERS, 2022, 7 (02) : 1332 - 1339
  • [40] Automated Concrete Pavement Slab Joint Detection Using Deep Learning and 3D Pavement Surface Images
    Hsieh, Yung-An
    Clark, Scott
    Yang, Zhongyu
    Tsai, Yichang James
    INTERNATIONAL JOURNAL OF PAVEMENT RESEARCH AND TECHNOLOGY, 2024, 17 (05) : 1112 - 1123