Hyperbolic prototype rectification for few-shot 3D point cloud classification

被引:0
作者
Feng, Yuan-Zhi [1 ]
Lin, Shing-Ho J. [2 ]
Tang, Xuan [3 ]
Wang, Mu-Yu [1 ]
Zheng, Jian-Zhang [2 ]
He, Zi-Yao [1 ]
Pang, Zi-Yi [1 ]
Yang, Jian [4 ]
Chen, Ming-Song [1 ]
Wei, Xian [1 ]
机构
[1] East China Normal Univ, Software Engn Inst, Shanghai 200062, Peoples R China
[2] Univ Chinese Acad Sci, Beijing 100049, Peoples R China
[3] East China Normal Univ, Sch Commun & Elect Engn, Shanghai 200062, Peoples R China
[4] Informat Engn Univ, Sch Geospatial Informat, Zhengzhou 450052, Henan, Peoples R China
基金
北京市自然科学基金;
关键词
Hyperbolic geometry; Few-shot learning; Point cloud classification; Prototype rectification; Feature enhancement;
D O I
10.1016/j.patcog.2024.111042
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Few-shot point cloud classification is a challenging task in 3D computer vision and has received widespread attention from researchers. Most of the works on deep learning models rely heavily on Euclidean spatial metrics. However, point cloud objects often have complex non-Euclidean geometric structures, with underlying inter/intra-class hierarchical structures, which are difficult to capture by current Euclidean-based deep learning models. Moreover, due to the lack of training samples, many few-shot learning methods often suffer from the overfitting problem. Given the Hyperbolic metric of non-Euclidean geometry offering hierarchical structural prior, as we assume to be able to assist FSL task, we propose Hyperbolic Prototype Rectification (HPR) HPR ) for few- shot point cloud classification, without requiring extra learnable parameter. Firstly, point clouds are embedded into hyperbolic space to better describe hierarchical similarity relationships in data. Secondly, the HPR utilizes hyperbolic spatial and distributional information to enhance the feature representation and improve the generalization capability, with more appropriate hyperbolic prototypes. The few-shot classification experiments and further ablation studies conducted on widely used point cloud datasets demonstrate the effectiveness of our method. On the real-world ScanObjectNN(-PB) datasets, the average classification accuracy outperforms the SOTA method by 2.08%(0.66%), respectively, indicating that the proposed HPR has great generalization capability and strong robustness against perturbed data. Our code is available at: https://github.com/JonathanUCAS/HPR.
引用
收藏
页数:12
相关论文
共 44 条
  • [1] Bai Qijie, 2023, WWW '23: Proceedings of the ACM Web Conference 2023, P523, DOI 10.1145/3543507.3583455
  • [2] ViewNet: A Novel Projection-Based Backbone with View Pooling for Few-shot Point Cloud Classification
    Chen, Jiajing
    Yang, Minmin
    Velipasalar, Senem
    [J]. 2023 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2023, : 17652 - 17660
  • [3] Goyal A, 2021, PR MACH LEARN RES, V139
  • [4] PCT: Point cloud transformer
    Guo, Meng-Hao
    Cai, Jun-Xiong
    Liu, Zheng-Ning
    Mu, Tai-Jiang
    Martin, Ralph R.
    Hu, Shi-Min
    [J]. COMPUTATIONAL VISUAL MEDIA, 2021, 7 (02) : 187 - 199
  • [5] Deep Learning for 3D Point Clouds: A Survey
    Guo, Yulan
    Wang, Hanyun
    Hu, Qingyong
    Liu, Hao
    Liu, Li
    Bennamoun, Mohammed
    [J]. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2021, 43 (12) : 4338 - 4364
  • [6] Jinlu Liu, 2020, Computer Vision - ECCV 2020. 16th European Conference. Proceedings. Lecture Notes in Computer Science (LNCS 12346), P741, DOI 10.1007/978-3-030-58452-8_43
  • [7] Hyperbolic Image Embeddings
    Khrulkov, Valentin
    Mirvakhabova, Leyla
    Ustinova, Evgeniya
    Oseledets, Ivan
    Lempitsky, Victor
    [J]. 2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2020, : 6417 - 6427
  • [8] Meta-Learning with Differentiable Convex Optimization
    Lee, Kwonjoon
    Maji, Subhransu
    Ravichandran, Avinash
    Soatto, Stefano
    [J]. 2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, : 10649 - 10657
  • [9] Dynamic Hyperbolic Attention Network for Fine Hand-object Reconstruction
    Leng, Zhiying
    Wu, Shun-Cheng
    Saleh, Mahdi
    Montanaro, Antonio
    Yu, Hao
    Wang, Yin
    Navab, Nassir
    Liang, Xiaohui
    Tombari, Federico
    [J]. 2023 IEEE/CVF INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV 2023), 2023, : 14848 - 14858
  • [10] Li Y., 2018, NeurIPS, V31