3D shape knowledge graph for cross-domain 3D shape retrieval

被引:0
|
作者
Chang, Rihao [1 ]
Ma, Yongtao [1 ]
Hao, Tong [2 ,5 ]
Wang, Weijie [3 ]
Nie, Weizhi [4 ,6 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin, Peoples R China
[2] Tianjin Normal Univ, Sch Life Sci, Tianjin, Peoples R China
[3] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
[4] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[5] Tianjin Normal Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[6] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D; multimedia; CONVOLUTIONAL NEURAL-NETWORKS; MODEL RETRIEVAL; OBJECT CATEGORIZATION;
D O I
10.1049/cit2.12326
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The surge in 3D modelling has led to a pronounced research emphasis on the field of 3D shape retrieval. Numerous contemporary approaches have been put forth to tackle this intricate challenge. Nevertheless, effectively addressing the intricacies of cross-modal 3D shape retrieval remains a formidable undertaking, owing to inherent modality-based disparities. The authors present an innovative notion-termed "geometric words"-which functions as elemental constituents for representing entities through combinations. To establish the knowledge graph, the authors employ geometric words as nodes, connecting them via shape categories and geometry attributes. Subsequently, a unique graph embedding method for knowledge acquisition is devised. Finally, an effective similarity measure is introduced for retrieval purposes. Importantly, each 3D or 2D entity can anchor its geometric terms within the knowledge graph, thereby serving as a link between cross-domain data. As a result, the authors' approach facilitates multiple cross-domain 3D shape retrieval tasks. The authors evaluate the proposed method's performance on the ModelNet40 and ShapeNetCore55 datasets, encompassing scenarios related to 3D shape retrieval and cross-domain retrieval. Furthermore, the authors employ the established cross-modal dataset (MI3DOR) to assess cross-modal 3D shape retrieval. The resulting experimental outcomes, in conjunction with comparisons against state-of-the-art techniques, clearly highlight the superiority of our approach.
引用
收藏
页码:1199 / 1216
页数:18
相关论文
共 50 条
  • [1] Universal unsupervised cross-domain 3D shape retrieval
    Zhou, Heyu
    Wang, Fan
    Liu, Qipei
    Li, Jiayu
    Liu, Wen
    Li, Xuanya
    Liu, An-An
    MULTIMEDIA SYSTEMS, 2024, 30 (01)
  • [2] Universal unsupervised cross-domain 3D shape retrieval
    Heyu Zhou
    Fan Wang
    Qipei Liu
    Jiayu Li
    Wen Liu
    Xuanya Li
    An-An Liu
    Multimedia Systems, 2024, 30
  • [3] 3D Model Retrieval Based on a 3D Shape Knowledge Graph
    Nie, Weizhi
    Wang, Ya
    Song, Dan
    Li, Wenhui
    IEEE ACCESS, 2020, 8 : 142632 - 142641
  • [4] 3D Model Retrieval Based on a 3D Shape Knowledge Graph
    Nie, Weizhi
    Wang, Ya
    Song, Dan
    Li, Wenhui
    IEEE Access, 2020, 8 : 142632 - 142641
  • [5] Learning Cross-Domain Neural Networks for Sketch-Based 3D Shape Retrieval
    Zhu, Fan
    Xie, Jin
    Fang, Yi
    THIRTIETH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, 2016, : 3683 - 3689
  • [6] Cross-Domain Image-Based 3D Shape Retrieval by View Sequence Learning
    Lee, Tang
    Lin, Yen-Liang
    Chiang, HungYueh
    Chiu, Ming-Wei
    Hsu, Winston H.
    Huang, Polly
    2018 INTERNATIONAL CONFERENCE ON 3D VISION (3DV), 2018, : 258 - 266
  • [7] Manifold Adversarial Learning for Cross-domain 3D Shape Representation
    Huang, Hao
    Chen, Cheng
    Fang, Yi
    COMPUTER VISION, ECCV 2022, PT XXVI, 2022, 13686 : 272 - 289
  • [8] Universal Cross-Domain 3D Model Retrieval
    Song, Dan
    Li, Tian-Bao
    Li, Wen-Hui
    Nie, Wei-Zhi
    Liu, Wu
    Liu, An-An
    IEEE TRANSACTIONS ON MULTIMEDIA, 2021, 23 : 2721 - 2731
  • [9] 3D GAUSSIAN DESCRIPTOR FOR 3D SHAPE RETRIEVAL
    Chaouch, Mohamed
    Verroust-Blondet, Anne
    ICME: 2009 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, VOLS 1-3, 2009, : 834 - 837
  • [10] CLN: Cross-Domain Learning Network for 2D Image-Based 3D Shape Retrieval
    Nie, Weizhi
    Zhao, Yue
    Nie, Jie
    Liu, An-An
    Zhao, Sicheng
    IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2022, 32 (03) : 992 - 1005