3D shape knowledge graph for cross-domain 3D shape retrieval

被引:0
|
作者
Chang, Rihao [1 ]
Ma, Yongtao [1 ]
Hao, Tong [2 ,5 ]
Wang, Weijie [3 ]
Nie, Weizhi [4 ,6 ]
机构
[1] Tianjin Univ, Sch Microelect, Tianjin, Peoples R China
[2] Tianjin Normal Univ, Sch Life Sci, Tianjin, Peoples R China
[3] Univ Trento, Dept Informat Engn & Comp Sci, Trento, Italy
[4] Tianjin Univ, Sch Elect & Informat Engn, Tianjin, Peoples R China
[5] Tianjin Normal Univ, Sch Life Sci, Tianjin 300387, Peoples R China
[6] Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
3-D; multimedia; CONVOLUTIONAL NEURAL-NETWORKS; MODEL RETRIEVAL; OBJECT CATEGORIZATION;
D O I
10.1049/cit2.12326
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The surge in 3D modelling has led to a pronounced research emphasis on the field of 3D shape retrieval. Numerous contemporary approaches have been put forth to tackle this intricate challenge. Nevertheless, effectively addressing the intricacies of cross-modal 3D shape retrieval remains a formidable undertaking, owing to inherent modality-based disparities. The authors present an innovative notion-termed "geometric words"-which functions as elemental constituents for representing entities through combinations. To establish the knowledge graph, the authors employ geometric words as nodes, connecting them via shape categories and geometry attributes. Subsequently, a unique graph embedding method for knowledge acquisition is devised. Finally, an effective similarity measure is introduced for retrieval purposes. Importantly, each 3D or 2D entity can anchor its geometric terms within the knowledge graph, thereby serving as a link between cross-domain data. As a result, the authors' approach facilitates multiple cross-domain 3D shape retrieval tasks. The authors evaluate the proposed method's performance on the ModelNet40 and ShapeNetCore55 datasets, encompassing scenarios related to 3D shape retrieval and cross-domain retrieval. Furthermore, the authors employ the established cross-modal dataset (MI3DOR) to assess cross-modal 3D shape retrieval. The resulting experimental outcomes, in conjunction with comparisons against state-of-the-art techniques, clearly highlight the superiority of our approach.
引用
收藏
页码:1199 / 1216
页数:18
相关论文
共 50 条
  • [41] Shape-based 3D model retrieval
    Song, JJ
    Golshani, F
    15TH IEEE INTERNATIONAL CONFERENCE ON TOOLS WITH ARTIFICIAL INTELLIGENCE, PROCEEDINGS, 2003, : 636 - 640
  • [42] Covariance Descriptors for 3D Shape Matching and Retrieval
    Tabia, Hedi
    Laga, Hamid
    Picard, David
    Gosselin, Philippe-Henri
    2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, : 4185 - 4192
  • [43] A Bag of Features Approach for 3D Shape Retrieval
    Fehr, Janis
    Streicher, Alexander
    Burkhardt, Hans
    ADVANCES IN VISUAL COMPUTING, PT 1, PROCEEDINGS, 2009, 5875 : 34 - +
  • [44] 3D shape retrieval using the filtering method
    Lu, Yingliang
    Kaneko, Kunihiko
    Makinouchi, Akifumi
    IMECS 2007: INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS, VOLS I AND II, 2007, : 365 - +
  • [45] A comparison of methods for 3D scene shape retrieval
    Yuan, Juefei
    Abdul-Rashid, Hameed
    Li, Bo
    Lu, Yijuan
    Schreck, Tobias
    Bai, Song
    Bai, Xiang
    Ngoc-Minh Bui
    Do, Minh N.
    Trong-Le Do
    Anh-Duc Duong
    He, Kai
    He, Xinwei
    Holenderski, Mike
    Jarnikov, Dmitri
    Tu-Khiem Le
    Li, Wenhui
    Liu, Anan
    Liu, Xiaolong
    Menkovski, Vlado
    Khac-Tuan Nguyen
    Thanh-An Nguyen
    Vinh-Tiep Nguyen
    Nie, Weizhi
    Van-Tu Ninh
    Rey, Perez
    Su, Yuting
    Vinh Ton-That
    Tran, Minh-Triet
    Wang, Tianyang
    Xiang, Shu
    Zhe, Shandian
    Zhou, Heyu
    Zhou, Yang
    Zhou, Zhichao
    COMPUTER VISION AND IMAGE UNDERSTANDING, 2020, 201
  • [46] A New Shape Benchmark for 3D Object Retrieval
    Fang, Rui
    Godil, Afzal
    Li, Xiaolan
    Wagan, Asim
    ADVANCES IN VISUAL COMPUTING, PT I, PROCEEDINGS, 2008, 5358 : 381 - 392
  • [47] Joint Learning of 3D Shape Retrieval and Deformation
    Uy, Mikaela Angelina
    Kim, Vladimir G.
    Sung, Minhyuk
    Aigerman, Noam
    Chaudhuri, Siddhartha
    Guibas, Leonidas
    2021 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, CVPR 2021, 2021, : 11708 - 11717
  • [48] GIFT: Towards Scalable 3D Shape Retrieval
    Bai, Song
    Bai, Xiang
    Zhou, Zhichao
    Zhang, Zhaoxiang
    Tian, Qi
    Latecki, Longin Jan
    IEEE TRANSACTIONS ON MULTIMEDIA, 2017, 19 (06) : 1257 - 1271
  • [49] Shape retrieval using 3D Zernike descriptors
    Novotni, M
    Klein, R
    COMPUTER-AIDED DESIGN, 2004, 36 (11) : 1047 - 1062
  • [50] Neural shape codes for 3D model retrieval
    Bai, Song
    Bai, Xiang
    Liu, Wenyu
    Roli, Fabio
    PATTERN RECOGNITION LETTERS, 2015, 65 : 15 - 21