Multi-View Graph Matching for 3D Model Retrieval

被引:4
作者
Su, Yu-Ting [1 ]
Li, Wen-Hui [1 ]
Nie, Wei-Zhi [1 ]
Liu, An-An [1 ]
机构
[1] Tianjin Univ, 92 Weijin Rd, Tianjin 300072, Peoples R China
基金
中国国家自然科学基金;
关键词
3D model retrieval; graph matching; unsupervised learning; OBJECT RETRIEVAL; RECOGNITION; CLASSIFICATION; SEARCH;
D O I
10.1145/3387920
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
3D model retrieval has been widely utilized in numerous domains, such as computer-aided design, digital entertainment, and virtual reality. Recently, many graph-based methods have been proposed to address this task by using multi-viewinformation of 3D models. However, these methods are always constrained bymanyto-many graph matching for the similarity measure between pairwise models. In this article, we propose a multi-view graph matching method (MVGM) for 3D model retrieval. The proposed method can decompose the complicated multi-view graph-based similarity measure into multiple single-view graph-based similarity measures and fusion. First, we present the method for single-view graph generation, and we further propose the novel method for the similarity measure in a single-view graph by leveraging both node-wise context and model-wise context. Then, we propose multi-view fusion with diffusion, which can collaboratively integrate multiple single-view similarities w.r.t. different viewpoints and adaptively learn their weights, to compute the multi-view similarity between pairwise models. In this way, the proposed method can avoid the difficulty in the definition and computation of the traditional high-order graph. Moreover, this method is unsupervised and does not require a large-scale 3D dataset for model learning. We conduct evaluations on four popular and challenging datasets. The extensive experiments demonstrate the superiority and effectiveness of the proposed method compared against the state of the art. In particular, this unsupervised method can achieve competitive performances against the most recent supervised and deep learning method.
引用
收藏
页数:20
相关论文
共 50 条
[31]   Deep models for multi-view 3D object recognition: a review [J].
Alzahrani, Mona ;
Usman, Muhammad ;
Jarraya, Salma Kammoun ;
Anwar, Saeed ;
Helmy, Tarek .
ARTIFICIAL INTELLIGENCE REVIEW, 2024, 57 (12)
[32]   Multi-view 3D Entangled Forest For Semantic Segmentation and Mapping [J].
Antonello, Morris ;
Wolf, Daniel ;
Prankl, Johann ;
Ghidoni, Stefano ;
Menegatti, Emanuele ;
Vincze, Markus .
2018 IEEE INTERNATIONAL CONFERENCE ON ROBOTICS AND AUTOMATION (ICRA), 2018, :1855-1862
[33]   Learning Multi-View Representation With LSTM for 3-D Shape Recognition and Retrieval [J].
Ma, Chao ;
Guo, Yulan ;
Yang, Jungang ;
An, Wei .
IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (05) :1169-1182
[34]   Integrated Multi-view 3D Image Capture and Motion Parallax 3D Display System [J].
Lal, Madan ;
Baloch, Shadi Khan ;
Soomro, Shoaib Rehman .
EMITTER-INTERNATIONAL JOURNAL OF ENGINEERING TECHNOLOGY, 2022, 10 (01) :1-13
[35]   MHFP: Multi-view based hierarchical fusion pooling method for 3D shape recognition [J].
Liang, Qi ;
Li, Qiang ;
Zhang, Lihu ;
Mi, Haixiao ;
Nie, Weizhi ;
Li, Xuanya .
PATTERN RECOGNITION LETTERS, 2021, 150 :214-220
[36]   Structural Class Classification of 3D Protein Structure Based on Multi-View 2D Images [J].
Suryanto, Chendra Hadi ;
Saigo, Hiroto ;
Fukui, Kazuhiro .
IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, 2018, 15 (01) :286-299
[37]   View-Based 3-D Model Retrieval: A Benchmark [J].
Liu, An-An ;
Nie, Wei-Zhi ;
Gao, Yue ;
Su, Yu-Ting .
IEEE TRANSACTIONS ON CYBERNETICS, 2018, 48 (03) :916-928
[38]   3D object retrieval with graph-based collaborative feature learning [J].
Chen, Feng ;
Li, Bo ;
Li, Liang .
JOURNAL OF VISUAL COMMUNICATION AND IMAGE REPRESENTATION, 2019, 58 :261-268
[39]   Multi-view Adaptive Graph Convolutions for Graph Classification [J].
Adaloglou, Nikolas ;
Vretos, Nicholas ;
Daras, Petros .
COMPUTER VISION - ECCV 2020, PT XXVI, 2020, 12371 :398-414
[40]   3D model retrieval using Bag-of-View-Words [J].
Ding, Ke ;
Wang, Wei ;
Liu, Yunhui .
MULTIMEDIA TOOLS AND APPLICATIONS, 2014, 72 (03) :2701-2722