View graph construction for scenes with duplicate structures via graph convolutional network

被引:2
|
作者
Peng, Yang [1 ]
Yan, Shen [1 ]
Liu, Yuxiang [1 ]
Liu, Yu [1 ]
Zhang, Maojun [1 ]
机构
[1] Natl Univ Def Technol, Changsha, Hunan, Peoples R China
关键词
graph convolutional network; image embedding; metric learing; view graph construction; STRUCTURE-FROM-MOTION; IMAGE RETRIEVAL; FEATURES;
D O I
10.1049/cvi2.12095
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
View graph construction aims to effectively organise disordered image dataset through image retrieval technique before structure from motion (SfM). Existing view graph construction methods usually fail to handle scenes with duplicate structure, because these methods solely treat the construction of view graph as a process of image-pair-wise matching and lack in exploiting images' topological details in dataset. In this paper, we handle this problem from a novel perspective to construct view graph in a global paradigm by introducing an end-to-end graph convolutional network (GCN). First, a location-aware embedding module is introduced to encode images into a feature space that takes into account the feature's location by using Vision Transformer architecture, improving the distinction between features of duplicate structure. Second, graph convolutional network that consists of topological relationship preserving module and feature metric learning module is proposed. Topological relationship preserving network is proposed to help nodes maintain their connected neighbourhood features. By merging the topological connected information into images' embedding, our method can process image matching in a global mode, thus improving the disambiguation ability for images with duplicate scenes. Then a feature metric learning network is embedded into GCN to dynamically compute the linkage prediction among nodes based on their features. Finally, our method combines these three parts to jointly optimise nodes' features and linkage prediction in an end-to-end paradigm. We make qualitative and quantitative comparisons based on three public benchmark datasets and demonstrate that our proposed method performs favourably against other state-of-the-art methods.
引用
收藏
页码:389 / 402
页数:14
相关论文
共 50 条
  • [1] Incomplete Graph Learning via Partial Graph Convolutional Network
    Zhang Z.
    Jiang B.
    Tang J.
    Tang J.
    Luo B.
    IEEE Transactions on Artificial Intelligence, 2024, 5 (09): : 1 - 7
  • [2] Power up! Robust Graph Convolutional Network via Graph Powering
    Jin, Ming
    Chang, Heng
    Zhu, Wenwu
    Sojoudi, Somayeh
    THIRTY-FIFTH AAAI CONFERENCE ON ARTIFICIAL INTELLIGENCE, THIRTY-THIRD CONFERENCE ON INNOVATIVE APPLICATIONS OF ARTIFICIAL INTELLIGENCE AND THE ELEVENTH SYMPOSIUM ON EDUCATIONAL ADVANCES IN ARTIFICIAL INTELLIGENCE, 2021, 35 : 8004 - 8012
  • [3] Application of Graph Convolutional Network in the Construction of Knowledge Graph for Higher Mathematics Teaching
    Yuan, Ruixue
    Li, Hongming
    Sun, Zhenyu
    Zhang, Huiwen
    SENSORS AND MATERIALS, 2023, 35 (12) : 4269 - 4290
  • [4] Modeling multiple latent information graph structures via graph convolutional network for aspect-based sentiment analysis
    Wang, Jiajun
    Li, Xiaoge
    An, Xiaochun
    COMPLEX & INTELLIGENT SYSTEMS, 2023, 9 (04) : 4003 - 4014
  • [5] Modeling multiple latent information graph structures via graph convolutional network for aspect-based sentiment analysis
    Jiajun Wang
    Xiaoge Li
    Xiaochun An
    Complex & Intelligent Systems, 2023, 9 : 4003 - 4014
  • [6] Graph Wavelet Convolutional Network with Graph Clustering
    Inatsuki, Hiroki
    Uto, Toshiyuki
    2022 37TH INTERNATIONAL TECHNICAL CONFERENCE ON CIRCUITS/SYSTEMS, COMPUTERS AND COMMUNICATIONS (ITC-CSCC 2022), 2022, : 165 - 168
  • [7] Robust graph learning with graph convolutional network
    Wan, Yingying
    Yuan, Changan
    Zhan, Mengmeng
    Chen, Long
    INFORMATION PROCESSING & MANAGEMENT, 2022, 59 (03)
  • [8] Multi-View Graph Convolutional Network for Multimedia Recommendation
    Yu, Penghang
    Tan, Zhiyi
    Lu, Guanming
    Bao, Bing-Kun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 6576 - 6585
  • [9] Hazy Removal via Graph Convolutional with Attention Network
    Hu, Bin
    Yue, Zhuangzhuang
    Gu, Mingcen
    Zhang, Yan
    Xu, Zhen
    Li, Jinhang
    JOURNAL OF SIGNAL PROCESSING SYSTEMS FOR SIGNAL IMAGE AND VIDEO TECHNOLOGY, 2023, 95 (04): : 517 - 527
  • [10] Hazy Removal via Graph Convolutional with Attention Network
    Bin Hu
    Zhuangzhuang Yue
    Mingcen Gu
    Yan Zhang
    Zhen Xu
    Jinhang Li
    Journal of Signal Processing Systems, 2023, 95 : 517 - 527