Effectively Filtering Images for Better Multi-modal Knowledge Graph

被引:0
作者
Peng, Huang [1 ]
Xu, Hao [1 ]
Tang, Jiuyang [1 ]
Wu, Jibing [1 ]
Huang, Hongbin [1 ]
机构
[1] Natl Univ Def Technol, Lab Big Data & Decis, Changsha 410000, Peoples R China
来源
WEB AND BIG DATA. APWEB-WAIM 2022 INTERNATIONAL WORKSHOPS, KGMA 2022, SEMIBDMA 2022, DEEPLUDA 2022 | 2023年 / 1784卷
关键词
Multi-modal knowledge graph; Clustering algorithm; Image-text matching; Entity alignment;
D O I
10.1007/978-981-99-1354-1_2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The existing multi-modal knowledge graph construction techniques have become mature for processing text modal data, but lack effective processing methods for other modal data such as visual modal data. Therefore, the focus of multi-modal knowledge graph construction lies in image and image and text fusion processing. At present, the construction of multi-modal knowledge graph often does not filter the image quality, and there are noises and similar repetitive images in the image set. To solve this problem, this paper studies the quality control and screening of images in the construction process of multi-modal knowledge graph, and proposes an image refining framework of multi-modal knowledge graph, which is divided into three modules. The final experiment proves that this framework can provide higher quality images for multi-modal knowledge graphs, and in the benchmark task of multi-modal entity alignment, the effect of entity alignment based on the multi-modal knowledge graphs constructed in this paper has been improved compared with previous models.
引用
收藏
页码:10 / 22
页数:13
相关论文
共 50 条
  • [41] MEAformer: Multi-modal Entity Alignment Transformer for Meta Modality Hybrid
    Chen, Zhuo
    Chen, Jiaoyan
    Zhang, Wen
    Guo, Lingbing
    Fang, Yin
    Huang, Yufeng
    Zhang, Yichi
    Geng, Yuxia
    Pan, Jeff Z.
    Song, Wenting
    Chen, Huajun
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3317 - 3327
  • [42] A Multi-Role Graph Attention Network for Knowledge Graph Alignment
    Ding, Linyi
    Yuan, Weijie
    Meng, Kui
    Liu, Gongshen
    2021 INTERNATIONAL JOINT CONFERENCE ON NEURAL NETWORKS (IJCNN), 2021,
  • [43] Rethinking Uncertainly Missing and Ambiguous Visual Modality in Multi-Modal Entity Alignment
    Chen, Zhuo
    Guo, Lingbing
    Fang, Yin
    Zhang, Yichi
    Chen, Jiaoyan
    Pan, Jeff Z.
    Li, Yangning
    Chen, Huajun
    Zhang, Wen
    SEMANTIC WEB, ISWC 2023, PART I, 2023, 14265 : 121 - 139
  • [44] Multi-Modal Memory Enhancement Attention Network for Image-Text Matching
    Ji, Zhong
    Lin, Zhigang
    Wang, Haoran
    He, Yuqing
    IEEE ACCESS, 2020, 8 : 38438 - 38447
  • [45] Adversarial Attentive Multi-Modal Embedding Learning for Image-Text Matching
    Wei, Kaimin
    Zhou, Zhibo
    IEEE ACCESS, 2020, 8 (08): : 96237 - 96248
  • [46] ADMH-ER: Adaptive Denoising Multi-Modal Hybrid for Entity Resolution
    Zhou, Qian
    Chen, Wei
    Zhang, Li
    Liu, An
    Fang, Junhua
    Zhao, Lei
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2025, 37 (03) : 1049 - 1063
  • [47] Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network
    Huang, Zhichao
    Li, Xutao
    Ye, Yunming
    Zhang, Baoquan
    Xu, Guangning
    Gan, Wensheng
    APPLIED INTELLIGENCE, 2023, 53 (04) : 3652 - 3671
  • [48] Multi-view knowledge graph fusion via knowledge-aware attentional graph neural network
    Zhichao Huang
    Xutao Li
    Yunming Ye
    Baoquan Zhang
    Guangning Xu
    Wensheng Gan
    Applied Intelligence, 2023, 53 : 3652 - 3671
  • [49] μKG: A Library for Multi-source Knowledge Graph Embeddings and Applications
    Luo, Xindi
    Sun, Zequn
    Hu, Andwei
    SEMANTIC WEB - ISWC 2022, 2022, 13489 : 610 - 627
  • [50] Research on Partition Block-based Multi-source Knowledge Fusion for Knowledge Graph Construction
    Song, Yu
    Dai, Dongming
    Hu, Chenxin
    Gui, Mingyu
    Zan, Hongying
    Zhang, Kunli
    2022 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2022), 2022, : 458 - 463