Effectively Filtering Images for Better Multi-modal Knowledge Graph

被引:0
作者
Peng, Huang [1 ]
Xu, Hao [1 ]
Tang, Jiuyang [1 ]
Wu, Jibing [1 ]
Huang, Hongbin [1 ]
机构
[1] Natl Univ Def Technol, Lab Big Data & Decis, Changsha 410000, Peoples R China
来源
WEB AND BIG DATA. APWEB-WAIM 2022 INTERNATIONAL WORKSHOPS, KGMA 2022, SEMIBDMA 2022, DEEPLUDA 2022 | 2023年 / 1784卷
关键词
Multi-modal knowledge graph; Clustering algorithm; Image-text matching; Entity alignment;
D O I
10.1007/978-981-99-1354-1_2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The existing multi-modal knowledge graph construction techniques have become mature for processing text modal data, but lack effective processing methods for other modal data such as visual modal data. Therefore, the focus of multi-modal knowledge graph construction lies in image and image and text fusion processing. At present, the construction of multi-modal knowledge graph often does not filter the image quality, and there are noises and similar repetitive images in the image set. To solve this problem, this paper studies the quality control and screening of images in the construction process of multi-modal knowledge graph, and proposes an image refining framework of multi-modal knowledge graph, which is divided into three modules. The final experiment proves that this framework can provide higher quality images for multi-modal knowledge graphs, and in the benchmark task of multi-modal entity alignment, the effect of entity alignment based on the multi-modal knowledge graphs constructed in this paper has been improved compared with previous models.
引用
收藏
页码:10 / 22
页数:13
相关论文
共 50 条
  • [31] Adaptive Feature Fusion for Multi-modal Entity Alignment
    Guo H.
    Li X.-Y.
    Tang J.-Y.
    Guo Y.-M.
    Zhao X.
    Zidonghua Xuebao/Acta Automatica Sinica, 2024, 50 (04): : 758 - 770
  • [32] Enhanced Entity Interaction Modeling for Multi-Modal Entity Alignment
    Li, Jinxu
    Zhou, Qian
    Chen, Wei
    Zhao, Lei
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT, PT II, KSEM 2023, 2023, 14118 : 214 - 227
  • [33] MMKG-PAR: Multi-Modal Knowledge Graphs-Based Personalized Attraction Recommendation
    Zhang, Gengyue
    Li, Hao
    Li, Shuangling
    Wang, Beibei
    Ding, Zhixing
    SUSTAINABILITY, 2024, 16 (05)
  • [34] PSNEA: Pseudo-Siamese Network for Entity Alignment between Multi-modal Knowledge Graphs
    Ni, Wenxin
    Xu, Qianqian
    Jiang, Yangbangyan
    Cao, Zongsheng
    Cao, Xiaochun
    Huang, Qingming
    PROCEEDINGS OF THE 31ST ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA, MM 2023, 2023, : 3489 - 3497
  • [35] Multi-modal entity alignment in hyperbolic space
    Guo, Hao
    Tang, Jiuyang
    Zeng, Weixin
    Zhao, Xiang
    Liu, Li
    NEUROCOMPUTING, 2021, 461 : 598 - 607
  • [36] Multi-modal Siamese Network for Entity Alignment
    Chen, Liyi
    Li, Zhi
    Xu, Tong
    Wu, Han
    Wang, Zhefeng
    Yuan, Nicholas Jing
    Chen, Enhong
    PROCEEDINGS OF THE 28TH ACM SIGKDD CONFERENCE ON KNOWLEDGE DISCOVERY AND DATA MINING, KDD 2022, 2022, : 118 - 126
  • [37] Multi-Modal Entity Alignment Method Based on Feature Enhancement
    Wang, Huansha
    Liu, Qinrang
    Huang, Ruiyang
    Zhang, Jianpeng
    APPLIED SCIENCES-BASEL, 2023, 13 (11):
  • [38] An Image-Text Matching Method for Multi-Modal Robots
    Zheng, Ke
    Li, Zhou
    JOURNAL OF ORGANIZATIONAL AND END USER COMPUTING, 2024, 36 (01)
  • [39] A Multi-Modal Medical Image Analysis Algorithm Based on Text Guidance
    Fan, Lin
    Gong, Xun
    Zheng, Cen-Yang
    Tien Tzu Hsueh Pao/Acta Electronica Sinica, 2024, 52 (07): : 2341 - 2355
  • [40] Multi-Modal Entity Alignment Using Uncertainty Quantification for Modality Importance
    Hama, Kenta
    Matsubara, Takashi
    IEEE ACCESS, 2023, 11 : 28479 - 28489