Effectively Filtering Images for Better Multi-modal Knowledge Graph

被引:0
作者
Peng, Huang [1 ]
Xu, Hao [1 ]
Tang, Jiuyang [1 ]
Wu, Jibing [1 ]
Huang, Hongbin [1 ]
机构
[1] Natl Univ Def Technol, Lab Big Data & Decis, Changsha 410000, Peoples R China
来源
WEB AND BIG DATA. APWEB-WAIM 2022 INTERNATIONAL WORKSHOPS, KGMA 2022, SEMIBDMA 2022, DEEPLUDA 2022 | 2023年 / 1784卷
关键词
Multi-modal knowledge graph; Clustering algorithm; Image-text matching; Entity alignment;
D O I
10.1007/978-981-99-1354-1_2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The existing multi-modal knowledge graph construction techniques have become mature for processing text modal data, but lack effective processing methods for other modal data such as visual modal data. Therefore, the focus of multi-modal knowledge graph construction lies in image and image and text fusion processing. At present, the construction of multi-modal knowledge graph often does not filter the image quality, and there are noises and similar repetitive images in the image set. To solve this problem, this paper studies the quality control and screening of images in the construction process of multi-modal knowledge graph, and proposes an image refining framework of multi-modal knowledge graph, which is divided into three modules. The final experiment proves that this framework can provide higher quality images for multi-modal knowledge graphs, and in the benchmark task of multi-modal entity alignment, the effect of entity alignment based on the multi-modal knowledge graphs constructed in this paper has been improved compared with previous models.
引用
收藏
页码:10 / 22
页数:13
相关论文
共 50 条
  • [1] MultiJAF: Multi-modal joint entity alignment framework for multi-modal knowledge graph
    Cheng, Bo
    Zhu, Jia
    Guo, Meimei
    NEUROCOMPUTING, 2022, 500 : 581 - 591
  • [2] MMEA: Entity Alignment for Multi-modal Knowledge Graph
    Chen, Liyi
    Li, Zhi
    Wang, Yijun
    Xu, Tong
    Wang, Zhefeng
    Chen, Enhong
    KNOWLEDGE SCIENCE, ENGINEERING AND MANAGEMENT (KSEM 2020), PT I, 2020, 12274 : 134 - 147
  • [3] MERGE: A Modal Equilibrium Relational Graph Framework for Multi-Modal Knowledge Graph Completion
    Shang, Yuying
    Fu, Kun
    Zhang, Zequn
    Jin, Li
    Liu, Zinan
    Wang, Shensi
    Li, Shuchao
    SENSORS, 2024, 24 (23)
  • [4] Enhancing Recommender System with Multi-modal Knowledge Graph
    Sun, Chengjie
    Chen, Weiwei
    Lin, Lei
    Shan, Lili
    PATTERN RECOGNITION AND COMPUTER VISION, PRCV 2023, PT I, 2024, 14425 : 395 - 407
  • [5] Multi-Modal Knowledge Graph Construction and Application: A Survey
    Zhu, Xiangru
    Li, Zhixu
    Wang, Xiaodan
    Jiang, Xueyao
    Sun, Penglei
    Wang, Xuwu
    Xiao, Yanghua
    Yuan, Nicholas Jing
    IEEE TRANSACTIONS ON KNOWLEDGE AND DATA ENGINEERING, 2024, 36 (02) : 715 - 735
  • [6] Multi-modal Graph Convolutional Network for Knowledge Graph Entity Alignment
    You, Yinghui
    Wei, Yuyang
    Zhang, Yanlong
    Chen, Wei
    Zhao, Lei
    WEB AND BIG DATA, PT I, APWEB-WAIM 2023, 2024, 14331 : 142 - 157
  • [7] Temporal multi-modal knowledge graph generation for link prediction
    Li, Yuandi
    Ji, Hui
    Yu, Fei
    Cheng, Lechao
    Che, Nan
    NEURAL NETWORKS, 2025, 185
  • [8] A Survey of Knowledge Graph Reasoning on Graph Types: Static, Dynamic, and Multi-Modal
    Liang, Ke
    Meng, Lingyuan
    Liu, Meng
    Liu, Yue
    Tu, Wenxuan
    Wang, Siwei
    Zhou, Sihang
    Liu, Xinwang
    Sun, Fuchun
    He, Kunlun
    IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2024, 46 (12) : 9456 - 9478
  • [9] Self-supervised opinion summarization with multi-modal knowledge graph
    Lingyun Jin
    Jingqiang Chen
    Journal of Intelligent Information Systems, 2024, 62 : 191 - 208
  • [10] Self-supervised opinion summarization with multi-modal knowledge graph
    Jin, Lingyun
    Chen, Jingqiang
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2024, 62 (01) : 191 - 208