Effectively Filtering Images for Better Multi-modal Knowledge Graph

被引:0
作者
Peng, Huang [1 ]
Xu, Hao [1 ]
Tang, Jiuyang [1 ]
Wu, Jibing [1 ]
Huang, Hongbin [1 ]
机构
[1] Natl Univ Def Technol, Lab Big Data & Decis, Changsha 410000, Peoples R China
来源
WEB AND BIG DATA. APWEB-WAIM 2022 INTERNATIONAL WORKSHOPS, KGMA 2022, SEMIBDMA 2022, DEEPLUDA 2022 | 2023年 / 1784卷
关键词
Multi-modal knowledge graph; Clustering algorithm; Image-text matching; Entity alignment;
D O I
10.1007/978-981-99-1354-1_2
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The existing multi-modal knowledge graph construction techniques have become mature for processing text modal data, but lack effective processing methods for other modal data such as visual modal data. Therefore, the focus of multi-modal knowledge graph construction lies in image and image and text fusion processing. At present, the construction of multi-modal knowledge graph often does not filter the image quality, and there are noises and similar repetitive images in the image set. To solve this problem, this paper studies the quality control and screening of images in the construction process of multi-modal knowledge graph, and proposes an image refining framework of multi-modal knowledge graph, which is divided into three modules. The final experiment proves that this framework can provide higher quality images for multi-modal knowledge graphs, and in the benchmark task of multi-modal entity alignment, the effect of entity alignment based on the multi-modal knowledge graphs constructed in this paper has been improved compared with previous models.
引用
收藏
页码:10 / 22
页数:13
相关论文
共 50 条
  • [21] MMKDGAT: Multi-modal Knowledge graph-aware Deep Graph Attention Network for remote sensing image recommendation
    Wang, Fei
    Zhu, Xianzhang
    Cheng, Xin
    Zhang, Yongjun
    Li, Yansheng
    EXPERT SYSTEMS WITH APPLICATIONS, 2024, 235
  • [22] MMCSD: Multi-Modal Knowledge Graph Completion Based on Super-Resolution and Detailed Description Generation
    Wang, Huansha
    Huang, Ruiyang
    Liu, Qinrang
    Li, Shaomei
    Zhang, Jianpeng
    Computers, Materials and Continua, 2025, 83 (01) : 761 - 783
  • [23] Multi-Modal Knowledge Graph Enhanced StyleGAN-Based Cognitive Semantic Communications for Image Transmissions
    Wu, Wei
    Mao, Hangtao
    Zhou, Fuhui
    Yao, Tianle
    Hu, Han
    Wang, Baoyun
    Wu, Qihui
    2024 IEEE INTERNATIONAL CONFERENCE ON COMMUNICATIONS WORKSHOPS, ICC WORKSHOPS 2024, 2024, : 1653 - 1659
  • [24] Mandari: Multi-Modal Temporal Knowledge Graph-aware Sub-graph Embedding for Next-POI Recommendation
    Liu, Xiaoqian
    Li, Xiuyun
    Cao, Yuan
    Zhang, Fan
    Jin, Xiongnan
    Chen, Jinpeng
    2023 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO, ICME, 2023, : 1529 - 1534
  • [25] MFIEA: entity alignment through multi-modal feature interaction and knowledge facts
    Zhang, Xiaoming
    Lv, Menglong
    Wang, Huiyong
    Naseriparsa, Mehdi
    JOURNAL OF INTELLIGENT INFORMATION SYSTEMS, 2025, : 965 - 988
  • [26] A question answering system for assembly process of wind turbines based on multi-modal knowledge graph and large language model
    Hu, Zhiqiang
    Li, Xinyu
    Pan, Xinyu
    Wen, Sijie
    Bao, Jinsong
    JOURNAL OF ENGINEERING DESIGN, 2023,
  • [27] MMIEA: Multi-modal Interaction Entity Alignment model for knowledge graphs
    Zhu, Bin
    Wu, Meng
    Hong, Yunpeng
    Chen, Yi
    Xie, Bo
    Liu, Fei
    Bu, Chenyang
    Ding, Weiping
    INFORMATION FUSION, 2023, 100
  • [28] Multi-Modal Knowledge-Aware Attention Network for Question Answering
    Zhang Y.
    Qian S.
    Fang Q.
    Xu C.
    Jisuanji Yanjiu yu Fazhan/Computer Research and Development, 2020, 57 (05): : 1037 - 1045
  • [29] Matching Images and Text with Multi-modal Tensor Fusion and Re-ranking
    Wang, Tan
    Xu, Xing
    Yang, Yang
    Hanjalic, Alan
    Shen, Heng Tao
    Song, Jingkuan
    PROCEEDINGS OF THE 27TH ACM INTERNATIONAL CONFERENCE ON MULTIMEDIA (MM'19), 2019, : 12 - 20
  • [30] Multi-modal Knowledge-aware Reinforcement Learning Network for Explainable Recommendation
    Tao, Shaohua
    Qiu, Runhe
    Ping, Yuan
    Ma, Hui
    KNOWLEDGE-BASED SYSTEMS, 2021, 227