Effective fake news video detection using domain knowledge and multimodal data fusion on youtube

被引:23
|
作者
Choi, Hyewon [1 ]
Ko, Youngjoong [1 ]
机构
[1] Sungkyunkwan Univ, Dept Comp Sci & Engn, 2066 Seobu Ro, Suwon, Gyeonggi Do, South Korea
基金
新加坡国家研究基金会;
关键词
Fake news video detection; Domain knowledge; Multimodal data; Deep neural networks;
D O I
10.1016/j.patrec.2022.01.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In the digital age, numerous videos are being actively produced and uploaded online. Simultaneously, fake news videos to attract public attention are also on the rise. Therefore, intensive research is being conducted to detect them. Validating video content is critical for all users as the public is exposed to various fake news videos. This study proposes ways to detect fake news videos effectively using domain knowledge and multimodal data fusion. We use domain knowledge to perform learning by reflecting the potential meaning of comments, helping us detecting fake news videos. We also use the linear combination to efficiently adjust the encoding rate for each characteristic of the video and effectively detect fake news videos. In particular, the domain knowledge improves the model performance by approximately 3% for all test datasets. Consequently, we achieve an F1-score of 0.93, which is higher than those of other comparison models in all the test datasets.(c) 2022 Elsevier B.V. All rights reserved.
引用
收藏
页码:44 / 52
页数:9
相关论文
共 44 条
  • [21] DETECTION WITH MULTIMODAL DEPENDENT DATA USING LOW DIMENSIONAL RANDOM PROJECTIONS
    Wimalajeewa, Thakshila
    Varshney, Pramod K.
    2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), 2017, : 4621 - 4625
  • [22] A multimodal fusion framework for urban scene understanding and functional identification using geospatial data
    Su, Chen
    Hu, Xinli
    Meng, Qingyan
    Zhang, Linlin
    Shi, Wenxu
    Zhao, Maofan
    INTERNATIONAL JOURNAL OF APPLIED EARTH OBSERVATION AND GEOINFORMATION, 2024, 127
  • [23] Fault detection and diagnostics in the context of sparse multimodal data and expert knowledge assistance: Application to hydrogenerators
    Jose, Sagar
    Nguyen, Khanh T. P.
    Medjaher, Kamal
    Zemouri, Ryad
    Levesque, Melanie
    Tahan, Antoine
    COMPUTERS IN INDUSTRY, 2023, 151
  • [24] Graph-based adaptive weighted fusion SLAM using multimodal data in complex underground spaces
    Lin, Xiaohu
    Yang, Xin
    Yao, Wanqiang
    Wang, Xiqi
    Ma, Xiongwei
    Ma, Bolin
    ISPRS JOURNAL OF PHOTOGRAMMETRY AND REMOTE SENSING, 2024, 217 : 101 - 119
  • [25] Crowd anomaly detection with LSTMs using optical features and domain knowledge for improved inferring
    Mohammad Sabih
    Dinesh Kumar Vishwakarma
    The Visual Computer, 2022, 38 : 1719 - 1730
  • [26] Crowd anomaly detection with LSTMs using optical features and domain knowledge for improved inferring
    Sabih, Mohammad
    Vishwakarma, Dinesh Kumar
    VISUAL COMPUTER, 2022, 38 (05) : 1719 - 1730
  • [27] A semantic approach based on domain knowledge for polarity shift detection using distant supervision
    Ayeste, Zahra
    Noferesti, Samira
    PROGRESS IN ARTIFICIAL INTELLIGENCE, 2022, 11 (02) : 169 - 180
  • [28] A semantic approach based on domain knowledge for polarity shift detection using distant supervision
    Zahra Ayeste
    Samira Noferesti
    Progress in Artificial Intelligence, 2022, 11 : 169 - 180
  • [29] Recent progress on machine learning with limited materials data: Using tools from data science and domain knowledge
    Zong, Bangtan
    Li, Jinshan
    Yuan, Tinghuan
    Wang, Jun
    Yuan, Ruihao
    JOURNAL OF MATERIOMICS, 2025, 11 (03)
  • [30] Car crash detection using ensemble deep learning and multimodal data from dashboard cameras
    Choi, Jae Gyeong
    Kong, Chan Woo
    Kim, Gyeongho
    Lim, Sunghoon
    EXPERT SYSTEMS WITH APPLICATIONS, 2021, 183