Multi-channel Convolutional Neural Network for Precise Meme Classification

被引:1
|
作者
Sherratt, Victoria [1 ]
Pimbblet, Kevin [2 ,3 ]
Dethlefs, Nina [4 ]
机构
[1] Univ Hull, Ctr Excellence Data Sci AI & Modelling DAIM, Kingston Upon Hull, England
[2] Univ Hull, Big Data Analyt Res Grp, Kingston Upon Hull, England
[3] Univ Hull, Sch Comp Sci, Kingston Upon Hull, England
[4] Univ Hull, EA Milne Ctr Astrophys, Kingston Upon Hull, England
关键词
multimodal learning; computer vision and language; neural networks; social media analysis;
D O I
10.1145/3591106.3592275
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes a multi-channel convolutional neural network (MC-CNN) for classifying memes and non-memes. Our architecture is trained and validated on a challenging dataset that includes non-meme formats with textual attributes, which are also circulated online but rarely accounted for in meme classification tasks. Alongside a transfer learning base, two additional channels capture low-level and fundamental features of memes that make them unique from other images with text. We contribute an approach which outperforms previous meme classifiers specifically in live data evaluation, and one that is better able to generalise 'in the wild'. Our research aims to improve accurate collation of meme content to support continued research in meme content analysis, and meme-related sub-tasks such as harmful content detection.
引用
收藏
页码:190 / 198
页数:9
相关论文
共 50 条
  • [31] Classification of Hand Gestures Based on Multi-channel EMG by Scale Average Wavelet Transform and Convolutional Neural Network
    Do-Chang Oh
    Yong-Un Jo
    International Journal of Control, Automation and Systems, 2021, 19 : 1443 - 1450
  • [32] Classification of Hand Gestures Based on Multi-channel EMG by Scale Average Wavelet Transform and Convolutional Neural Network
    Oh, Do-Chang
    Jo, Yong-Un
    INTERNATIONAL JOURNAL OF CONTROL AUTOMATION AND SYSTEMS, 2021, 19 (03) : 1443 - 1450
  • [33] A Multi-Channel Convolutional Neural Network approach to automate the citation screening process
    van Dinter, Raymon
    Catal, Cagatay
    Tekinerdogan, Bedir
    APPLIED SOFT COMPUTING, 2021, 112
  • [34] Multi-channel Convolutional Neural Network Feature Extraction for Session Based Recommendation
    Ji, Zhenyan
    Wu, Mengdan
    Feng, Yumin
    Armendariz Inigo, Jose Enrique
    COMPLEXITY, 2021, 2021
  • [35] Image Reconstruction for Ultrasonic Tomography using Multi-channel Convolutional Neural Network
    Lyu, Jiashuo
    Tan, Chao
    Dong, Feng
    PROCEEDINGS OF THE 39TH CHINESE CONTROL CONFERENCE, 2020, : 7304 - 7309
  • [36] FACIAL LANDMARK DETECTION VIA CASCADE MULTI-CHANNEL CONVOLUTIONAL NEURAL NETWORK
    Hou, Qiqi
    Wang, Jinjun
    Cheng, Lele
    Gong, Yihong
    2015 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING (ICIP), 2015, : 1800 - 1804
  • [37] Multi-channel Classification Resonance Network
    Kim, Joonhyuk
    Park, Gyeong-Moon
    Kim, Jong-Hwan
    2019 7TH INTERNATIONAL CONFERENCE ON ROBOT INTELLIGENCE TECHNOLOGY AND APPLICATIONS (RITA), 2019, : 12 - 19
  • [38] Multi-channel Lightweight Convolutional Neural Network for Remote Myocardial Infarction Monitoring
    Cao, Yangjie
    Wei, Tingting
    Lin, Nan
    Zhang, Di
    Rodrigues, Joel J. P. C.
    2020 IEEE WIRELESS COMMUNICATIONS AND NETWORKING CONFERENCE WORKSHOPS (WCNCW), 2020,
  • [39] Infrared and visible image fusion based on multi-channel convolutional neural network
    Wang, Hongmei
    An, Wenbo
    Li, Lin
    Li, Chenkai
    Zhou, Daming
    IET IMAGE PROCESSING, 2022, 16 (06) : 1575 - 1584
  • [40] Epileptic Seizure Detection for Multi-channel EEG with Deep Convolutional Neural Network
    Park, Chulkyun
    Choi, Gwangho
    Kim, Junkyung
    Kim, Sangdeok
    Kim, Tae-Loon
    Min, Kyeongyuk
    Jung, Ki-Young
    Chong, Jongwha
    2018 INTERNATIONAL CONFERENCE ON ELECTRONICS, INFORMATION, AND COMMUNICATION (ICEIC), 2018, : 518 - 522