Hand-Drawn Emoji Recognition using Convolutional Neural Network

被引:1
作者
Akter, Mehenika [1 ]
Hossain, Mohammad Shahadat [1 ]
Andersson, Karl [2 ]
机构
[1] Univ Chittagong, Dept Comp Sci & Engn, Chittagong, Bangladesh
[2] Lulea Univ Technol, Dept Comp Sci Elect & Space Engn, Skelleftea, Sweden
来源
PROCEEDINGS OF 2020 6TH IEEE INTERNATIONAL WOMEN IN ENGINEERING (WIE) CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (WIECON-ECE 2020) | 2020年
关键词
hand-drawn emoji; recognition; classification; convolutional neural network; CNN; pre-trained model; machine learning;
D O I
10.1109/WIECON-ECE52138.2020.9397933
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Emojis are like small icons or images used to express our sentiments or feelings via text messages. They are extensively used in different social media platforms like Facebook, Twitter, Instagram etc. We considered hand-drawn emojis to classify them into 8 classes in this research paper. Hand-drawn emojis are the emojis drawn in any digital platform or in just a paper with a pen. This paper will enable the users to classify the hand-drawn emojis so that they could use them in any social media without any confusion. We made a local dataset of 500 images for each class summing a total of 4000 images of hand-drawn emojis. We presented a system which could recognise and classify the emojis into 8 classes with a convolutional neural network model. The model could favorably recognise as well as classify the hand-drawn emojis with an accuracy of 97%. Some pre-trained CNN models like VGG16, VGG19, ResNet50, MobileNetV2, InceptionV3 and Xception are also trained on the dataset to compare the accuracy and check whether they are better than the proposed one. On the other hand, machine learning models like SVM, Random Forest, Adaboost, Decision Tree and XGboost are also implemented on the dataset.
引用
收藏
页码:159 / 164
页数:6
相关论文
共 29 条
  • [1] Abadi M, 2016, ACM SIGPLAN NOTICES, V51, P1, DOI [10.1145/2951913.2976746, 10.1145/3022670.2976746]
  • [2] Ahmed T. Uddin, 2020, 9 INT C INF EL VIS I
  • [3] Ahmed TU, 2019, 2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC), P336, DOI [10.1109/iciev.2019.8858529, 10.1109/ICIEV.2019.8858529]
  • [4] Akter M., 2020, 3 INT C INT COMP OPT
  • [5] Barbieri F., 2018, ARXIV PREPRINT ARXIV
  • [6] Bokil S., GBOARD ANDROID GETS
  • [7] New Modality: Emoji Challenges in Prediction, Anticipation, and Retrieval
    Cappallo, Spencer
    Svetlichnaya, Stacey
    Garrigues, Pierre
    Mensink, Thomas
    Snoek, Cees G. M.
    [J]. IEEE TRANSACTIONS ON MULTIMEDIA, 2019, 21 (02) : 402 - 415
  • [8] Performance Analysis of Google Colaboratory as a Tool for Accelerating Deep Learning Applications
    Carneiro, Tiago
    Medeiros Da Nobrega, Raul Victor
    Nepomuceno, Thiago
    Bian, Gui-Bin
    De Albuquerque, Victor Hugo C.
    Reboucas Filho, Pedro Pedrosa
    [J]. IEEE ACCESS, 2018, 6 : 61677 - 61685
  • [9] Emoji-Powered Representation Learning for Cross-Lingual Sentiment Classification
    Chen, Zhenpeng
    Shen, Sheng
    Hu, Ziniu
    Lu, Xuan
    Mei, Qiaozhu
    Liu, Xuanzhe
    [J]. WEB CONFERENCE 2019: PROCEEDINGS OF THE WORLD WIDE WEB CONFERENCE (WWW 2019), 2019, : 251 - 262
  • [10] Chowdhury RR, 2019, 2019 JOINT 8TH INTERNATIONAL CONFERENCE ON INFORMATICS, ELECTRONICS & VISION (ICIEV) AND 2019 3RD INTERNATIONAL CONFERENCE ON IMAGING, VISION & PATTERN RECOGNITION (ICIVPR) WITH INTERNATIONAL CONFERENCE ON ACTIVITY AND BEHAVIOR COMPUTING (ABC), P318, DOI [10.1109/iciev.2019.8858545, 10.1109/ICIEV.2019.8858545]