Hand-Drawn Emoji Recognition using Convolutional Neural Network

被引:2
作者
Akter, Mehenika [1 ]
Hossain, Mohammad Shahadat [1 ]
Andersson, Karl [2 ]
机构
[1] Univ Chittagong, Dept Comp Sci & Engn, Chittagong, Bangladesh
[2] Lulea Univ Technol, Dept Comp Sci Elect & Space Engn, Skelleftea, Sweden
来源
PROCEEDINGS OF 2020 6TH IEEE INTERNATIONAL WOMEN IN ENGINEERING (WIE) CONFERENCE ON ELECTRICAL AND COMPUTER ENGINEERING (WIECON-ECE 2020) | 2020年
关键词
hand-drawn emoji; recognition; classification; convolutional neural network; CNN; pre-trained model; machine learning;
D O I
10.1109/WIECON-ECE52138.2020.9397933
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Emojis are like small icons or images used to express our sentiments or feelings via text messages. They are extensively used in different social media platforms like Facebook, Twitter, Instagram etc. We considered hand-drawn emojis to classify them into 8 classes in this research paper. Hand-drawn emojis are the emojis drawn in any digital platform or in just a paper with a pen. This paper will enable the users to classify the hand-drawn emojis so that they could use them in any social media without any confusion. We made a local dataset of 500 images for each class summing a total of 4000 images of hand-drawn emojis. We presented a system which could recognise and classify the emojis into 8 classes with a convolutional neural network model. The model could favorably recognise as well as classify the hand-drawn emojis with an accuracy of 97%. Some pre-trained CNN models like VGG16, VGG19, ResNet50, MobileNetV2, InceptionV3 and Xception are also trained on the dataset to compare the accuracy and check whether they are better than the proposed one. On the other hand, machine learning models like SVM, Random Forest, Adaboost, Decision Tree and XGboost are also implemented on the dataset.
引用
收藏
页码:159 / 164
页数:6
相关论文
共 29 条
[21]  
Monrat AA, 2018, PROCEEDINGS OF THE 2018 43RD ANNUAL IEEE CONFERENCE ON LOCAL COMPUTER NETWORKS WORKSHOPS (LCN WORKSHOPS), P38, DOI 10.1109/LCNW.2018.8628607
[22]  
Plaugic L., OXFORD DICT WORD YEA
[23]   Beyond Just Text: Semantic Emoji Similarity Modeling to Support Expressive Communication [J].
Pohl, Henning ;
Domin, Christian ;
Rohs, Michael .
ACM TRANSACTIONS ON COMPUTER-HUMAN INTERACTION, 2017, 24 (01)
[24]  
Priya B. G., INT J SCI RES REV, V7, P859
[25]  
Tosi S, 2009, Matplotlib for Python developers
[26]  
Tüske Z, 2015, INT CONF ACOUST SPEE, P4285, DOI 10.1109/ICASSP.2015.7178779
[27]  
Ul Islam R., 2015, 17 INT C INF INT WEB, DOI [10.1145/2837185.2837212, DOI 10.1145/2837185.2837212]
[28]   The NumPy Array: A Structure for Efficient Numerical Computation [J].
van der Walt, Stefan ;
Colbert, S. Chris ;
Varoquaux, Gael .
COMPUTING IN SCIENCE & ENGINEERING, 2011, 13 (02) :22-30
[29]   Speech Emotion Recognition in Neurological Disorders Using Convolutional Neural Network [J].
Zisad, Sharif Noor ;
Hossain, Mohammad Shahadat ;
Andersson, Karl .
BRAIN INFORMATICS, BI 2020, 2020, 12241 :287-296