Comparative analysis of TF-IDF and loglikelihood method for keywords extraction of twitter data

被引:5
作者
Abid, Muhammad Adeel [1 ]
Mushtaq, Muhammad Faheem [2 ]
Akram, Urooj [2 ]
Abbasi, Mateen Ahmed [1 ]
Rustam, Furqan [1 ]
机构
[1] Khwaja Fareed Univ Engn & Informat Technol, Fac Informat Technol, Rahim Yar Khan 64200, Pakistan
[2] Islamia Univ Bahawalpur, Dept Artificial Intelligence, Bahawalpur 63100, Pakistan
关键词
Twitter; Social Media; Classification; Loglikelihood Methods; Term Frequency-Inverse; Document Frequency;
D O I
10.22581/muet1982.2301.09
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
Twitter has become the foremost standard of social media in today's world. Over 335 million users are online monthly, and near about 80% are accessing it through their mobiles. Further, Twitter is now supporting 35+ which enhance its usage too much. It facilitates people having different languages. Near about 21% of the total users are from US and 79% of total users are outside of US. A tweet is restricted to a hundred and forty characters; hence it contains such information which is more concise and much valuable. Due to its usage, it is estimated that five hundred million tweets are sent per day by different categories of people including teacher, students, celebrities, officers, musician, etc. So, there is a huge amount of data that is increasing on a daily basis that need to be categorized. The important key feature is to find the keywords in the huge data that is helpful for identifying a twitter for classification. For this purpose, Term Frequency-Inverse Document Frequency (TF-IDF) and Loglikelihood methods are chosen for keywords extracted from the music field and perform a comparative analysis on both results. In the end, relevance is performed from 5 users so that finally we can take a decision to make assumption on the basis of experiments that which method is best. This analysis is much valuable because it gives a more accurate estimation which method's results are more reliable.
引用
收藏
页码:88 / 94
页数:7
相关论文
共 33 条
[21]   Mining Frequent Item Sets in Asynchronous Transactional Data Streams over Time Sensitive Sliding Windows Model [J].
Javaid, Qaisar ;
Memon, Farida ;
Talpur, Shahnawaz ;
Arif, Muhammad ;
Awan, Muhammad Daud .
MEHRAN UNIVERSITY RESEARCH JOURNAL OF ENGINEERING AND TECHNOLOGY, 2016, 35 (04) :625-644
[22]  
Karkali M, 2013, LECT NOTES COMPUT SC, V8180, P57, DOI 10.1007/978-3-642-41230-1_5
[23]  
Kim S.N., 2009, AUSTRALASIAN LANGUAG, P94
[24]  
Luo G., 2007, P ACM SIGMOD, P497
[25]  
Mikolov T, 2013, Arxiv, DOI arXiv:1301.3781
[26]   Enhancing First Story Detection using Word Embeddings [J].
Moran, Sean ;
McCreadie, Richard ;
Macdonald, Craig ;
Ounis, Iadh .
SIGIR'16: PROCEEDINGS OF THE 39TH INTERNATIONAL ACM SIGIR CONFERENCE ON RESEARCH AND DEVELOPMENT IN INFORMATION RETRIEVAL, 2016, :821-824
[27]  
Petrov C, 2019, Twitter statistics
[28]  
Petrovic S., 2010, HUMAN LANGUAGE TECHN, P181
[29]  
Safari K, 2020, Arxiv, DOI arXiv:1904.10403
[30]  
Schroeder R, 2012, Combating Terrorism Exchange, V2, P54