Analyzing Sentiments Regarding ChatGPT Using Novel BERT: A Machine Learning Approach

被引:30
作者
Sudheesh, R. [1 ]
Mujahid, Muhammad [2 ]
Rustam, Furqan [3 ]
Shafique, Rahman [4 ]
Chunduri, Venkata [5 ]
Villar, Monica Gracia [6 ,7 ,8 ]
Ballester, Julien Brito [6 ,9 ,10 ]
Diez, Isabel de la Torre [11 ]
Ashraf, Imran [4 ]
机构
[1] Kodiyattu Veedu, Kollam 691532, Valakom, India
[2] Khwaja Fareed Univ Engn & Informat Technol, Dept Comp Sci, Rahim Yar Khan 64200, Pakistan
[3] Univ Coll Dublin, Sch Comp Sci, Dublin D04 V1W8, Ireland
[4] Yeungnam Univ, Dept Informat & Commun Engn, Gyongsan 38541, South Korea
[5] Indiana State Univ, Terre Haute, IN 47809 USA
[6] Univ Europea Atlantico, Fac Social Sci & Humanities, Isabel Torres 21, Santander 39011, Spain
[7] Univ Int Iberoamer Arecibo, Dept Project Management, Arecibo, PR 00613 USA
[8] Univ Int Cuanza, Dept Extens, EN250, Cuito, Bie, Angola
[9] Univ Int Iberoamer, Campeche 24560, Mexico
[10] Univ Int Colombia, Bogota 11001, Colombia
[11] Univ Valladolid, Dept Signal Theory Commun & Telemat Engn, Paseo Belen 15, Valladolid 47011, Spain
关键词
ChatGPT; sentimental analysis; BERT; machine learning; LDA; app reviewers; deep learning; ALGORITHMS;
D O I
10.3390/info14090474
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Chatbots are AI-powered programs designed to replicate human conversation. They are capable of performing a wide range of tasks, including answering questions, offering directions, controlling smart home thermostats, and playing music, among other functions. ChatGPT is a popular AI-based chatbot that generates meaningful responses to queries, aiding people in learning. While some individuals support ChatGPT, others view it as a disruptive tool in the field of education. Discussions about this tool can be found across different social media platforms. Analyzing the sentiment of such social media data, which comprises people's opinions, is crucial for assessing public sentiment regarding the success and shortcomings of such tools. This study performs a sentiment analysis and topic modeling on ChatGPT-based tweets. ChatGPT-based tweets are the author's extracted tweets from Twitter using ChatGPT hashtags, where users share their reviews and opinions about ChatGPT, providing a reference to the thoughts expressed by users in their tweets. The Latent Dirichlet Allocation (LDA) approach is employed to identify the most frequently discussed topics in relation to ChatGPT tweets. For the sentiment analysis, a deep transformer-based Bidirectional Encoder Representations from Transformers (BERT) model with three dense layers of neural networks is proposed. Additionally, machine and deep learning models with fine-tuned parameters are utilized for a comparative analysis. Experimental results demonstrate the superior performance of the proposed BERT model, achieving an accuracy of 96.49%.
引用
收藏
页数:29
相关论文
共 78 条
[1]  
Al Kilani N, 2019, 2019 SIXTH INTERNATIONAL CONFERENCE ON SOCIAL NETWORKS ANALYSIS, MANAGEMENT AND SECURITY (SNAMS), P541, DOI [10.1109/SNAMS.2019.8931820, 10.1109/snams.2019.8931820]
[2]   The impact of preprocessing steps on the accuracy of machine learning algorithms in sentiment analysis [J].
Alam, Saqib ;
Yao, Nianmin .
COMPUTATIONAL AND MATHEMATICAL ORGANIZATION THEORY, 2019, 25 (03) :319-335
[3]   Automatic Classification of Accessibility User Reviews in Android Apps [J].
Aljedaani, Wajdi ;
Mkaouer, Mohamed Wiem ;
Ludi, Stephanie ;
Javed, Yasir .
2022 7TH INTERNATIONAL CONFERENCE ON DATA SCIENCE AND MACHINE LEARNING APPLICATIONS (CDMA 2022), 2022, :133-138
[4]   Detection of Fake Job Postings by Utilizing Machine Learning and Natural Language Processing Approaches [J].
Amaar, Aashir ;
Aljedaani, Wajdi ;
Rustam, Furqan ;
Ullah, Saleem ;
Rupapara, Vaibhav ;
Ludi, Stephanie .
NEURAL PROCESSING LETTERS, 2022, 54 (03) :2219-2247
[5]  
[Anonymous], 2015, P 2015 C EMP METH NA, DOI [DOI 10.18653/V1/D15-1167, 10.18653/v1/D15-1167]
[6]   Opinion mining for app reviews: an analysis of textual representation and predictive models [J].
Araujo, Adailton F. ;
Golo, Marcos P. S. ;
Marcacini, Ricardo M. .
AUTOMATED SOFTWARE ENGINEERING, 2022, 29 (01)
[7]   Analysis of Sentiments on the Onset of COVID-19 Using Machine Learning Techniques [J].
Arya, Vishakha ;
Mishra, Amit Kumar ;
Gonzalez-Briones, Alfonso .
ADCAIJ-ADVANCES IN DISTRIBUTED COMPUTING AND ARTIFICIAL INTELLIGENCE JOURNAL, 2022, 11 (01) :45-63
[8]   Self voting classification model for online meeting app review sentiment analysis and topic modeling [J].
Aslam, Naila ;
Xia, Kewen ;
Rustam, Furqan ;
Lee, Ernesto ;
Ashraf, Imran .
PEERJ COMPUTER SCIENCE, 2022, 8
[9]   Sentiment Analysis and Emotion Detection on Cryptocurrency Related Tweets Using Ensemble LSTM-GRU Model [J].
Aslam, Naila ;
Rustam, Furqan ;
Lee, Ernesto ;
Washington, Patrick Bernard ;
Ashraf, Imran .
IEEE ACCESS, 2022, 10 :39313-39324
[10]   A BERT Framework to Sentiment Analysis of Tweets [J].
Bello, Abayomi ;
Ng, Sin-Chun ;
Leung, Man-Fai .
SENSORS, 2023, 23 (01)