Unlocking the Potential: A Comprehensive Systematic Review of ChatGPT in Natural Language Processing Tasks

被引:6
作者
Alomari, Ebtesam Ahmad [1 ]
机构
[1] Albaha Univ, Fac Comp & Informat, Albaha 65731, Saudi Arabia
来源
CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES | 2024年 / 141卷 / 01期
关键词
Generative AI; large language model (LLM); natural language processing (NLP); ChatGPT; GPT (generative pre- training transformer); GPT-4; sentiment analysis; NER; information extraction; annotation; text classification;
D O I
10.32604/cmes.2024.052256
中图分类号
T [工业技术];
学科分类号
08 ;
摘要
As Natural Language Processing (NLP) continues to advance, driven by the emergence of sophisticated large language models such as ChatGPT, there has been a notable growth in research activity. This rapid uptake reflects increasing interest in the field and induces critical inquiries into ChatGPT's applicability in the NLP domain. This review paper systematically investigates the role of ChatGPT in diverse NLP tasks, including information text classification, sentiment analysis, emotion recognition and text annotation. The novelty of this work lies in its comprehensive analysis of the existing literature, addressing a critical gap in understanding ChatGPT's adaptability, limitations, and optimal application. In this paper, we employed a systematic stepwise approach following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) framework to direct our search process and seek relevant studies. Our review reveals ChatGPT's significant potential in enhancing various NLP tasks. Its adaptability in information extraction tasks, sentiment analysis, and text classification showcases its ability to comprehend diverse contexts and extract meaningful details. Additionally, ChatGPT's flexibility in annotation tasks reduces manual efforts and accelerates the annotation process, making it a valuable asset in NLP development and research. Furthermore, GPT-4 and prompt engineering emerge as a complementary mechanism, empowering users to guide the model and enhance overall accuracy. Despite its promising potential, challenges persist. The performance of ChatGPT needs to be tested using more extensive datasets and diverse data structures. Subsequently, its limitations in handling domain-specific language and the need for fine-tuning in specific applications highlight the importance of further investigations to address these issues.
引用
收藏
页码:43 / 85
页数:43
相关论文
共 138 条
[1]  
Achiam Josh, 2023, GPT-4 Technical Report
[2]  
Agarwal M., 2023, J. Reprod. Res., V1, P140
[3]  
Al Ghazali Shatha, 2024, International Journal of Information and Education Technology, V14, P271, DOI 10.18178/ijiet.2024.14.2.2048
[4]   A Comprehensive Study of ChatGPT: Advancements, Limitations, and Ethical Considerations in Natural Language Processing and Cybersecurity [J].
Alawida, Moatsum ;
Mejri, Sami ;
Mehmood, Abid ;
Chikhaoui, Belkacem ;
Abiodun, Oludare Isaac .
INFORMATION, 2023, 14 (08)
[5]  
Alizadeh M.H., ARXIV
[6]   Harnessing the Power of ChatGPT for Automating Systematic Review Process: Methodology, Case Study, Limitations, and Future Directions [J].
Alshami, Ahmad ;
Elsayed, Moustafa ;
Ali, Eslam ;
Eltoukhy, Abdelrahman E. E. ;
Zayed, Tarek .
SYSTEMS, 2023, 11 (07)
[7]  
Baidoo-Anu D., 2023, J. AI, V7, P52, DOI [10.2139/ssrn.4337484, DOI 10.61969/JAI.1337500, 10.61969/jai.1337500, DOI 10.2139/SSRN.4337484]
[8]   The Power of Generative AI: A Review of Requirements, Models, Input-Output Formats, Evaluation Metrics, and Challenges [J].
Bandi, Ajay ;
Adapa, Pydi Venkata Satya Ramesh ;
Kuchi, Yudu Eswar Vinay Pratap Kumar .
FUTURE INTERNET, 2023, 15 (08)
[9]  
Belal M., 2023, arXiv
[10]   Exploring Large Language Models for Low-Resource IT Information Extraction [J].
Bhavya, Bhavya ;
Isaza, Paulina Toro ;
Deng, Yu ;
Nidd, Michael ;
Azad, Amar Prakash ;
Shwartz, Larisa ;
Zhai, ChengXiang .
2023 23RD IEEE INTERNATIONAL CONFERENCE ON DATA MINING WORKSHOPS, ICDMW 2023, 2023, :1203-1212