A Generative Artificial Intelligence Using Multilingual Large Language Models for ChatGPT Applications

被引:10
作者
Tuan, Nguyen Trung [1 ]
Moore, Philip [2 ]
Thanh, Dat Ha Vu [3 ]
Pham, Hai Van [3 ]
机构
[1] Natl Econ Univ, Sch Informat Technol & Digital Econ, 207 Giai Phong St, Hanoi 10000, Vietnam
[2] Lanzhou Univ, Sch Informat Sci & Engn, Feiyun Bldg,222 Tianshui South Rd, Lanzhou 730030, Peoples R China
[3] Hanoi Univ Sci & Technol, Sch Informat & Commun Technol, 1 Dai Co Viet, Hanoi 10000, Vietnam
来源
APPLIED SCIENCES-BASEL | 2024年 / 14卷 / 07期
关键词
generative AI; language comprehension; multilingual language models; large language models; support systems; technological determinism; chatbot; ChatGPT; DISRUPTIVE INNOVATION; TECHNOLOGY;
D O I
10.3390/app14073036
中图分类号
O6 [化学];
学科分类号
0703 ;
摘要
ChatGPT plays significant roles in the third decade of the 21st Century. Smart cities applications can be integrated with ChatGPT in various fields. This research proposes an approach for developing large language models using generative artificial intelligence models suitable for small- and medium-sized enterprises with limited hardware resources. There are many generative AI systems in operation and in development. However, the technological, human, and financial resources required to develop generative AI systems are impractical for small- and medium-sized enterprises. In this study, we present a proposed approach to reduce training time and computational cost that is designed to automate question-response interactions for specific domains in smart cities. The proposed model utilises the BLOOM approach as its backbone for using generative AI to maximum the effectiveness of small- and medium-sized enterprises. We have conducted a set of experiments on several datasets associated with specific domains to validate the effectiveness of the proposed model. Experiments using datasets for the English and Vietnamese languages have been combined with model training using low-rank adaptation to reduce training time and computational cost. In comparative experimental testing, the proposed model outperformed the 'Phoenix' multilingual chatbot model by achieving a 92% performance compared to 'ChatGPT' for the English benchmark.
引用
收藏
页数:24
相关论文
共 61 条
[1]  
Aghajanyan A, 2020, Arxiv, DOI arXiv:2012.13255
[2]  
Alabool Hamzeh Mohammad, 2023, 2023 International Conference on Information Technology (ICIT), P184, DOI 10.1109/ICIT58056.2023.10225801
[3]  
Ayoola O. O., 2023, BizEcons Quarterly, V16, P1
[4]  
Baidoo-Anu D., 2023, Journal of AI, V7, P52, DOI [DOI 10.61969/JAI.1337500, 10.2139/ssrn.4337484, DOI 10.2139/SSRN.4337484]
[5]  
Beeching E., 2023, Open LLM leaderboard
[6]  
Checkland P., 1997, Information, systems and information systems: making sense of the field
[7]  
Chen W.K., 2021, P 2021 IEEE INT C SO, P1, DOI [10.1109/SSIM49526.2021.9555195, DOI 10.1109/SSIM49526.2021.9555195]
[8]  
Chen ZH, 2023, Arxiv, DOI arXiv:2304.10453
[9]  
Christensen C., 2013, Disruptive innovation
[10]   Disruptive Innovation: An Intellectual History and Directions for Future Research [J].
Christensen, Clayton M. ;
McDonald, Rory ;
Altman, Elizabeth J. ;
Palmer, Jonathan E. .
JOURNAL OF MANAGEMENT STUDIES, 2018, 55 (07) :1043-1078