What if ChatGPT generates quantitative research data? A case study in tourism

被引:7
|
作者
Sop, Serhat Adem [1 ]
Kurcer, Doga [1 ]
机构
[1] Burdur Mehmet Akif Ersoy Univ, Dept Tourism Management, Burdur, Turkiye
关键词
ChatGPT; Quantitative research; Artificial intelligence-generated dataset; Data fabrication; Research ethics; Tourism;
D O I
10.1108/JHTT-08-2023-0237
中图分类号
F [经济];
学科分类号
02 ;
摘要
Purpose - This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication. Design/methodology/approach - A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets' quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test. Findings - The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses. Originality/value - This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
引用
收藏
页码:329 / 343
页数:15
相关论文
共 50 条
  • [41] Using ChatGPT to Generate Research Ideas in Dysphagia: A Pilot Study
    Nachalon, Yuval
    Broer, Maya
    Nativ-Zeltzer, Nogah
    DYSPHAGIA, 2024, 39 (03) : 407 - 411
  • [42] Data-driven management using Business Analytics: the case study of data sets for new business in tourism
    Ferreira, Ana
    Pedrosa, Isabel
    2022 17TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2022,
  • [43] Exploring the Use of Artificial Intelligence for Qualitative Data Analysis: The Case of ChatGPT
    Morgan, David L.
    INTERNATIONAL JOURNAL OF QUALITATIVE METHODS, 2023, 22
  • [45] The why, how, and what of public policy implications of tourism and hospitality research
    Aguinis, Herman
    Kraus, Sascha
    Pocek, Jasna
    Meyer, Natanya
    Jensen, Soren H.
    TOURISM MANAGEMENT, 2023, 97
  • [46] ChatGPT as an Information Source for Patients with Migraines: A Qualitative Case Study
    Schuetz, Pascal
    Lob, Sina
    Chahed, Hiba
    Dathe, Lisa
    Loewer, Maren
    Reiss, Hannah
    Weigel, Alina
    Albrecht, Joanna
    Tokgoez, Pinar
    Dockweiler, Christoph
    HEALTHCARE, 2024, 12 (16)
  • [47] Case Study of Tourism Course Recommendation System Using Data from Social Network Services
    Takahashi, Shizune
    Li, Shuang
    Yamada, Keizo
    Takagi, Masanori
    Sasaki, Jun
    NEW TRENDS IN INTELLIGENT SOFTWARE METHODOLOGIES, TOOLS AND TECHNIQUES, 2017, 297 : 339 - 347
  • [48] Probing into the Fairness of Large Language Models: A Case Study of ChatGPT
    Li, Yunqi
    Zhang, Lanjing
    Zhang, Yongfeng
    2024 58TH ANNUAL CONFERENCE ON INFORMATION SCIENCES AND SYSTEMS, CISS, 2024,
  • [49] Determinants of CO2 emissions in ASEAN: a quantitative research on the role of tourism
    Phu, Ly Hoang
    Anh, Vo Huyen Bao
    Trang, Pham Ngoc
    Thao, Ha Anh
    Nhung, Pham Hong
    INTERNATIONAL JOURNAL OF ENVIRONMENT AND POLLUTION, 2024, 74 (1-4) : 172 - 197
  • [50] Global trends and hotspots of ChatGPT in medical research: a bibliometric and visualized study
    Liu, Ling
    Qu, Shenhong
    Zhao, Haiyun
    Kong, Lingping
    Xie, Zhuzhu
    Jiang, Zhichao
    Zou, Pan
    FRONTIERS IN MEDICINE, 2024, 11