What if ChatGPT generates quantitative research data? A case study in tourism

被引:7
|
作者
Sop, Serhat Adem [1 ]
Kurcer, Doga [1 ]
机构
[1] Burdur Mehmet Akif Ersoy Univ, Dept Tourism Management, Burdur, Turkiye
关键词
ChatGPT; Quantitative research; Artificial intelligence-generated dataset; Data fabrication; Research ethics; Tourism;
D O I
10.1108/JHTT-08-2023-0237
中图分类号
F [经济];
学科分类号
02 ;
摘要
Purpose - This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication. Design/methodology/approach - A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets' quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test. Findings - The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses. Originality/value - This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
引用
收藏
页码:329 / 343
页数:15
相关论文
共 50 条
  • [1] ChatGPT as a data analyst: an exploratory study on AI-supported quantitative data analysis in empirical research
    Prandner, Dimitri
    Wetzelhuetter, Daniela
    Hese, Soenke
    FRONTIERS IN EDUCATION, 2025, 9
  • [2] The impact of ChatGPT on human skills: A quantitative study on twitter data
    Giordano, Vito
    Spada, Irene
    Chiarello, Filippo
    Fantoni, Gualtiero
    TECHNOLOGICAL FORECASTING AND SOCIAL CHANGE, 2024, 203
  • [3] Understanding the impact of ChatGPT on tourism and hospitality: Trends, prospects and research agenda
    Sigala, Marianna
    Ooi, Keng-Boon
    Tan, Garry Wei-Han
    Aw, Eugene Cheng-Xi
    Buhalis, Dimitrios
    Cham, Tat-Huei
    Chen, Meng-Mei
    Dwivedi, Yogesh K.
    Gretzel, Ulrike
    Inversini, Alessandro
    Jung, Timothy
    Law, Rob
    Ye, Ivy Huiyue
    JOURNAL OF HOSPITALITY AND TOURISM MANAGEMENT, 2024, 60 : 384 - 390
  • [4] Research on the sustainable development of tourism coupled with economic and environment data -- a case study of Hangzhou
    Song, Haifeng
    Wang, Weijia
    Zhu, Jiaqi
    Ren, Cong
    Li, Xin
    Lou, Wenyi
    Yang, Weiwei
    Du, Lei
    MATHEMATICAL BIOSCIENCES AND ENGINEERING, 2023, 20 (12) : 20852 - 20880
  • [5] THE CASE STUDY IN TOURISM RESEARCH: A METHODOLOGICAL APPROACH
    Marujo, Noemi
    TURISMO-ESTUDOS E PRATICAS, 2016, 5 (01): : 113 - 128
  • [6] Game of algorithms: ChatGPT implications for the future of tourism education and research
    Ivanov, Stanislav
    Soliman, Mohammad
    JOURNAL OF TOURISM FUTURES, 2021, 9 (02) : 214 - 221
  • [7] Quantitative versus qualitative tourism research
    Walle, AH
    ANNALS OF TOURISM RESEARCH, 1997, 24 (03) : 524 - 536
  • [8] The impact of ChatGPT on human data collection: A case study involving typicality norming data
    Heyman, Tom
    Heyman, Geert
    BEHAVIOR RESEARCH METHODS, 2024, 56 (05) : 4974 - 4981
  • [9] ARTIFICIAL INTELLIGENCE IN THE ANALYSIS OF EDUCATIONAL RESEARCH QUANTITATIVE DATA: RELIABILITY OF DATA ANALYST GPT (CHATGPT) COMPARED TO SPSS AND JAMOVI
    Santos, Cassio
    NUANCES-ESTUDOS SOBRE EDUCACAO, 2024, 35
  • [10] Halal tourism and ChatGPT: an overview of current trends and future research directions
    Battour, Mohamed
    Mady, Khalid
    Salaheldeen, Mohamed
    Ratnasari, Ririn Tri
    Sallem, Ramzi
    Al Sinawi, Saleh
    JOURNAL OF ISLAMIC MARKETING, 2024, 15 (12) : 3464 - 3483