What if ChatGPT generates quantitative research data? A case study in tourism

被引:7
|
作者
Sop, Serhat Adem [1 ]
Kurcer, Doga [1 ]
机构
[1] Burdur Mehmet Akif Ersoy Univ, Dept Tourism Management, Burdur, Turkiye
关键词
ChatGPT; Quantitative research; Artificial intelligence-generated dataset; Data fabrication; Research ethics; Tourism;
D O I
10.1108/JHTT-08-2023-0237
中图分类号
F [经济];
学科分类号
02 ;
摘要
Purpose - This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication. Design/methodology/approach - A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets' quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test. Findings - The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses. Originality/value - This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
引用
收藏
页码:329 / 343
页数:15
相关论文
共 50 条
  • [31] Guided Reading: A Case Study in Evaluating Scientific Reports on Quantitative Research
    Osorio, Alessander
    Ferreira Jr, Paulo Roberto
    Cavalheiro, Gerson Geraldo H.
    JOURNAL OF UNIVERSAL COMPUTER SCIENCE, 2024, 30 (13) : 1829 - 1848
  • [32] Bridging the gap of bibliometric analysis: The evolution, current state, and future directions of tourism research using ChatGPT
    Shin, Hakseung
    Kang, Juhyun
    JOURNAL OF HOSPITALITY AND TOURISM MANAGEMENT, 2023, 57 : 40 - 47
  • [33] The use of ChatGPT in academic writing: A case study in Education
    Baldrich, D. Kevin
    Dominguez-Oller, Juana Celia
    PIXEL-BIT- REVISTA DE MEDIOS Y EDUCACION, 2024, (71): : 141 - 157
  • [34] Research on Intelligent Tourism Application Based on Big Data
    Dai, Zhiqiang
    Xiang, Changguo
    PROCEEDINGS OF THE 7TH INTERNATIONAL CONFERENCE ON EDUCATION, MANAGEMENT, INFORMATION AND COMPUTER SCIENCE (ICEMC 2017), 2017, 73 : 493 - 496
  • [35] Management of research data at the Regional Tourism Observatories in Chile
    Padilla, Patricio
    Sanchez, Sergio
    Hernandez, Jorge
    Mendoza, Yenniel
    CUADERNOS DE TURISMO, 2020, (45) : 289 - 310
  • [36] Flipped dialogic learning method with ChatGPT: A case study
    Pavlova, Nataliya Hristova
    INTERNATIONAL ELECTRONIC JOURNAL OF MATHEMATICS EDUCATION, 2024, 19 (01)
  • [37] May Artificial Intelligence Influence Future Pediatric Research?-The Case of ChatGPT
    Corsello, Antonio
    Santangelo, Andrea
    CHILDREN-BASEL, 2023, 10 (04):
  • [38] A Case Study Investigating the Utilization of ChatGPT in Online Discussions
    Lin, Xi
    Luterbach, Ken
    Gregory, Kristen H.
    Sconyers, Sarah E.
    ONLINE LEARNING, 2024, 28 (02):
  • [39] QUANTITATIVE AND QUALITATIVE DIMENSIONS OF TOURISM CONTRIBUTION TO REGIONAL DEVELOPMENT IN ROMANIA. THE CASE OF CULTURAL TOURISM
    Mitrut, Constantin
    Constantin, Daniela-Luminita
    ECONOMIC COMPUTATION AND ECONOMIC CYBERNETICS STUDIES AND RESEARCH, 2009, 43 (01) : 55 - 66
  • [40] Quantitative research in tourism and hospitality: an agenda for best-practice recommendations
    Assaf, A. George
    Tsionas, Mike G.
    INTERNATIONAL JOURNAL OF CONTEMPORARY HOSPITALITY MANAGEMENT, 2019, 31 (07) : 2776 - 2787