What if ChatGPT generates quantitative research data? A case study in tourism

被引:7
|
作者
Sop, Serhat Adem [1 ]
Kurcer, Doga [1 ]
机构
[1] Burdur Mehmet Akif Ersoy Univ, Dept Tourism Management, Burdur, Turkiye
关键词
ChatGPT; Quantitative research; Artificial intelligence-generated dataset; Data fabrication; Research ethics; Tourism;
D O I
10.1108/JHTT-08-2023-0237
中图分类号
F [经济];
学科分类号
02 ;
摘要
Purpose - This study aims to explore whether Chat Generative Pre-training Transformer (ChatGPT) can produce quantitative data sets for researchers who could behave unethically through data fabrication. Design/methodology/approach - A two-stage case study related to the field of tourism was conducted, and ChatGPT (v.3.5.) was asked to respond to the first questionnaire on behalf of 400 participants and the second on behalf of 800 participants. The artificial intelligence (AI)-generated data sets' quality was statistically tested via descriptive statistics, correlation analysis, exploratory factor analysis, confirmatory factor analysis and Harman's single-factor test. Findings - The results revealed that ChatGPT could respond to the questionnaires as the number of participants at the desired sample size level and could present the generated data sets in a table format ready for analysis. It was also observed that ChatGPT's responses were systematical, and it created a statistically ideal data set. However, it was noted that the data produced high correlations among the observed variables, the measurement model did not achieve sufficient goodness of fit and the issue of common method bias emerged. The conclusion reached is that ChatGPT does not or cannot yet generate data of suitable quality for advanced-level statistical analyses. Originality/value - This study shows that ChatGPT can provide quantitative data to researchers attempting to fabricate data sets unethically. Therefore, it offers a new and significant argument to the ongoing debates about the unethical use of ChatGPT. Besides, a quantitative data set generated by AI was statistically examined for the first time in this study. The results proved that the data produced by ChatGPT is problematic in certain aspects, shedding light on several points that journal editors should consider during the editorial processes.
引用
收藏
页码:329 / 343
页数:15
相关论文
共 50 条
  • [21] Open data for tourism: the case of Tourpedia
    Lo Duca, Angelica
    Marchetti, Andrea
    JOURNAL OF HOSPITALITY AND TOURISM TECHNOLOGY, 2019, 10 (03) : 382 - 398
  • [22] Research on Sustainable Tourism Development of aLeisure City - The case of Changsha Based on Data Mining
    Chen Wenwu
    An Yonggang
    Ma Xiaoyan
    He Yunxiang
    2014 7TH INTERNATIONAL CONFERENCE ON INTELLIGENT COMPUTATION TECHNOLOGY AND AUTOMATION (ICICTA), 2014, : 573 - 578
  • [23] Leveraging ChatGPT and other generative artificial intelligence (AI)-based applications in the hospitality and tourism industry: practices, challenges and research agenda
    Dwivedi, Yogesh K.
    Pandey, Neeraj
    Currie, Wendy
    Micu, Adrian
    INTERNATIONAL JOURNAL OF CONTEMPORARY HOSPITALITY MANAGEMENT, 2024, 36 (01) : 1 - 12
  • [24] AI Unreliable Answers: A Case Study on ChatGPT
    Amaro, Ilaria
    Della Greca, Attilio
    Francese, Rita
    Tortora, Genoveffa
    Tucci, Cesare
    ARTIFICIAL INTELLIGENCE IN HCI, AI-HCI 2023, PT II, 2023, 14051 : 23 - 40
  • [25] Future applications of generative large language models: A data-driven case study on ChatGPT
    Chiarello, Filippo
    Giordano, Vito
    Spada, Irene
    Barandoni, Simone
    Fantoni, Gualtiero
    TECHNOVATION, 2024, 133
  • [26] A systematic review of augmented reality tourism research: What is now and what is next?
    Jingen Liang, Lena
    Elliot, Statia
    TOURISM AND HOSPITALITY RESEARCH, 2021, 21 (01) : 15 - 30
  • [27] What is it and how to measure cultural tourism? A longitudinal study with time series for the Spanish case
    Mallor, Elodie
    Gonzalez-Gallarza Granizo, Martina
    Fayos Gardo, Teresa
    PASOS-REVISTA DE TURISMO Y PATRIMONIO CULTURAL, 2013, 11 (02) : 269 - 284
  • [28] Evaluating passive mobile positioning data for tourism surveys:: An Estonian case study
    Ahas, Rein
    Aasa, Anto
    Roose, Antti
    Mark, Uelar
    Silm, Siiri
    TOURISM MANAGEMENT, 2008, 29 (03) : 469 - 486
  • [29] A novel ChatGPT-based multimodel framework for tourism review mining: a case study on China's five sacred mountains
    Cheng, Xinquan
    Chen, Yuanhong
    Wang, Pingfan
    Zhou, YanXi
    Wei, Xiaojing
    Luo, Wenjiang
    Duan, Qingxin
    JOURNAL OF HOSPITALITY AND TOURISM TECHNOLOGY, 2024, 15 (04) : 592 - 609
  • [30] Mapping the evolution of tourism research: the Spanish case
    Martinez-Navarro, Jesus
    Campayo-Sanchez, Fernando
    Fedorova, Liudmila Ostrovskaya
    JOURNAL OF HISTORICAL RESEARCH IN MARKETING, 2024, 16 (01) : 96 - 121