The Ability of ChatGPT in Paraphrasing Texts and Reducing Plagiarism: A Descriptive Analysis

被引:4
作者
Hassanipour, Soheil [1 ]
Nayak, Sandeep [2 ]
Bozorgi, Ali [3 ]
Keivanlou, Mohammad -Hossein [1 ]
Dave, Tirth [4 ]
Alotaibi, Abdulhadi [5 ]
Joukar, Farahnaz [1 ]
Mellatdoust, Parinaz [6 ]
Bakhshi, Arash [1 ]
Kuriyakose, Dona [7 ]
Polisetty, Lakshmi [2 ]
Chimpiri, Mallika [8 ]
Amini-Salehi, Ehsan [1 ]
机构
[1] Guilan Univ Med Sci, Gastrointestinal & Liver Dis Res Ctr, 7H8Q 24P, Rasht, Iran
[2] Yale New Haven Hlth Bridgeport Hosp, Dept Internal Med, Bridgeport, CT USA
[3] Univ Tehran Med Sci, Tehran Heart Ctr, Tehran, Iran
[4] Bukovinian State Med Univ, Dept Internal Med, Chernovtsy, Ukraine
[5] Vis Coll, Dept Med, Riyadh, Saudi Arabia
[6] Politecn Milan, Dipartimento Elettron Informaz & Bioingn, Milan, Italy
[7] St Josephs Mission Hosp, Dept Internal Med, Anchal, India
[8] UCLA Neurosci, Los Angeles, CA USA
来源
JMIR MEDICAL EDUCATION | 2024年 / 10卷
关键词
ChatGPT; paraphrasing; text generation; prompts; academic journals; plagiarize; plagiarism; paraphrase; wording; LLM; LLMs; language model; language models; prompt; generative; artificial intelligence; NLP; natural language processing; rephrase; plagiarizing; honesty; integrity; texts; text; textual; generation; large language model; large language models;
D O I
10.2196/53308
中图分类号
G40 [教育学];
学科分类号
040101 ; 120403 ;
摘要
Background: The introduction of ChatGPT by OpenAI has garnered significant attention. Among its capabilities, paraphrasing stands out. Objective: This study aims to investigate the satisfactory levels of plagiarism in the paraphrased text produced by this chatbot. Methods: Three texts of varying lengths were presented to ChatGPT. ChatGPT was then instructed to paraphrase the provided texts using five different prompts. In the subsequent stage of the study, the texts were divided into separate paragraphs, and ChatGPT was requested to paraphrase each paragraph individually. Lastly, in the third stage, ChatGPT was asked to paraphrase the texts it had previously generated. Results: The average plagiarism rate in the texts generated by ChatGPT was 45% (SD 10%). ChatGPT exhibited a substantial reduction in plagiarism for the provided texts (mean difference -0.51, 95% CI -0.54 to -0.48; P <.001). Furthermore, when comparing the second attempt with the initial attempt, a significant decrease in the plagiarism rate was observed (mean difference -0.06, 95% CI -0.08 to -0.03; P <.001). The number of paragraphs in the texts demonstrated a noteworthy association with the percentage of plagiarism, with texts consisting of a single paragraph exhibiting the lowest plagiarism rate ( P <.001). Conclusion: Although ChatGPT demonstrates a notable reduction of plagiarism within texts, the existing levels of plagiarism remain relatively high. This underscores a crucial caution for researchers when incorporating this chatbot into their work.
引用
收藏
页数:7
相关论文
共 24 条
  • [1] Plagiarism
    Agrawal, Ranjan
    [J]. INDIAN JOURNAL OF PATHOLOGY AND MICROBIOLOGY, 2020, 63 (02) : 175 - 176
  • [2] Risk Factors of Non-alcoholic Fatty Liver Disease in the Iranian Adult Population: A Systematic Review and Meta-analysis
    Amini-Salehi, Ehsan
    Hassanipour, Soheil
    Joukar, Farahnaz
    Daryagasht, Amir Ali
    Khosousi, Mohammad-Javad
    Aleali, Maryam Sadat
    Ansar, Malek Moien
    Heidarzad, Forough
    Abdzadeh, Elham
    Vakilpour, Azin
    Mansour-Ghanaei, Fariborz
    [J]. HEPATITIS MONTHLY, 2023, 23 (01)
  • [3] Exploring the Boundaries of Reality: Investigating the Phenomenon of Artificial Intelligence Hallucination in Scientific Writing Through ChatGPT References
    Athaluri, Sai Anirudh
    Manthena, Sandeep Varma
    Kesapragada, V. S. R. Krishna Manoj
    Yarlagadda, Vineel
    Dave, Tirth
    Duddumpudi, Rama Tulasi Siri
    [J]. CUREUS JOURNAL OF MEDICAL SCIENCE, 2023, 15 (04)
  • [4] ChatGPT and the Future of Medical Writing
    Biswas, Som
    [J]. RADIOLOGY, 2023, 307 (02)
  • [5] Not all plagiarism requires a retraction
    Chaddah, Praveen
    [J]. NATURE, 2014, 511 (7508) : 127 - 127
  • [6] ChatGPT in medicine: an overview of its applications, advantages, limitations, future prospects, and ethical considerations
    Dave, Tirth
    Athaluri, Sai Anirudh
    Singh, Satyam
    [J]. FRONTIERS IN ARTIFICIAL INTELLIGENCE, 2023, 6
  • [7] ABSTRACTS WRITTEN BY CHATGPT FOOL SCIENTISTS
    Else, Holly
    [J]. NATURE, 2023, 613 (7944) : 423 - 423
  • [8] ChatGPT: evolution or revolution?
    Gordijn, Bert
    ten Have, Henk
    [J]. MEDICINE HEALTH CARE AND PHILOSOPHY, 2023, 26 (01) : 1 - 2
  • [9] Gupta A., 2020, Int. J. Eng. Res. Technol, V9, P255, DOI DOI 10.17577/IJERTV9IS070143
  • [10] The Acceptable Text Similarity Level in Manuscripts Submitted to Scientific Journals
    Habibzadeh, Farrokh
    [J]. JOURNAL OF KOREAN MEDICAL SCIENCE, 2023, 38 (31)