Using AI-based detectors to control AI-assisted plagiarism in ESL writing: “The Terminator Versus the Machines”

被引:0
作者
Karim Ibrahim
机构
[1] Gulf University for Science and Technology,
来源
Language Testing in Asia | / 13卷
关键词
Generative AI; AI-assisted plagiarism; Language assessment; Academic integrity; ESL composition;
D O I
暂无
中图分类号
学科分类号
摘要
The release of ChatGPT marked the beginning of a new era of AI-assisted plagiarism that disrupts traditional assessment practices in ESL composition. In the face of this challenge, educators are left with little guidance in controlling AI-assisted plagiarism, especially when conventional methods fail to detect AI-generated texts. One approach to managing AI-assisted plagiarism is using fine-tuned AI classifiers, such as RoBERTa, to identify machine-generated texts; however, the reliability of this approach is yet to be established. To address the challenge of AI-assisted plagiarism in ESL contexts, the present cross-disciplinary descriptive study examined the potential of two RoBERTa-based classifiers to control AI-assisted plagiarism on a dataset of 240 human-written and ChatGPT-generated essays. Data analysis revealed that both platforms could identify AI-generated texts, but their detection accuracy was inconsistent across the dataset.
引用
收藏
相关论文
共 38 条
[1]  
Ali WZW(2012)Plagiarism: To what extent is it understood? Procedia - Social and Behavioral Sciences 59 604-611
[2]  
Ismail H(2023)Chatting and Cheating: Ensuring academic integrity in the era of ChatGPT Innovations in Education and Teaching International 340–341 250-261
[3]  
Cheat TT(2016)An improved method to construct basic probability assignment based on the confusion matrix for classification problem Information Sciences 27 861-874
[4]  
Cotton DR(2006)An introduction to ROC analysis Pattern Recognition Letters 2 41-45
[5]  
Cotton PA(1985)A overview of descriptive research Journal of the Association of Pediatric Oncology Nurses 2 37-39
[6]  
Shipway JR(2022)Generating diverse code explanations using the GPT-3 large language model Proceedings of the ACM Conference on International Computing Education Research 19 129-132
[7]  
Deng X(2015)Qualitative and descriptive research: Data type versus data analysis Language Teaching Research 2005 27-38
[8]  
Liu Q(2005)The state of critical thinking today New Directions for Community Colleges 78 84-93
[9]  
Deng Y(2023)Collaborating with ChatGPT: Considering the implications of generative artificial intelligence for journalism and media education Journalism and Mass Communication Educator 47 269-302
[10]  
Mahadevan S(2014)Plagiarism in second-language writing Language Teaching 1 9-150