An Artificial Intelligence Method for Automatic Assessment of Fuzzy Semantics in English Literature

被引:0
作者
Li, Meiyan [1 ]
机构
[1] Henan Normal Univ, Fac Int Studies, Xinxiang 453007, Henan, Peoples R China
关键词
Automatic assessment; recurrent neural networks; long short-term memory (LSTM); quadratic weighted kappa (QWK); convolutional layer;
D O I
10.14569/IJACSA.2023.0141004
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
This Online writing and evaluation are becoming increasingly popular, as is automatic literature assessment. The most popular way is to obtain a good evaluation of the essay and article is by the automatic scoring model. However, assessing fuzzy semantics contained in reports and papers takes much work. An automated essay and articles assessment model using the long-short-term memory (LSTM) neural network is developed and validated to obtain an appropriate assessment. The relevant theoretical basis of the recurrent neural network is introduced first, and the quadratic weighted kappa (QWK) elevation method is cited here to develop the model. The LSTM network is then awarded for developing the general automatic assessment model. The available model is modified to get better performance by adding a convolutional layer(s). Finally, a data set of 7000 essays is segmented based on the ratio of 6:2:2 to train, validate, and test the model. The results indicate that the LSTM network can effectively capture the general properties of the essay and articles. After adding the convolutional layer(s), the LSTM+convolutional layer(s) model can get better performance. The QWK values are higher than 0.6 and have an improvement of 0.097 to 0.134 compared with the LSTM network, which proves that the results of the LSTM network combined with the convolutional layer(s) model are overall satisfactory, and the modified model has practical values.
引用
收藏
页码:29 / 37
页数:9
相关论文
共 26 条
[1]  
Alikaniotis D, 2016, Arxiv, DOI arXiv:1606.04289
[2]   A novel automated essay scoring approach for reliable higher educational assessments [J].
Beseiso, Majdi ;
Alzubi, Omar A. ;
Rashaideh, Hasan .
JOURNAL OF COMPUTING IN HIGHER EDUCATION, 2021, 33 (03) :727-746
[3]   Automatic Essay Scoring with Recurrent Neural Network [J].
Cai, Changzhi .
2019 THE 3RD INTERNATIONAL CONFERENCE ON HIGH PERFORMANCE COMPILATION, COMPUTING AND COMMUNICATIONS (HP3C 2019), 2019, :1-7
[4]  
Cai WC, 2018, 2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP), P5189, DOI 10.1109/ICASSP.2018.8462025
[5]  
Dong F., 2017, P 21 C COMP NAT LANG, P153
[6]  
Farag Y, 2020, Arxiv, DOI [arXiv:1804.06898, 10.48550/arXiv.1804.06898, DOI 10.48550/ARXIV.1804.06898]
[7]   Automated language essay scoring systems: a literature review [J].
Hussein, Mohamed Abdellatif ;
Hassan, Hesham ;
Nassef, Mohammad .
PEERJ COMPUTER SCIENCE, 2019, 2019 (08)
[8]  
Ke ZX, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P6300
[9]  
Lagakis P, 2021, 2021 INT C COMPUTER, P1
[10]   Identification of future signal based on the quantitative and qualitative text mining: a case study on ethical issues in artificial intelligence [J].
Lee, Young-Joo ;
Park, Ji-Young .
QUALITY & QUANTITY, 2018, 52 (02) :653-667