EduNER: a Chinese named entity recognition dataset for education research

被引:7
作者
Li, Xu [1 ]
Wei, Chengkun [1 ]
Jiang, Zhuoren [2 ]
Meng, Wenlong [1 ]
Ouyang, Fan [3 ]
Zhang, Zihui [4 ]
Chen, Wenzhi [1 ]
机构
[1] Zhejiang Univ, Coll Comp Sci & Technol, 38 Zheda Rd, Hangzhou 310027, Zhejiang, Peoples R China
[2] Zhejiang Univ, Sch Publ Affairs, 866 Yuhangtang Rd, Hangzhou 310058, Zhejiang, Peoples R China
[3] Zhejiang Univ, Coll Educ, 866 Yuhangtang Rd, Hangzhou 310058, Zhejiang, Peoples R China
[4] Zhejiang Univ, Informat Technol Ctr, 866 Yuhangtang Rd, Hangzhou 310058, Zhejiang, Peoples R China
基金
中国国家自然科学基金;
关键词
Chinese named entity recognition; Dataset; Benchmark; Education; AGREEMENT;
D O I
10.1007/s00521-023-08635-5
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
A high-quality domain-oriented dataset is crucial for the domain-specific named entity recognition (NER) task. In this study, we introduce a novel education-oriented Chinese NER dataset (EduNER). To provide representative and diverse training data, we collect data from multiple sources, including textbooks, academic papers, and education-related web pages. The collected documents span ten years (2012-2021). A team of domain experts is invited to accomplish the education NER schema definition, and a group of trained annotators is hired to complete the annotation. A collaborative labeling platform is built for accelerating human annotation. The constructed EduNER dataset includes 16 entity types, 11k+ sentences, and 35,731 entities. We conduct a thorough statistical analysis of EduNER and summarize its distinctive characteristics by comparing it with eight open-domain or domain-specific NER datasets. Sixteen state-of-the-art models are further utilized for NER tasks validation. The experimental results can enlighten further exploration. To the best of our knowledge, EduNER is the first publicly available dataset for NER task in the education domain, which may promote the development of education-oriented NER models.
引用
收藏
页码:17717 / 17731
页数:15
相关论文
共 51 条
[1]  
Alvarado Julio Cesar Salinas, 2015, P AUSTRALASIAN LANGU, P84
[2]   An instant perspective comparison system to facilitate learners' discussion effectiveness in an online discussion process [J].
Chen, Chih-Ming ;
Tsao, Han-Wen .
COMPUTERS & EDUCATION, 2021, 164
[3]   A COEFFICIENT OF AGREEMENT FOR NOMINAL SCALES [J].
COHEN, J .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1960, 20 (01) :37-46
[4]  
Devlin J, 2019, 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES (NAACL HLT 2019), VOL. 1, P4171
[5]   NCBI disease corpus: A resource for disease name recognition and concept normalization [J].
Dogan, Rezarta Islamaj ;
Leaman, Robert ;
Lu, Zhiyong .
JOURNAL OF BIOMEDICAL INFORMATICS, 2014, 47 :1-10
[6]   Automatically generating effective search queries directly from community question-answering questions for finding related questions [J].
Figueroa, Alejandro .
EXPERT SYSTEMS WITH APPLICATIONS, 2017, 77 :11-19
[7]  
Garcia-Castro R., 2020, 32 INT C SOFTW ENG K, P413, DOI 10.18293/SEKE2020-153
[8]  
Gui T, 2019, PROCEEDINGS OF THE TWENTY-EIGHTH INTERNATIONAL JOINT CONFERENCE ON ARTIFICIAL INTELLIGENCE, P4982
[9]  
Gui T, 2019, 2019 CONFERENCE ON EMPIRICAL METHODS IN NATURAL LANGUAGE PROCESSING AND THE 9TH INTERNATIONAL JOINT CONFERENCE ON NATURAL LANGUAGE PROCESSING (EMNLP-IJCNLP 2019), P1040
[10]  
Hahn U, 2010, Proceedings of the Fourth Linguistic Annotation Workshop, P235