AsNER - Annotated Dataset and Baseline for Assamese Named Entity recognition

被引:0
作者
Pathak, Dhrubajyoti [1 ]
Nandi, Sukumar [1 ]
Sarmah, Priyankoo [1 ]
机构
[1] Indian Inst Technol Guwahati, North Guwahati, India
来源
LREC 2022: THIRTEEN INTERNATIONAL CONFERENCE ON LANGUAGE RESOURCES AND EVALUATION | 2022年
关键词
NER dataset; Language Resources; Assamese NER; Assamese Language; Named Entity Recognition; NER model; AsNER;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
We present the AsNER, a named entity annotation dataset for low resource Assamese language with a baseline Assamese NER model. The dataset contains about 99k tokens comprised of text from the speech of the Prime Minister of India and Assamese play. It also contains person names, location names and addresses. The proposed NER dataset is likely to be a significant resource for deep neural based Assamese language processing. We benchmark the dataset by training NER models and evaluating using state-of-the-art architectures for supervised named entity recognition (NER) such as Fasttext, BERT, XLM-R, FLAIR, MuRIL etc. We implement several baseline approaches with state-of-the-art sequence tagging Bi-LSTM-CRF architecture. The highest F1-score among all baselines achieves an accuracy of 80.69% when using MuRIL as a word embedding method. The annotated dataset and the top performing model are made publicly available.
引用
收藏
页码:6571 / 6577
页数:7
相关论文
共 26 条
[1]  
Akbik A., 2018, P 27 INT C COMP LING, P1638
[2]  
Akbik A, 2019, NAACL HLT 2019: THE 2019 CONFERENCE OF THE NORTH AMERICAN CHAPTER OF THE ASSOCIATION FOR COMPUTATIONAL LINGUISTICS: HUMAN LANGUAGE TECHNOLOGIES: PROCEEDINGS OF THE DEMONSTRATIONS SESSION, P54
[3]  
[Anonymous], 2006, Named entity recognition for question answering
[4]  
Aone C, 1999, ADVANCES IN AUTOMATIC TEXT SUMMARIZATION, P71
[5]  
Babych B., 2003, P 7 INT EAMT WORKSH
[6]  
Bojanowski P., 2017, T ASSOC COMPUT LING, V5, P135, DOI DOI 10.1162/TACL_A_00051
[7]  
Chinchor N., 1997, P 7 C MESSAGE UNDERS, V29, P1
[8]  
Chiu J.P., 2016, Transactions of the Association for Computational Linguistics, V4, P357, DOI [10.1162/tacl_a_00104, DOI 10.1162/TACLA00104]
[9]  
Conneau Alexis, 2019, Unsupervised cross-lingual representation learning at scale, DOI DOI 10.18653/V1/2020.ACL-MAIN.747
[10]  
Devlin J., 2018, CORR