Chinese Named Entity Recognition for Dairy Cow Diseases by Fusion of Multi-Semantic Features Using Self-Attention-Based Deep Learning

被引:0
作者
Lou, Yongjun [1 ]
Gao, Meng [1 ]
Zhang, Shuo [1 ]
Yang, Hongjun [2 ]
Wang, Sicong [3 ]
He, Yongqiang [1 ]
Yang, Jing [1 ]
Yang, Wenxia [1 ]
Du, Haitao [4 ]
Shen, Weizheng [1 ]
机构
[1] Northeast Agr Univ, Coll Elect Engn & Informat, Harbin 150030, Peoples R China
[2] Shandong Acad Agr Sci, Anim Husb & Vet Inst, Jinan 251000, Peoples R China
[3] Hong Kong Univ Sci & Technol, Sch Engn, Hong Kong 999077, Peoples R China
[4] Dairy Assoc Heilongjiang Prov, Harbin 150030, Peoples R China
来源
ANIMALS | 2025年 / 15卷 / 06期
关键词
Chinese named entity recognition; dairy cow disease; multi-level features; Bi-LSTM; self-attention;
D O I
10.3390/ani15060822
中图分类号
S8 [畜牧、 动物医学、狩猎、蚕、蜂];
学科分类号
0905 ;
摘要
Named entity recognition (NER) is the basic task of constructing a high-quality knowledge graph, which can provide reliable knowledge in the auxiliary diagnosis of dairy cow disease, thus alleviating problems of missed diagnosis and misdiagnosis due to the lack of professional veterinarians in China. Targeting the characteristics of the Chinese dairy cow diseases corpus, we propose an ensemble Chinese NER model incorporating character-level, pinyin-level, glyph-level, and lexical-level features of Chinese characters. These multi-level features were concatenated and fed into the bidirectional long short-term memory (Bi-LSTM) network based on the multi-head self-attention mechanism to learn long-distance dependencies while focusing on important features. Finally, the globally optimal label sequence was obtained by the conditional random field (CRF) model. Experimental results showed that our proposed model outperformed baselines and related works with an F1 score of 92.18%, which is suitable and effective for named entity recognition for the dairy cow disease corpus.
引用
收藏
页数:21
相关论文
共 49 条
[1]  
Li G., Sun J., Guan M., Sun S., Shi G., Zhu C., A New Method for Non-Destructive Identification and Tracking of Multi-Object Behaviors in Beef Cattle Based on Deep Learning, Animals, 14, (2024)
[2]  
Li G., Shi G., Zhu C., Dynamic Serpentine Convolution with Attention Mechanism Enhancement for Beef Cattle Behavior Recognition, Animals, 14, (2024)
[3]  
Pramanik S., Alabi J., Roy R.S., Weikum G., UNIQORN: Unified question answering over RDF knowledge graphs and natural language text, J. Web Semant, 83, (2024)
[4]  
Xu L., Lu L., Liu M., Song C., Wu L., Nanjing Yunjin intelligent question-answering system based on knowledge graphs and retrieval augmented generation technology, Herit. Sci, 12, (2024)
[5]  
Wang H., Shen W., Zhang Y., Gao M., Zhang Q., Xiaohui A., Du H., Qiu B., Diagnosis of dairy cow diseases by knowledge-driven deep learning based on the text reports of illness state, Comput. Electron. Agric, 205, (2023)
[6]  
Cai C., Jiang Z., Wu H., Wang J., Liu J., Song L., Research on knowledge graph-driven equipment fault diagnosis method for intelligent manufacturing, Int. J. Adv. Manuf. Technol, 130, pp. 4649-4662, (2024)
[7]  
Cai S., Xie Z., Explainable fraud detection of financial statement data driven by two-layer knowledge graph, Expert. Syst. Appl, 246, (2024)
[8]  
Cheng F., Yan C., Liu W., Lin X., Research on medical insurance anti-gang fraud model based on the knowledge graph, Eng. Appl. Artif. Intell, 134, (2024)
[9]  
Chen Z., Yang Y., Semantic relatedness algorithm for keyword sets of geographic metadata, Cartogr. Geogr. Inf. Sci, 47, pp. 125-140, (2020)
[10]  
Lee J., Yoon W., Kim S., Kim D., Kim S., So C.H., Kang J., BioBERT: A pre-trained biomedical language representation model for biomedical text mining, Bioinformatics, 36, pp. 1234-1240, (2020)