Quality Assurance for Segmentation and Tagging of Chinese Novels in the Ming and Qing Dynasties

被引:2
作者
Xiong, Dan [1 ]
Lu, Qin [1 ]
Lo, Fengju [2 ]
Shi, Dingxu [3 ]
Chiu, Tin-shing [1 ]
机构
[1] Hong Kong Polytech Univ, Dept Comp, Hong Kong, Hong Kong, Peoples R China
[2] Yuan Ze Univ, Dept Chinese Linguist & Literature, Taoyuan, Taiwan
[3] Hong Kong Polytech Univ, Dept Chinese & Bilingual Studies, Kowloon, Hong Kong, Peoples R China
来源
2012 INTERNATIONAL CONFERENCE ON ASIAN LANGUAGE PROCESSING (IALP 2012) | 2012年
关键词
Quality assurance; word segmentation; tagging; named entities; novels in the Ming and Qing dynasties;
D O I
10.1109/IALP.2012.60
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper presents a word segmentation and named entity tagging project which annotates Chinese novels in the Ming and Qing dynasties. Computer-aided tools are used to assist the annotation. The focus of this paper will be on the quality assurance measures to ensure precision and consistency. The specification for word segmentation and named entity tagging is formulated based on the standards for modern Chinese segmentation commonly used in Mainland China and in Taiwan as well as the analysis of differences between Chinese classics and modern Chinese. The specification is established through iterative refinements. This refinement process can offer valuable insights into the quality control of computer-aided processing performed on Chinese literature works in the Ming and Qing dynasties and can be applied to those in even earlier periods. The finalized corpus, built in a computer-aided, manually-reviewed method in accordance with the specification, can be used for researches in literature, linguistics, information technology, and teaching of Chinese.
引用
收藏
页码:77 / 80
页数:4
相关论文
共 4 条
[1]  
[Anonymous], 1999, CNS14366 NBS
[2]  
Liu Y., 1994, GB13715
[3]  
Lu Q., 2004, J CHINESE LANGUAGE C, V14, P221
[4]  
YU SW, 2003, J CHINESE LANGUAGE C, V13, P121