Research and implementation on Chinese word segmentation

被引：0
|
作者：
Tang, Yunting [1 ]
Wu, Yan
机构：
[1] Zhejiang Univ, Ningbo Inst Technol, Ningbo 135000, Peoples R China
[2] Harbin Inst Technol, Dept Comp Sci & Elect Engn, Harbin 150001, Peoples R China
来源：
2007 International Symposium on Computer Science & Technology, Proceedings | 2007年
关键词：
Chinese segmentation; overlapping ambiguous phrase; combined ambiguous phrase; hybrid ambiguous phrase;
D O I：
暂无
中图分类号：
TP18 [人工智能理论];
学科分类号：
081104 ; 0812 ; 0835 ; 1405 ;
摘要：
Chinese word segmentation is the first step towards much exciting word-based text processing applications. In this paper, we present a method to convert the problem of Chinese sentence segmentation to that of pure Chinese string segmentation. It is based on word frequency and the segmentation depends on the maximum value of the product of frequencies of Chinese words. Experimental results indicate that the proposed algorithm can resolve ambiguous problems of Chinese segmentation, which is very helpful for Chinese information processing.
引用
收藏
页码：361 / 363
页数：3
相关论文
共 50 条
  • [21] Models and algorithm of Chinese word segmentation
    Wang, X
    Fu, G
    Yeung, DS
    Liu, JNK
    Luk, R
    IC-AI'2000: PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, VOL 1-III, 2000, : 1279 - 1284
  • [22] The Research of Chinese Automatic Word Segmentation In Hierarchical Model Dictionary Binary Tree
    Luo XianGang
    Luo Jin
    Xie Zhong
    FIRST INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS, PROCEEDINGS, 2009, : 321 - 324
  • [23] A quick method for Chinese word segmentation
    Huang, XH
    Luo, ZS
    Tang, J
    1997 IEEE INTERNATIONAL CONFERENCE ON INTELLIGENT PROCESSING SYSTEMS, VOLS 1 & 2, 1997, : 1773 - 1776
  • [24] Neural Chinese word segmentation with dictionary
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    NEUROCOMPUTING, 2019, 338 : 46 - 54
  • [25] Word segmentation in Chinese language processing
    Shu, Xinxin
    Wang, Junhui
    Shen, Xiaotong
    Qu, Annie
    Statistics and Its Interface, 2017, 10 (02) : 165 - 173
  • [26] A combining approach for Chinese word segmentation
    Aiqing, Wang
    Sen, Zhang
    SNPD 2007: EIGHTH ACIS INTERNATIONAL CONFERENCE ON SOFTWARE ENGINEERING, ARTIFICIAL INTELLIGENCE, NETWORKING, AND PARALLEL/DISTRIBUTED COMPUTING, VOL 3, PROCEEDINGS, 2007, : 738 - +
  • [27] A Hybrid Approach to Chinese Word Segmentation
    Chen, Bing
    Tai, Xiaoying
    2009 INTERNATIONAL SYMPOSIUM ON INTELLIGENT INFORMATION SYSTEMS AND APPLICATIONS, PROCEEDINGS, 2009, : 154 - 158
  • [28] CRFs based Chinese word segmentation
    Gui, Kunzhi
    Ren, Yong
    Peng, Zhaomeng
    MECHATRONICS ENGINEERING, COMPUTING AND INFORMATION TECHNOLOGY, 2014, 556-562 : 4376 - 4379
  • [29] An integrated approach for Chinese word segmentation
    Fu, GH
    Luke, KK
    PACLIC 17: LANGUAGE, INFORMATION AND COMPUTATION, PROCEEDINGS, 2003, : 80 - 87
  • [30] Chinese Word Segmentation with Character Abstraction
    Tian, Le
    Qiu, Xipeng
    Huang, Xuanjing
    CHINESE COMPUTATIONAL LINGUISTICS AND NATURAL LANGUAGE PROCESSING BASED ON NATURALLY ANNOTATED BIG DATA, 2013, 8208 : 36 - 43
12345