Research and implementation on Chinese word segmentation

Chinese word segmentation is the first step towards much exciting word-based text processing applications. In this paper, we present a method to convert the problem of Chinese sentence segmentation to that of pure Chinese string segmentation. It is based on word frequency and the segmentation depends on the maximum value of the product of frequencies of Chinese words. Experimental results indicate that the proposed algorithm can resolve ambiguous problems of Chinese segmentation, which is very helpful for Chinese information processing.