The Research of Chinese Automatic Word Segmentation In Hierarchical Model Dictionary Binary Tree

被引:0
|
作者
Luo XianGang [1 ]
Luo Jin [1 ]
Xie Zhong [1 ]
机构
[1] China Univ Geosci, Fac Informat Engn, Wuhan, Peoples R China
来源
FIRST INTERNATIONAL WORKSHOP ON DATABASE TECHNOLOGY AND APPLICATIONS, PROCEEDINGS | 2009年
关键词
hierarchical model; search engine; Chinese Automatic Word Segmentation;
D O I
10.1109/DBTA.2009.27
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
With the continuous development and growing popularity of the Internet, the amount of information on-line is in the explosive growth. How to find out the information that we need correctly and quickly from the mass data, then put in the front. Under this background, the Internet search engine grows up rapidly. This article describes the search engine on the general principle and common technology, and on this basis, combined with analyzeing the existing technology of Chinese Automatic Word Segmentation, then to achieve a "wide-based segmentation of the largest positive scan," the Chinese word segmentation algorithm. According to the full text index technology, information search engine uses the means both of by word index and words index. Then, through the set of high-speed computing, and retrieve the information of users' requriements. Finally, using hierarchical model Lexicon Binary Tree, which reserched and realized the model of information search engine.
引用
收藏
页码:321 / 324
页数:4
相关论文
共 50 条
  • [1] Research of automatic Chinese word segmentation
    Liu, KY
    Zheng, JH
    2002 INTERNATIONAL CONFERENCE ON MACHINE LEARNING AND CYBERNETICS, VOLS 1-4, PROCEEDINGS, 2002, : 805 - 809
  • [2] Research on Dictionary for Personalized Chinese Word Segmentation
    Jiang, Huanjun
    Ren, Xiang
    Liu, Ke
    MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1868 - +
  • [3] Research of an Improved Algorithm for Chinese Word Segmentation Dictionary Based on Double-Array Trie Tree
    Yang, Wenchuan
    Liu, Jian
    Yu, Miao
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2013, 2013, 400 : 355 - 362
  • [4] Neural Chinese word segmentation with dictionary
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    NEUROCOMPUTING, 2019, 338 : 46 - 54
  • [5] Automatic word segmentation for Chinese classics of tea based on tree-pruning
    Fang, Miao
    Jiang, Yi
    Zhao, Qi
    Jiang, Xin
    2009 SECOND INTERNATIONAL SYMPOSIUM ON KNOWLEDGE ACQUISITION AND MODELING: KAM 2009, VOL 1, 2009, : 438 - +
  • [6] Neural Chinese Word Segmentation with Dictionary Knowledge
    Liu, Junxin
    Wu, Fangzhao
    Wu, Chuhan
    Huang, Yongfeng
    Xie, Xing
    NATURAL LANGUAGE PROCESSING AND CHINESE COMPUTING, NLPCC 2018, PT II, 2018, 11109 : 80 - 91
  • [7] An Optimization Algorithm of Chinese Word Segmentation Based on Dictionary
    Tang, Jun
    Wu, Qing
    Li, Yinghong
    2015 INTERNATIONAL CONFERENCE ON NETWORK AND INFORMATION SYSTEMS FOR COMPUTERS (ICNISC), 2015, : 259 - 262
  • [8] An improved automatic Chinese word segmentation mechanism
    Wang, Hu
    Wang, Qianping
    RECENT ADVANCE OF CHINESE COMPUTING TECHNOLOGIES, 2007, : 147 - 150
  • [9] The Research on Chinese Automatic Segmentation
    Li Huan-qin
    Yan Shi-tao
    ADVANCES IN APPLIED SCIENCE AND INDUSTRIAL TECHNOLOGY, PTS 1 AND 2, 2013, 798-799 : 818 - +
  • [10] Research and implementation on Chinese word segmentation
    Tang, Yunting
    Wu, Yan
    2007 International Symposium on Computer Science & Technology, Proceedings, 2007, : 361 - 363