Tries for approximate string matching

被引:33
作者
Shang, H [1 ]
Merrettal, TH [1 ]
机构
[1] MCGILL UNIV, SCH COMP SCI, MONTREAL, PQ H3A 2A7, CANADA
基金
加拿大自然科学与工程研究理事会;
关键词
approximate matching; text search; trie;
D O I
10.1109/69.536247
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Tries offer text searches with costs which are independent of the size of the document being searched, and so are important for large documents requiring spelling checkers, case insensitivity, and limited approximate regular secondary storage. Approximate searches, in which the search pattern differs from the document by k substitutions, transpositions, insertions or deletions, have hitherto been carried out only at costs linear in the size of the document. We present a trie-based method whose cost is independent of document size. Our experiments show that this new method significantly outperforms the nearest competitor for k = 0 and k = 1, which are arguably the most important cases. The linear cost (in k) of the other methods begins to catch up, for our small files, only at k = 2. for larger files, complexity arguments indicate that tries will outperform the linear methods for larger values of k. The indexes combine suffixes and so are compact in storage, When the text itself does not need to be stored, as in a spelling checker, we even obtain negative overhead: 50% compression. We discuss a variety of applications and extensions, including best match (for spelling checkers), case insensitivity, and limited approximate regular expression matching.
引用
收藏
页码:540 / 547
页数:8
相关论文
共 29 条
  • [1] Apostolico A., 1985, NATO ASI Series, V12, P85, DOI [DOI 10.1007/978-3-642-82456-2_6, 10.1007/978-3-642-82456-26, DOI 10.1007/978-3-642-82456-26]
  • [2] A NEW APPROACH TO TEXT SEARCHING
    BAEZAYATES, R
    GONNET, GH
    [J]. COMMUNICATIONS OF THE ACM, 1992, 35 (10) : 74 - 82
  • [3] BAEZAYATES RA, 1992, LECT NOTES COMPUT SC, V644, P185
  • [4] BAEZAYATES RA, 1989, LECT NOTES COMPUT SC, V372, P46
  • [5] BAEZAYATES RA, 1992, INFORMATION RETRIEVA, P219
  • [6] FAST STRING SEARCHING ALGORITHM
    BOYER, RS
    MOORE, JS
    [J]. COMMUNICATIONS OF THE ACM, 1977, 20 (10) : 762 - 772
  • [7] Chang W. I., 1990, Proceedings. 31st Annual Symposium on Foundations of Computer Science (Cat. No.90CH2925-6), P116, DOI 10.1109/FSCS.1990.89530
  • [8] A TECHNIQUE FOR COMPUTER DETECTION AND CORRECTION OF SPELLING ERRORS
    DAMERAU, FJ
    [J]. COMMUNICATIONS OF THE ACM, 1964, 7 (03) : 171 - 176
  • [9] Gonnet G.H., 1992, INFORMATION RETRIEVA, P66
  • [10] GONNET GH, 1988, OED8802 U WAT