A space and time efficient algorithm for constructing compressed suffix arrays

被引:37
作者
Hon, Wing-Kai [1 ]
Lam, Tak-Wah
Sadakane, Kunihiko
Sung, Wing-Kin
Yiu, Siu-Ming
机构
[1] Univ Hong Kong, Dept Comp Sci, Hong Kong, Hong Kong, Peoples R China
[2] Kyushu Univ, Dept Comp Sci & Commun Engn, Fukuoka 812, Japan
[3] Natl Univ Singapore, Sch Comp, Singapore 117548, Singapore
关键词
text indexing; pattern matching; compression; construction;
D O I
10.1007/s00453-006-1228-8
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
With the first human DNA being decoded into a sequence of about 2.8 billion characters, much biological research has been centered on analyzing this sequence. Theoretically speaking, it is now feasible to accommodate an index for human DNA in the main memory so that any pattern can be located efficiently. This is due to the recent breakthrough on compressed suffix arrays, which reduces the space requirement from O (n log n) bits to O (n) bits. However, Constructing compressed suffix arrays is still not an easy task because we still have to compute suffix arrays first and need a working memory of O (n log it) bits (i.e., more than 13 gigabytes for human DNA). This paper initiates the study of constructing compressed suffix arrays directly from the text. The main contribution is a construction algorithm that uses only O (n) bits of working memory, and the time complexity is O (n log n). Our construction algorithm is also time and space efficient for texts with large alphabets such as Chinese or Japanese. Precisely, when the alphabet size is vertical bar Sigma vertical bar, the working space is O (n log vertical bar Sigma vertical bar) bits, and the time complexity remains O (n log n), which is independent of vertical bar Sigma vertical bar.
引用
收藏
页码:23 / 36
页数:14
相关论文
共 22 条
[1]  
BURROWS M, 1994, 12J DIG EQ CORP
[2]  
Clark DR, 1996, PROCEEDINGS OF THE SEVENTH ANNUAL ACM-SIAM SYMPOSIUM ON DISCRETE ALGORITHMS, P383
[3]   Indexing compressed text [J].
Ferragina, P ;
Manzini, G .
JOURNAL OF THE ACM, 2005, 52 (04) :552-581
[4]  
Ferragina P, 2001, SIAM PROC S, P269
[5]   Compressed suffix arrays and suffix trees with applications to text indexing and string matching [J].
Grossi, R ;
Vitter, JS .
SIAM JOURNAL ON COMPUTING, 2005, 35 (02) :378-407
[6]  
Grossi R, 2003, SIAM PROC S, P841
[7]  
Grossi R., 2004, Proceedings of the fifteenth annual ACM-SIAM symposium on Discrete algorithms, P636
[8]  
Hon W.K., 2004, ALENEX ANALC
[9]  
Hon WK, 2003, ANN IEEE SYMP FOUND, P251
[10]   Database indexing for large DNA and protein sequence collections [J].
Hunt, E ;
Atkinson, MP ;
Irving, RW .
VLDB JOURNAL, 2002, 11 (03) :256-271