This paper proposes a high-accuracy on-line structure-based handwritten Chinese phonetic symbol recognition system. Each reference symbol consists of visible and hidden line segments, where two line segments intersecting each other form an X-shape structure, and those forming a crucial T-shape structure mark a T-shape structure. The first-stage recognition performs the structure-based dynamic programming to match the input handwriting with reference symbols. The second-stage recognition performs the partialmerge dynamic programming to reevaluate the similarity between the input handwriting and the candidate symbols in a confusing set. The third-stage recognition performs the structure-constrained confirmation to determine the best candidate.