Based on the thought of Gauss-Seidel iteration, a parallel algorithm is proposed for solving the least-square problems, the method is proved to be convergent. The calculated amount is greatly reduced, thus calculating time is saved extensively when the method is used, because only triangle decomposition is needed for one of the submatrices of Matrix Jacobi and the decomposition is not needed for the whole Jacobi.