Convergence properties of the stochastic gradient adaptive algorithm based on the least mean absolute third (LMAT) error criterion are presented. The performance of the algorithm is examined and compared for several different probability densities of the measurement noise in the system identification mode. It is observed that the LMAT algorithm outperforms the LMS algorithm for most noise probability densities, except in the case of exponentially distributed noise.