In our previous work we have demonstrated that the perceived wander of image intensities as seen through the windows" of each pixel due to atmospheric turbulence can be modelled as a simple oscillator pixel-by-pixel and a linear Kalman filter (KF) can be finetuned to predict to a certain extent short term future deformations. In this paper, we are expanding the Kalman filter into a Hybrid Extended Kalman filter (HEKF) to fine tune itself by relaxing the oscillator parameters at each individual pixel. Results show that HEKF performs significantly better than linear KF.