A novel, efficient, and simple modification to standard marching-on-in-time (MOT) based time-domain integral equation (TDIE) solvers is presented. It allows for the use of high-order temporal interpolators without the need to extrapolate and predict future unknowns. The order of these temporal interpolators is increased as the distance of source and testing quadrature points increases. The proposed TDIE solver significantly increases the accuracy of solutions by exploiting high-order temporal interpolation at no significant extra computational cost. Numerical examples are presented to validate the proposed method.