Back Propagation is now the most widely used tool in the field of Artificial Neural Networks. Many attempts try to enhance this algorithm to get minimum mean square error, less training time and small number of epochs. This paper first reviews the disadvantages of the Back Propagation algorithm. Next, the new modified Back Propagation is explained. Finally, comparison between the two algorithms is made through many examples.