Optimization – why momentum really works

This post explains why momentum works in optimization.  Nice interactive images are used to this aim.

Here you can find another overview of gradient-descent based methods.