What is the result of using other stepping methods (backwards Euler etc)?
How would we make it more likely to arrive at a global minimum instead of a local minimum?
How should we determine how small the tau value should be, since smaller the tau value the more steps to take, which means longer run time?
Is there an algorithm that optimally sets a variable step size?
What is the most efficient way to choose a step size?