Comment by kxyvr

Is there any particular reason why we have conversations on learning rates and not simply use a line-search that finds a point that satisfies the strong Wolfe conditions?

https://en.wikipedia.org/wiki/Wolfe_conditions

Unless I'm missing something, optimization theory and practice tells us concretely how to guarantee convergence.