Gradient descent: step size and convergence

How gradient descent steps against the gradient, why the step size (learning rate) must stay under 2/L, and how the condition number sets its pace.

Part of Fitting a model.

Read first

Read next