Exercise R.5.5

Gradient descent: starting points stuck at a saddle point

Reinforcement Learning › Exercises › Background review › R.5 Step-size conditions
MediumWritten

Consider \(f(x)=x^4-x^3\) and provide the range of starting points \(x_0\) such that gradient descent will get stuck in a flat region forever (assuming a small enough learning rate such that GD will converge).

Hint: Plot it in Desmos. Also, \(f'(0)=0\).