Exercise 6.4.3
Linear vs non-linear function approximators: trade-offs
Reinforcement Learning › Exercises › Lecture 6 · Function Approximation › 6.4 Convergence, divergence and experience replay
Discuss the trade-offs in choosing a linear function approximator versus a more complex, non-linear one (like a neural network). Consider aspects like computational complexity, stability, and representational power.