Exercise 2.4.1
Value functions: comparing policies by v_π(s) in every state
Reinforcement Learning › Exercises › Lecture 2 · The RL Problem and Finite MDPs › 2.4 Bellman expectation equations
In value-based methods within the context of reinforcement learning, how are different policies compared to identify which one is better?