Exercise 5.7.1
Off-policy learning: identify an off-policy scenario
In reinforcement learning, the distinction between on-policy and off-policy methods is crucial for understanding how different algorithms learn from the environment. Which of the following scenarios allow us to identify the usage of an off-policy method?