Exercise 4.1.3
Monte Carlo prediction: every-visit versus first-visit on blackjack
Reinforcement Learning › Exercises › Lecture 4 · Monte Carlo Methods and TD Learning › 4.1 Monte Carlo prediction
Suppose every-visit MC was used instead of first-visit MC on the blackjack task. Would you expect the results to be very different? Why or why not?
Source: Sutton & Barto (2018), Reinforcement Learning: An Introduction, 2nd ed., Exercise 5.2. Licensed CC BY-NC-ND 2.0.