Exercise 5.2.3
SARSA: find and fix errors in faulty pseudocode
Reinforcement Learning › Exercises › Lecture 5 · Model-Free Control › 5.2 SARSA: on-policy TD control
The image below shows the pseudo-code of a faulty SARSA algorithm. What are the problems in this SARSA algorithm? There are six problems in total. Find at least four, explain what is wrong, and fix it.