Exercise 5.2.3

SARSA: find and fix errors in faulty pseudocode

Reinforcement Learning › Exercises › Lecture 5 · Model-Free Control › 5.2 SARSA: on-policy TD control
MediumWritten

The image below shows the pseudo-code of a faulty SARSA algorithm. What are the problems in this SARSA algorithm? There are six problems in total. Find at least four, explain what is wrong, and fix it.

algorithm pseudocode
Algorithm 1: Faulty SARSA with \(\epsilon\)-greedy policy