Exercise 2.2.1

Markov property: which history-independence equality is false

EasyMultiple choice

Consider the transition function of a Markov Decision Process (MDP) as \(p(S_{t+1} = s'| S_t = s, A_t = a)\), where \(S_t= s\) is the current state at time \(t\), \(S_{t+1} = s'\) is the next state at time \(t+1\), and \(A_t = a\) is the action at time \(t\). Consider also that \(R_t\) represents the reward at time \(t\). Which of the following statements is false in a MDP?