Exercise R.1.3
Conditional probability: random moves between four rooms
Consider this grid, where each cell is a "room" \(X_t\) denoting our position at time \(t\).
Assume we are moving randomly and need to move to an adjacent room each time. The probability of being in any room is equiprobable, namely: \[\begin{align*} \mathbb{P}(X_t=1)=\mathbb{P}(X_t=2)=\mathbb{P}(X_t=3)=\mathbb{P}(X_t=4)=0.25 \end{align*}\] Now let \(X_t\) denote our current room. What are \(\mathbb{P}(X_{t+1}=3 \mid X_t=3), \mathbb{P}(X_{t+1}=3 \mid X_t=2), \mathbb{P}(X_{t+1}=1 \mid X_t=3)\), and \(\mathbb{P}(X_{t+2}=1 \mid X_t=4)\)? Remember we can only move to adjacent rooms and not diagonally and cannot stay in the same room.