Exercise 1.7.1
Upper confidence bound (UCB): derive the uncertainty term
Reinforcement Learning › Exercises › Lecture 1 · Exploration Methods › 1.7 Upper confidence bound (UCB)
Show the derivation of the uncertainty term in the upper-confidence bound algorithm. Hint: Look into the extra material provided.