Exercise 1.7.1

Upper confidence bound (UCB): derive the uncertainty term