Reinforcement Learning

An introductory course in eight lectures, with video recordings, tutorials and exercises, following Sutton and Barto's textbook.

The course goes from the exploration–exploitation dilemma in multi-armed bandits, through finite Markov decision processes, dynamic programming, and Monte Carlo and temporal-difference learning, to function approximation, policy gradients and model-based methods. It follows R. S. Sutton and A. G. Barto, Reinforcement Learning: An Introduction, 2nd ed., 2018, free online from the authors.

Course map

Each concept of the lectures, in the order the slides teach it. The slide link opens the deck at the first slide on the concept; the task links open the tutorial at the task that practises it, and the exercise links open the exercises on the concept, numbered lecture.concept.n.

EasyMediumHardCodehas a coding partEx 1.9.3dashed: filed under another concept, also practises this one

R Background review 8 topics · probability and functional analysis
1 Exploration Methods Slides (102) Video Tutorial 1 9 concepts
2 The RL Problem and Finite MDPs Slides (77) Video Tutorial 2 6 concepts
3 Dynamic Programming Slides (78) Video Tutorial 3 7 concepts
4 Monte Carlo Methods and TD Learning Slides (68) Video Tutorial 4 5 concepts
5 Model-Free Control Slides (62) Video Tutorial 5 7 concepts
6 Function Approximation Slides (65) Video Tutorial 6 4 concepts
7 Policy Gradients and Actor-Critic Slides (58) Video Tutorial 7 5 concepts
8 Model-Based Reinforcement Learning Slides (45) Video 2 concepts

© 2025–2026 Rafael Fernandes Cunha · Originally developed for Reinforcement Learning (WBAI061-05), University of Groningen.