This course represents half of Advanced Topics in Machine Learning (COMP 0083) from the UCL CS MSc on Machine Learning. The other half is an Introduction to Statistical Learning Theory, taught by Massimiliano Pontil .

This page will contain slides and detailed notes for the kernel part of the course. The assignment may also be found here (at the bottom of the page). Note that the slides will be updated as the course progresses, and I modify them to answer questions I get in the classes. I'll put the date of last update next to each document - be sure to get the latest one. Let me know if you find errors.

There are sets of practice exercises and solutions further down the page (after the slides).

For questions on the course material, please email Ilyes Khemakhem.

Slides and notes

Lectures 1 and 2 slides and notes, last modified 16 Oct 2019

Lecture 3 slides (notes same as for lectures 1 and 2), last modified 17 Oct 2018

Lecture 4 slides and notes, last modified 11 January 2020

Lecture 5,6 slides and notes (notes same as lecture 4), last modified 07 Nov 2018

Lecture 7 slides and notes (notes same as lecture 4), last modified 07 Nov 2018

Lecture 8 slides, last modified 27 Nov 2019

Lecture 9 slides and notes, last modified 30 Nov 2018

Lecture 10 Slides, last modified 13 Dec 2017

Theory lectures Slides 1, Slides 2 , and notes, last modified 20 Mar 2013

Supplementary lecture slides, last modified 22 Mar 2012


The assignment (first part due on Friday Nov 22, 2019). You will need this extract on incomplete Cholesky (scanned from Shawe-Taylor and Cristianini, Kernel Methods for Pattern Analysis). Last modified 04 Oct 2019.

Practice exercises and solutions

The exercises are taken from exams in previous years, with minor modifications. Worked solutions are provided. Last modified 18 Oct 2015.
  • Set 1
  • Set 2
  • Contact