Lecture 1

Theory

Lecture slides: Here

These hands-on exercesises focus on first implementing the Gradient Descent (GD) algorithm to then continue with the Stochastic GD (SGD) implementation. For the latter the MNIST / CIFAR-10 datasets will be used to illustrate a multiclass classification problem.