|Vorlesung:||Montag,||17:15 - 18:45, 1/305||(Dr. J. Vitay)|
|Übung:||Mittwoch,||09:15 - 10:45, 1/B202||(R. Larisch)|
|Übung:||Mittwoch,||15:30 - 17:00, 1/B202||(Dr. M. Teichmann)|
|Übung:||Freitag,||11:30 - 13:00, 1/B202||(Dr. M. Teichmann)|
Prerequisites: Modules in Mathematics I to IV, basic knowledge in Python.
Exam: written examination (90 minutes), 5 credit points.
Contact: julien dot vitay at informatik dot tu-chemnitz dot de.
Language: English. The exam can of course be done in German.
The written exam will be on Tuesday 19.02 at 13:30 in the room 1/316 only! The 1/201 will not be used.
Content of the exam: everything except: 1) Restricted Boltzmann Machines (RBM), 2) Policy Gradient (deep RL), 3) AlphaGo.
The course will present an introduction to the research field of Machine Learning, including Supervised Learning, Deep Learning and Reinforcement Learning. The different algorithms presented during the lectures will be studied in more details during the exercises, through implementations in Python.
The plan of the course is:
- Supervised learning
- Linear algorithms (regression, classification, softmax, maximum likelihood)
- Learning Theory (cross-validation, VC dimension, feature space)
- Neural Networks (MLP, regularization)
- Support vector machines (maximum margin classifier, kernel trick)
- Deep Learning (CNN, GAN)
- Recurrent neural networks (LSTM, GRU)
- Reinforcement Learning
- Formal definition of the RL-Problem (Markov Decision Processes)
- Dynamic Programming, Monte Carlo Methods
- Temporal Difference Learning (TD, Q-learning), Eligibility traces
- Deep Reinforcement learning (DQN, A3C, DDPG)
- "Deep Learning", Goodfellow, Bengio & Courville
- "Support Vector Machines and other kernel-based learning methods", Cristianini & Shawe-Taylor
- "Reinforcement Learning", Sutton & Barto (1st and 2nd editions)
- How do I register for the course?
You don't. There is no OPAL or anything, just show up to the lectures/exercises and register for the exam in December.
- How do I register for the exam?
search for Registration on SBService happens in December. Only registered students can participate to the exam.
- I cannot assist to the exercises. Can I take the exam anyway?
Yes. The exercises are there to help you understand the concepts seen in the lectures and get practical experience with machine learning tools. But they are not obligatory for the exam.
- Do I have to memorize all these equations?
No, but to understand them, which is basically the same.
Slides for the lecturesChapter 01 - Introduction (pdf)
Chapter 02 - Linear learning machines (pdf)
Chapter 03 - Learning theory (pdf)
Chapter 04 - Neural networks (pdf)
Chapter 05 - Support-vector machines (pdf)
Chapter 06 - Deep learning (pdf)
Chapter 07 - Recurrent neural networks (pdf)
Chapter 08 - Reinforcement Learning (pdf)
Chapter 09 - Deep Reinforcement Learning (pdf)
Bonus - Introduction to the game of Go (pdf)
To use Jupyter notebooks in the B202, follow these guidelines (pdf).Exercise 01 - Introduction to Python and NumPy. (questions , solution )
Exercise 02 - Linear classification. (questions , solution )
Exercise 03 - Cross-validation. (questions , solution )
Exercise 04 - Multi-layer perceptron. (questions , solution )
Exercise 05 - Multi-layer perceptron on the MNIST dataset. (questions , solution )
Exercise 06 - Support-vector machines. (questions , solution )
Exercise 07 - Convolutional neural networks. (questions , solution )
Exercise 08 - Transfer learning. (questions , solution )
Exercise 09 - Reinforcement learning (skipped). (questions , solution )
Exercise 10 - Q-learning and Gridworld. (questions , solution )