Avsnittsöversikt
-
Continue on Recurrent NN
Reading: 10.1-10 (skip 10.8)
Special Topic: Attention Mechanism and Transformers
Reading: Chapter 11 of "Dive into Deep Learning" (https://d2l.ai)
REMARKS: The book "Dive into Deep Learning" contains many state-of-the-art topics in DL that can be used as an excellent supporting reference. The book is also better written with more graphical illustrations compared to Goodfellow's book. Nevertheless, the "Dive" book doesn't provide enough mathematical and statistical backgrounds of DL and therefore is not recommended as the main textbook for the course. The best learning path is to first build up a firm background from Goodfellow's book and then move on to the "Dive" book to learn about the modern developments with better understanding.