CS 5480: Deep Learning


Legend for Reading Assignments


Label Reference / Book
Bishop Deep Learning: Foundations and Concepts, by Christopher M. Bishop and Hugh Bishop
Shalev-Shwartz Understanding Machine Learning: From Theory to Algorithms, by Shai Shalev-Shwartz and Shai Ben-David
Zhang Dive into Deep Learning, by Aston Zhang, Zachary C. Lipton, Mu Li, and Alexander J. Smola.

Tentative Schedule for SP 2025


Lecture # Date Topic and Slides Subtopics Reading Assignment
1 Jan 22 T1: Learning (T0: Course Introduction), What is Learning? Shalev-Shwartz (Chap 2)
2 Jan 24 Empirical Risk Minimization, Linear Regression Bishop (Chap 4)
3 Jan 27 (Recorded Lecture to be posted in Panapto folder, in-class activities) Linear Classification, Perceptron Bishop (Chap 6)
4 Jan 29 (Recorded Lecture to be posted in Panapto folder, in-class activities) Need for Deep Learning, Multi-Layer Perceptrons Bishop (Chap 6)
5 Jan 31 (Reserve lecture for in-class activities)
6 Feb 3 (Recorded Lecture to be posted in Panapto folder, in-class activities) Activation Functions Bishop (Chap 6)
7 Feb 5 Optimization, First-Order Algorithms Bishop (Chap 7)
8 Feb 7 Momentum, Adaptive Rate Bishop (Chap 7)
9 Feb 10 Data Parallelism Bishop (Chap 7)
10 Feb 12
11 Feb 14
12 Feb 17 T2: CNNs
13 Feb 19
14 Feb 21
15 Feb 24
16 Feb 26
17 Feb 28
18 Mar 3
19 Mar 5 T3: Transformers
20 Mar 7
21 Mar 10
22 Mar 12
23 Mar 14 Spring Recess (No Class)
24 Mar 17
25 Mar 19 Exam Topics:
26 Mar 21 Spring Break (No Class)
27 Mar 24
28 Mar 26
29 Mar 28
30 Mar 31 T4: GNNs
31 Apr 2
32 Apr 4
33 Apr 7
34 Apr 9 T5: Deep RL
35 Apr 11
36 Apr 14
37 Apr 16
38 Apr 18
39 Apr 21 T6: Generative Models
40 Apr 23
41 Apr 25
42 Apr 28
43 Apr 30
44 May 2
45 May 5 Project Presentations
46 May 7
47 May 9