The following is a preliminary schedule of the lectures and presentations for CS 4033/5033 Machine Learning for Fall 2018. This specific order of each topic will depend on the class projects and interest. This will be finalized in the first week. The schedule will be updated throughout the semester as we delve deeper into special topics and/or add additional topics of interest. The project deadlines are in red and will not change, even if other parts of the schedule change.
| Date | Topic | Assigned Reading | Assigned today | Due today |
Week 1: Introduction |
||||
| Aug 20 | Overview of the course. What is machine learning? What will I learn if I take this class? | Elements of Statistical Learning (ESL), Chapter 1 | Pretest (in class) | |
Aug 22
|
Introduction to Reinforcement learning , Exploration & Exploitation, The RL problem | Sutton & Barto: Chapters 1 & 2 | ||
Week 2: Reinforcment Learning |
||||
| Aug 27 | Project introduction, The RL problem | Sutton & Barto: Chapter 3 | Projects, HW 1 | |
| Aug 29 | The RL Problem | |||
Week 3: Reinforcment Learning |
||||
| Sep 3 | Labor Day (no class)
|
|||
| Sep 5 | The RL Problem | HW 1 Online RL project proposals |
||
Week 4: Reinforcement learning |
||||
| Sep 10 | RL problem | Written RL project proposals | ||
| Sep 12 | TD learning, Q-learning |
Sutton & Barto: Chapter 6 | HW 2 | |
Week 5: Reinforcment learning |
||||
| Sep 17 | Eligibility Traces, | Sutton & Barto: Chapter 7 and 12 |
|
|
| Sep 19 | RL using function approximation |
Sutton & Barto: Chapter 9 |
HW 2 (Friday) | |
Week 6: Supervised learning |
||||
Sep 24 | Introduction to SL, Nearest Neighbor, K-means clustering, , |
ESL Chapter 2.1-2.3, ESL Chapter 3.1-3.2 |
Short project checkpoint Long checkpoint 1 |
|
| Sep 26 | Least Squares Linear Regression, Logistic regression, Introduction to regularization |
Logistic: Wikipedia and ESL Chapter 4.4 |
||
Week 7: Model evaluation and short RL projects |
||||
Oct 1 |
Ridge, Lasso, and Elastic nets, Overfitting, Bias-Variance Tradeoff, Model selection |
Ridge/Lasso/Elastic: ESL Chapter 3.3-3.8 |
HW 3 | |
Oct 3 |
Short RL project presentations |
Short RL project presentations |
||
Week 8: Tree-based methods and long SL projects |
||||
| Oct 8 | Model evaluation and verification |
ESL Chapter 7 |
||
| Oct 10 | Decision trees
|
ESL Chapter 9.2 | Online Long SL Project Proposals Written Short RL projects |
|
Week 9: Ensembles and Introduction to Neural Networks |
||||
Oct 15 |
Decision trees, and ensemble methods |
|
Written Long SL project proposals Long RL checkpoint 2 |
|
| Oct 17 | Boosting, Bagging, Ensemble methods, Random Forests and Gradient Boosted Regression Trees |
ESL Chapter 8.7, ESL Chapter 10, ESL Chapter 15 |
HW 3 (Oct 20) | |
Week 10: Neural Nets |
||||
Oct 22 |
Neural Networks, Backpropagation |
ESL Chapter 11 | ||
Oct 24 |
Backpropagation |
HW 4 |
|
|
Week 11: Neural Nets, Long RL projects, Deep learning |
||||
| Oct 29 | Long RL project presentations |
Long RL project presentations | ||
Oct 31 |
Finish any Long RL project presentations As time allows: Convolutional Neural Nets/Deep learning |
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas | Long RL project presentations Long SL checkpoint 1 |
|
Week 12: Deep learning and Short SL projects |
||||
| Nov 5 | Convolutional Neural Nets/Deep learning |
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas |
|
|
| Nov 7 | Semantic segmentation, fully convolutional nets, U-nets |
Written long RL projects Online Short SL project proposals HW 4 (Friday) |
||
Week 13: Deep learning |
||||
| Nov 12 | Generative Adversarial Models, LSTM (long short-term memory) |
|
HW 5 | Written SL project proposals |
| Nov 14 | Deep RL: AlphaZero | |||
Week 14: Deep learning and deep RL |
||||
| Nov 19 | Introduction to Bayesian methods (Naive Bayes) If time allows: Support Vector Machines introduction |
ESL Chapter 11 | Short SL checkpoint Long SL checkpoint 2 |
|
| Nov 21 | Thanksgiving vacation |
|||
Week 15: Kernel methods, SVR, SVM |
||||
| Nov 26 | Kernel methods, Kernel trick, SVR, SVMs |
ESL Chapter 11 |
||
| Nov 28 | Feature importance, learning how to interpret ML models. |
HW 5 | ||
Week 16: Project presentations |
||||
| Dec 3 | SL project presentations (long ones go first) | Oral SL projects: long projects present first | ||
| Dec 5 | SL project presentations (short ones and remaining long ones) | Oral SL projects: short projects present second | ||
Week 17: Final |
||||
| Dec 14, 4:30-6:30 | Final project writeup due |
|||