The following is a preliminary schedule of the lectures and presentations for CS 4033/5033 Machine Learning for Fall 2018. This specific order of each topic will depend on the class projects and interest. This will be finalized in the first week. The schedule will be updated throughout the semester as we delve deeper into special topics and/or add additional topics of interest. The project deadlines are in red and will not change, even if other parts of the schedule change.
Date  Topic  Assigned Reading  Assigned today  Due today 
Week 1: Introduction 

Aug 20  Overview of the course. What is machine learning? What will I learn if I take this class?  Elements of Statistical Learning (ESL), Chapter 1  Pretest (in class)  
Aug 22

Introduction to Reinforcement learning , Exploration & Exploitation, The RL problem  Sutton & Barto: Chapters 1 & 2  
Week 2: Reinforcment Learning 

Aug 27  Project introduction, The RL problem  Sutton & Barto: Chapter 3  Projects, HW 1  
Aug 29  The RL Problem  
Week 3: Reinforcment Learning 

Sep 3  Labor Day (no class)


Sep 5  The RL Problem  HW 1 Online RL project proposals 

Week 4: Reinforcement learning 

Sep 10  RL problem  Written RL project proposals  
Sep 12  TD learning, Qlearning 
Sutton & Barto: Chapter 6  HW 2  
Week 5: Reinforcment learning 

Sep 17  Eligibility Traces,  Sutton & Barto: Chapter 7 and 12 


Sep 19  RL using function approximation 
Sutton & Barto: Chapter 9 
HW 2 (Friday)  
Week 6: Supervised learning 

Sep 24  Introduction to SL, Nearest Neighbor, Kmeans clustering, , 
ESL Chapter 2.12.3, ESL Chapter 3.13.2 
Short project checkpoint Long checkpoint 1 

Sep 26  Least Squares Linear Regression, Logistic regression, Introduction to regularization 
Logistic: Wikipedia and ESL Chapter 4.4 

Week 7: Model evaluation and short RL projects 

Oct 1 
Ridge, Lasso, and Elastic nets, Overfitting, BiasVariance Tradeoff, Model selection 
Ridge/Lasso/Elastic: ESL Chapter 3.33.8 
HW 3  
Oct 3 
Short RL project presentations 
Short RL project presentations 

Week 8: Treebased methods and long SL projects 

Oct 8  Model evaluation and verification 
ESL Chapter 7 

Oct 10  Decision trees

ESL Chapter 9.2  Online Long SL Project Proposals Written Short RL projects 

Week 9: Ensembles and Introduction to Neural Networks 

Oct 15 
Decision trees, and ensemble methods 

Written Long SL project proposals Long RL checkpoint 2 

Oct 17  Boosting, Bagging, Ensemble methods, Random Forests and Gradient Boosted Regression Trees 
ESL Chapter 8.7, ESL Chapter 10, ESL Chapter 15 
HW 3 (Oct 20)  
Week 10: Neural Nets 

Oct 22 
Neural Networks, Backpropagation 
ESL Chapter 11  
Oct 24 
Backpropagation 
HW 4 


Week 11: Neural Nets, Long RL projects, Deep learning 

Oct 29  Long RL project presentations 
Long RL project presentations  
Oct 31 
Finish any Long RL project presentations As time allows: Convolutional Neural Nets/Deep learning 
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas  Long RL project presentations Long SL checkpoint 1 

Week 12: Deep learning and Short SL projects 

Nov 5  Convolutional Neural Nets/Deep learning 
Neural Networks and Deep Learning chapter 6 and see the readings on Canvas 


Nov 7  Semantic segmentation, fully convolutional nets, Unets 
Written long RL projects Online Short SL project proposals HW 4 (Friday) 

Week 13: Deep learning 

Nov 12  Generative Adversarial Models, LSTM (long shortterm memory) 

HW 5  Written SL project proposals 
Nov 14  Deep RL: AlphaZero  
Week 14: Deep learning and deep RL 

Nov 19  Introduction to Bayesian methods (Naive Bayes) If time allows: Support Vector Machines introduction 
ESL Chapter 11  Short SL checkpoint Long SL checkpoint 2 

Nov 21  Thanksgiving vacation 

Week 15: Kernel methods, SVR, SVM 

Nov 26  Kernel methods, Kernel trick, SVR, SVMs 
ESL Chapter 11 

Nov 28  Feature importance, learning how to interpret ML models. 
HW 5  
Week 16: Project presentations 

Dec 3  SL project presentations (long ones go first)  Oral SL projects: long projects present first  
Dec 5  SL project presentations (short ones and remaining long ones)  Oral SL projects: short projects present second  
Week 17: Final 

Dec 14, 4:306:30  Final project writeup due 