CS 4033/5033 Machine Learning Class schedule

Fall 2018

The following is a preliminary schedule of the lectures and presentations for CS 4033/5033 Machine Learning for Fall 2018. This specific order of each topic will depend on the class projects and interest. This will be finalized in the first week. The schedule will be updated throughout the semester as we delve deeper into special topics and/or add additional topics of interest. The project deadlines are in red and will not change, even if other parts of the schedule change.

Date Topic Assigned Reading Assigned today Due today
Week 1: Introduction
Aug 20 Overview of the course. What is machine learning? What will I learn if I take this class? Elements of Statistical Learning (ESL), Chapter 1   Pretest (in class)

Aug 22


Introduction to Reinforcement learning , Exploration & Exploitation, The RL problem Sutton & Barto: Chapters 1 & 2    
Week 2: Reinforcment Learning
Aug 27 Project introduction, The RL problem Sutton & Barto: Chapter 3 Projects, HW 1
Aug 29 The RL Problem      

Week 3: Reinforcment Learning

Sep 3
Labor Day (no class)
Sep 5 The RL Problem    

HW 1

Online RL project proposals

Week 4: Reinforcement learning
Sep 10 RL problem     Written RL project proposals
Sep 12

TD learning, Q-learning

Sutton & Barto: Chapter 6 HW 2  
Week 5: Reinforcment learning
Sep 17 Eligibility Traces, Sutton & Barto: Chapter 7 and 12  


Sep 19

RL using function approximation

Sutton & Barto: Chapter 9

  HW 2 (Friday)
Week 6: Supervised learning

Sep 24

Introduction to SL, Nearest Neighbor, K-means clustering, ,

ESL Chapter 2.1-2.3, ESL Chapter 3.1-3.2


Short project checkpoint

Long checkpoint 1

Sep 26

Least Squares Linear Regression, Logistic regression, Introduction to regularization

Logistic: Wikipedia and ESL Chapter 4.4

Week 7: Model evaluation and short RL projects

Oct 1

Ridge, Lasso, and Elastic nets, Overfitting, Bias-Variance Tradeoff, Model selection

Ridge/Lasso/Elastic: ESL Chapter 3.3-3.8

HW 3  

Oct 3

Short RL project presentations


Short RL project presentations

Week 8: Tree-based methods and long SL projects
Oct 8

Model evaluation and verification

ESL Chapter 7

Oct 10

Decision trees


ESL Chapter 9.2  

Online Long SL Project Proposals

Written Short RL projects

Week 9: Ensembles and Introduction to Neural Networks

Oct 15

Decision trees, and ensemble methods



Written Long SL project proposals

Long RL checkpoint 2

Oct 17

Boosting, Bagging, Ensemble methods, Random Forests and Gradient Boosted Regression Trees

ESL Chapter 8.7, ESL Chapter 10, ESL Chapter 15

  HW 3 (Oct 20)
Week 10: Neural Nets

Oct 22

Neural Networks, Backpropagation

ESL Chapter 11    

Oct 24


  HW 4


Week 11: Neural Nets, Long RL projects, Deep learning
Oct 29

Long RL project presentations

    Long RL project presentations

Oct 31

Finish any Long RL project presentations

As time allows: Convolutional Neural Nets/Deep learning

Neural Networks and Deep Learning chapter 6 and see the readings on Canvas  

Long RL project presentations

Long SL checkpoint 1

Week 12: Deep learning and Short SL projects
Nov 5

Convolutional Neural Nets/Deep learning

Neural Networks and Deep Learning chapter 6 and see the readings on Canvas



Nov 7

Semantic segmentation, fully convolutional nets, U-nets


Written long RL projects

Online Short SL project proposals

HW 4 (Friday)

Week 13: Deep learning
Nov 12 Generative Adversarial Models, LSTM (long short-term memory)


HW 5 Written SL project proposals
Nov 14 Deep RL: AlphaZero

AlphaZero paper

Week 14: Deep learning and deep RL
Nov 19

Introduction to Bayesian methods (Naive Bayes)

If time allows: Support Vector Machines introduction

ESL Chapter 11  

Short SL checkpoint

Long SL checkpoint 2

Nov 21
Thanksgiving vacation
Week 15: Kernel methods, SVR, SVM
Nov 26
Kernel methods, Kernel trick, SVR, SVMs
ESL Chapter 11
Nov 28
Feature importance, learning how to interpret ML models.
    HW 5
Week 16: Project presentations
Dec 3 SL project presentations (long ones go first)     Oral SL projects: long projects present first
Dec 5 SL project presentations (short ones and remaining long ones)     Oral SL projects: short projects present second
Week 17: Final
Dec 14, 4:30-6:30
Final project writeup due