Link Search Menu Expand Document
CSCI 2470

Course Schedule

Lectures

Sep. 15, Tue
Machine Learning Recap and Perceptrons
Chen Sun
  1. Slides
  2. Recommended Reading: What is AI?
Sep. 17, Thu
Loss Functions and Optimization
Chen Sun
  1. Slides
Sep. 17, Thu
HW1 Setup and Warm-up
  1. Due date: TBA
Sep. 22, Tue
Stochastic Gradient Descent and MLP
Chen Sun
  1. Slides
Sep. 24, Thu
Backpropagation
Chen Sun
  1. Slides
  2. Recommended Reading: Hacker’s guide to Neural Networks
Sep. 29, Tue
Deep Learning Softwares and Hardwares
Chen Sun
  1. Slides
Oct. 1, Thu
Convolutional Neural Networks: Introduction
Chen Sun
  1. Slides
  2. Recommended Reading: The Bitter Lesson
  3. Recommended Reading: Induction, Inductive Biases, and Infusing Knowledge into Learned Representations
Oct. 1, Thu
HW2 Convolutional Neural Networks
  1. Due date: TBA
Oct. 6, Tue
Convolutional Neural Networks: Architectures
Chen Sun
  1. Slides
Oct. 8, Thu
Convolutional Neural Networks in Practice
Chen Sun
  1. Slides
Oct. 13, Tue
Multimodal Learning
Chen Sun
  1. Slides
Oct. 13, Tue
MP1 Multimodal Learning
  1. Due date: TBA
Oct. 15, Thu
Automatic Differentiation
Chen Sun
  1. Slides
Oct. 15, Thu
HW3 Beras
  1. Due date: TBA
Oct. 20, Tue
Word Embedding and RNNs
Chen Sun
  1. Slides
Oct. 22, Thu
Machine Translation
Chen Sun
  1. Slides
Oct. 27, Tue
LSTM and Transformers
Chen Sun
  1. Slides
Oct. 29, Thu
Transformer Applications
Chen Sun
  1. Slides
Oct. 29, Thu
Final Final Project Proposal
  1. Due date: TBA
Nov. 5, Thu
Graph Neural Networks, Intro to Generative Models
Chen Sun
  1. Slides
Nov. 10, Tue
Deep Generative Models in Practice
Chen Sun
  1. Slides
Nov. 10, Tue
Feedback Mid-term Feedback Form
  1. One extra late day for students who submit this form :)
Nov. 10, Tue
HW4 Image Captioning
  1. Due date: TBA
Nov. 12, Thu
Autoencoders and Self-supervised Learning
Chen Sun
  1. Slides
Nov. 17, Tue
Variational Autoencoders
Chen Sun
  1. Slides
Nov. 19, Thu
Diffusion Models
Chen Sun
  1. Slides
Nov. 19, Thu
MP2 Diffusion and Langevin Dynamics
  1. Due date: TBA
Nov. 24, Tue
Reinforcement Learning: Overview
Chen Sun
  1. Slides
Dec. 1, Tue
Diffusion Models: Applications
Chen Sun
  1. Slides
Dec. 1, Tue
Final Final Project Check-in
  1. Due date: TBA
Dec. 1, Tue
HW5 Reinforcement Learning
  1. Due date: TBA
Dec. 1, Tue
MP3 Applications of Diffusion
  1. Due date: TBA
Dec. 3, Thu
Policy Gradients
Chen Sun
  1. Slides
Dec. 8, Tue
Policy Optimization
Chen Sun
  1. Slides
Dec. 10, Thu
Final Deep Learning Day (Location TBA)
  1. Report due date: TBA
  2. Slides