Course Schedule
Lectures
- Sep. 15, Tue
- Machine Learning Recap and Perceptrons (Slides)
- Chen Sun
- Recommended Reading: What is AI?
- Sep. 17, Thu
- Loss Functions and Optimization (Slides)
- Chen Sun
- Sep. 17, Thu
- HW1 Math and Machine Learning Recap
- Handout
- Sep. 22, Tue
- Stochastic Gradient Descent and Multi-layer Perceptrons (Slides)
- Chen Sun
- Sep. 24, Thu
- Backpropagation (Slides)
- Chen Sun
- Recommended Reading: Hacker’s guide to Neural Networks
- Sep. 29, Tue
- Deep Learning Softwares and Hardwares (Slides)
- Chen Sun
- Sep. 29, Tue
- Final Final project teaming
- Form
- Oct. 1, Thu
- Convolutional Neural Network: Introduction (Slides)
- Chen Sun
- Recommended Reading: The Bitter Lesson
- Recommended Reading: Induction, Inductive Biases, and Infusing Knowledge into Learned Representations
- Oct. 1, Thu
- HW2 CNN
- Handout
- GenAI form
- Oct. 6, Tue
- Convolutional Neural Network: Architectures (Slides)
- Chen Sun
- Oct. 8, Thu
- Convolutional Neural Networks in Practice (Slides)
- Chen Sun
- Oct. 13, Tue
- Representation Learning (Slides)
- Chen Sun
- Oct. 15, Thu
- Automatic Differentiation (Slides)
- Chen Sun
- Oct. 15, Thu
- HW3 Beras
- Handout
- GenAI form
- Oct. 20, Tue
- Language Modeling and Recurrent Neural Networks (Slides)
- Chen Sun
- The lecture is pre-recorded!
- Oct. 22, Thu
- RNNs and Attention (Slides)
- Chen Sun
- Oct. 27, Tue
- Transformers and LLMs (Recording Part 1 / Part 2, Slides)
- Chen Sun
- Oct. 28, Wed
- Final Final project proposal
- Add Your Slides Here
- Oct. 29, Thu
- Final Project Idea Pitch
- Slides
- Oct. 29, Thu
- HW4 LLMs
- Handout
- GenAI form
- Nov. 5, Thu
- Reinforcement Learning for LLMs (Slides)
- Zitian Tang
- Nov. 10, Tue
- INVITED Directions in Understanding and Improving LLM Post-training
- Rosie Zhao
- Nov. 12, Thu
- Intro to Diffusion Models
- Chen Sun
- Nov. 12, Thu
- MP1 Reinforcement Learning for LLMs
- Nov. 17, Tue
- Diffusion Models: Applications (Zoom)
- Chen Sun
- Nov. 19, Thu
- INVITED Invited Talk
- Mehul Damani
- Nov. 24, Tue
- Generative Models for Robotic Learning
- Zilai Zeng
- Nov. 24, Tue
- MP2 Diffusion Models
- Dec. 1, Tue
- Deep Generative Models in Practice (Recording)
- Chen Sun
- Dec. 3, Thu
- Video World Models for Robots
- Zilai and Zitian
- Dec. 4, Fri
- INVITED Invited Talk (Tentative)
- Andrew Owens
- Dec. 8, Tue
- Final Project Presentations (1)
- Dec. 10, Thu
- Final Project Presentations (2)
- Dec. 11, Fri
- INVITED Invited Talk
- Jiatao Gu
- Dec. 17, Thu
- Final Final Project Deliverables Due