Week-by-week schedule#

Note: Italicized text indicates planned topics, but subject to change.

Date

Week

Topic

Milestones

Materials

Sep 30

1

Introduction, state space representation, coding basics

Ex 1,
lec01 (annotated),
quiz0(sol0)

Oct 7

2

Optimization

Ex 2, Ex 3,
lec02(annotated)

Oct 14

3

Stability and invariance, Lyapunov and barrier functions

Exercises 1,2,3 due Thurs

lec03(annotated), Ex 4, Ex 5, Ex 6

Oct 21

4

Value function, dynamic programming, Bellman equation

Self-assessment due Thurs

lec04(annotated), Ex 7, Ex 8

Oct 28

5

Markov Decision Process, POMDPs // Guest lecture: Dr. Liam Kruse

Exercises 4, 5, 6, 7, 8 due Thurs

Guest lecture, Ex 9

Nov 4

6

Linear quadratic regulator

Self-assessment due Thurs

lec06(annotated), Ex 10, Ex 11, Ex 12

Nov 11

7

(No lecture / Veterans Day)

Exercises 9, 10, 11, 12 due Thurs

lec07(annotated), HJ notebook

Nov 18

8

Trajectory optimization, MPC, learning-based control

Self-assessment due Thurs

lec08(annotated), Ex 13, Ex 14

Nov 25

9

Kalman filter and Linear Quadratic Gaussian

lec09(annotated)

Dec 2

10

Research paper presentation

Exercises 13 & 14 due Mon (Dec 1)

Finals

Video and feedback due, Self-assessment due Mon (Dec 8)