CMSC5728: Decision Analysis and Game Theory
Student/Faculty Expectations on Teaching and Learning
Prof. John C.S. Lui
This is a graduate level course which covers theory on decision science.
There are several main topics I plan to cover, they are:
(a) Multi-armed bandit theory;
(b) Game theory;
(c) Reinforcement learning theory.
I like to emphasize that course
is mathematical and algorithmic in nature.
I will introduce a lot of concepts, show the mathematical proves,
and present the physical meanings and applications.
Students are expected to follow and understand my lecture,
and also do a lot of readings and do some programming (via Python).
are expected to attend the lecutre,
read the leture notes and understand them,
spend time to read resources on the Internet,
do the homework,
do the programming assignments,..etc,
so to keep pace with this course.
- Dr. Kechao Cai
Office, HSH Eng Bldg, Room 120. (Email: firstname.lastname@example.org)
- Homework: 20%
- Programming assignments: 30%
- Exam: 50%
Students need to get at least 30% in the final exam to pass, independent
of their performance in programming exercises.
IMPORTANT REMINDERS !!!!!!
- Final Examination will be on December 3, 2019. 7:00 pm till 9:00 pm.
Venue will be ERB 404.
- No late homework, programming assignments or projects will be accepted;
Outline for the course:
(Note: I usually prepare more materials
than we can cover in a semester. I will leave those materials I can't
cover to students as a self-learning tool.)
- Introduction to topics on decision science
- Stochastic multi-armed bandit (MAB)
- UCB algorithms and regret bound
- Thompson Sampling and its application to MAB
- Adersarial Bandits
- Linear Bandits
- Contextual Bandit
- MAB application: Dynamic Pricing
- MAB application: networking, crowdsourcing, and multipath protocols
- MAB with budget constraints
- Game theory
- Two-player game
- Concept of equilibrium (Nash Equilibrium)
- Dynamic Games
- Markov Decision Process
- TD-learning, Q-learning
- Approximate DP theory
- Policy gradient methods
(Lecture Notes are available at CUHK Blackboard (https://blackboard.cuhk.edu.hk/))
Please refer to the CUHK Blackboard
Written homework and programming assignment
Please go to the "Blackboard" to access the specification.