This is a course to introduce the students to theories of Markov decision processes. Emphasis will be on the rigorous mathematical treatment of the theory of Markov decision processes. Topics will include MDP finite horizon, MDP with infinite horizon, and some of the recent development of solution method.