40 Resources to Completely Master Markov Decision Processes

The Markov Decision Process is the formal description of the Reinforcement Learning problem. It includes concepts like states, actions, rewards, and how an agent makes decisions based on a given policy. So, what Reinforcement Learning algorithms do is to find optimal solutions to Markov Decision Processes.

Markov Decision Process

Because it is a fundamental concept in the Reinforcement Learning domain, we selected more than 40 resources about Markov Decision Process, including blog posts, books, and videos. Check the links below.

Blog Posts

• Reinforcement Learning Demystified: Markov Decision Processes (Part 1)
• Reinforcement Learning Demystified: Markov Decision Processes (Part 2)
• RL part 3. Markov Decision Process, policy, Bellman Optimality Equation.
• AN INTRODUCTION TO REINFORCEMENT LEARNING – I :: MARKOV DECISION PROCESSES
• Markov Decision Processes, by Applied Probability Notes
• Markov Decision Process for Tic Tac Toe
• Self Learning AI-Agents Part I: Markov Decision Processes
• Getting Started with Markov Decision Processes: Reinforcement Learning
• Understanding Markov Decision Processes
• Markov chains and Markov Decision process
• Not-So-Deep Reinforcement Learning for dummies — Part 2
• Markov Decision process

Books

• Markov Decision Processes: Discrete Stochastic Dynamic Programming
• Continuous-Time Markov Decision Processes
• Planning with Markov Decision Processes: An AI Perspective
• Markov Decision Processes in Practice
• Constrained Markov Decision Processes
• Reinforcement Learning, an Introduction

Videos

https://www.youtube.com/watch?v=my207WNoeyA

Markov Decision Processes (MDPs) - Structuring a Reinforcement Learning Problem

https://www.youtube.com/watch?v=Jk2V9yA82YU

Markov Decision Processes - Georgia Tech - Machine Learning

https://www.youtube.com/watch?v=BxIG76-C37k

Markov Decision Processes Two - Georgia Tech - Machine Learning

https://www.youtube.com/watch?v=Jw3ZnWFjDfM

Markov Decision Processes Three - Georgia Tech - Machine Learning

https://www.youtube.com/watch?v=dkBZ9YKuOVA

Markov Decision Processes Four - Georgia Tech - Machine Learning

https://www.youtube.com/watch?v=lfHX2hHRMVQ

RL Course by David Silver - Lecture 2: Markov Decision Process

https://www.youtube.com/watch?v=hMbxmRyDw5M

Reinforcement Learning 3: Markov Decision Processes and Dynamic Programming

https://www.youtube.com/watch?v=Oxqwwnm_x0s

Lecture 8 MDPs

https://www.youtube.com/watch?v=Csiiv6WGzKM

Lecture 9: Markov Decision Process II

https://www.youtube.com/watch?v=mNGVkKeMUtc

Markov Rewards and Dynamic Programming

https://www.youtube.com/watch?v=IkbkEtOOC1Y

Markov Chains I

https://www.youtube.com/watch?v=ZulMqrvP-Pk

Markov Chains II

https://www.youtube.com/watch?v=HIMxdWDLEK8

Markov Chains III

https://www.youtube.com/watch?v=1GoxbgSQwfM

Reinforcement Learning and Markov Decision Processes I

https://www.youtube.com/watch?v=g2GnL8MVHHc

Reinforcement Learning and Markov Decision Processes II

https://www.youtube.com/watch?v=KovN7WKI9Y0

Markov Decision Processes

https://www.youtube.com/watch?v=DgRqxKt2DYE

Markov Decision Process (MDP) Tutorial

https://www.youtube.com/watch?v=HmcyDQZbEFs

introduction to Markov Decision Processes (MFD)

https://www.youtube.com/watch?v=jpmZp3eX-wI

An Introduction to Markov Decision Processes and Reinforcement Learning

https://www.youtube.com/watch?v=SWYceQpEVKM

CS885 Lecture 2a: Markov Decision Processes

https://www.youtube.com/watch?v=qkdB37Wq6tw

Grad Course in AI (#11): Markov Decision Processes

https://www.youtube.com/watch?v=7-HMYuMroak

Marcus Hutter - Markov Decision Processes