Why does Markov Decision Process matter in Reinforcement Learning?

Comparison between MDP and k-armed bandit problems to see how MDP is better-fitted in the real world

Photo by janan lagerwall on Unsplash

For most learners, the Markov Decision Process(MDP) framework is the first to know when diving into Reinforcement Learning (RL). However, can you explain why it is so important? Why not…