Monty Hall transition system

This is an example of a partially defined Markov decision process.