Imported from https://github.com/facundo-p/Markov-Game-Model