Imported from https://github.com/vcadillog/PPO-Mario-Bros-Tensorflow-2