Imported from https://github.com/BorealisAI/pommerman-baseline