Imported from https://github.com/bentrevett/pytorch-rl