Imported from https://github.com/meg965/pytorch-rl