Imported from https://github.com/apourchot/ERL-pytorch