Imported from https://github.com/alondj/Pytorch-Gpipe